Surveillance camera management system and surveillance camera management method

The surveillance camera management system uses autonomous robots and identification markers to detect abnormalities in surveillance cameras, reducing data communication needs and costs by focusing on marker detection rather than full image analysis.

JP2025006446AActive Publication Date: 2025-01-17MITSUBISHI ELECTRIC BUILDING SOLUTIONS CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023107249
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-06-29
Publication Date
2025-01-17
Estimated Expiration
2043-06-29

AI Technical Summary

Technical Problem

Existing surveillance camera systems face challenges in detecting abnormalities such as deviations in the angle of view or lens dirt, leading to increased data communication costs when managing multiple facilities remotely.

Method used

A surveillance camera management system that utilizes autonomous robots equipped with identification markers and surveillance cameras to detect abnormalities by detecting moving objects and extracting identification codes within a predetermined range, minimizing data communication by analyzing these markers rather than entire images.

Benefits of technology

This approach allows for efficient detection of surveillance camera abnormalities while reducing data communication requirements, thereby minimizing communication costs and ensuring timely identification of issues.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025006446000001_ABST
    Figure 2025006446000001_ABST
Patent Text Reader

Abstract

To provide a surveillance camera management system and a surveillance camera management method that can detect an abnormality in a surveillance camera while minimizing the amount of data communication required for abnormality detection.SOLUTION: A wireless communication device 72 is installed in a facility 1 in which a robot 40 travels by itself, and when the robot 40 travels within a communication range 102 in which communication with the robot 40 is possible, acquires identification information (robot ID) for identifying the robot 40 from the robot 40 via wireless communication. If no moving object is detected by a surveillance camera 70 within a first time period after the identification information is acquired by the wireless communication device 72, a server device 10 determines that the installation state is abnormal.SELECTED DRAWING: Figure 9
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a surveillance camera management system and a surveillance camera management method. [Background technology]

[0002] In the case of security cameras that monitor facilities, abnormalities may occur due to an abnormality in the installation of the security camera (misaligned viewing angle) or a dirty lens of the security camera. Whether such abnormalities have occurred is often checked visually by the facility manager. Alternatively, devices that automatically detect security camera abnormalities by analyzing images captured by the security camera have also been developed.

[0003] For example, JP 2018-26724 A (Patent Document 1) discloses an image processing device in which a user holding a marker walks around a monitored area, a surveillance camera captures the marker at each position, and the position and attitude of the camera are adjusted using the position coordinates of the captured marker. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-26724 A Summary of the Invention [Problem to be solved by the invention]

[0005] When using a device such as the image processing device in Patent Document 1 to detect abnormalities such as deviation in the angle of view of a surveillance camera or dirt on the lens, image analysis is performed based on multiple image (video) information obtained from the surveillance camera, which results in a large amount of data obtained from the surveillance camera.

[0006] For example, in a case where a cloud server is used to manage multiple facilities in remote locations, multiple images captured by surveillance cameras installed in the facilities must be acquired by a server device in the remote location via a communication line, and the server device must analyze the acquired images to detect abnormalities. In this case, the communication charges for acquiring the images must be high.

[0007] The present disclosure has been made to solve the above-mentioned problems, and its purpose is to provide a surveillance camera management system and a surveillance camera management method that can detect abnormalities in surveillance cameras while minimizing the amount of data communication required for abnormality detection. [Means for solving the problem]

[0008] A surveillance camera management system according to the present disclosure includes a communication device, a surveillance camera, and a control device. The communication device is installed in a facility where a robot travels by itself, and acquires identification information for identifying the robot from the robot via wireless communication when the robot travels within a predetermined range where communication with the robot is possible. The surveillance camera has a function of capturing images of the facility and detecting moving objects. The control device detects an abnormality in the surveillance camera based on information acquired from the communication device and information acquired from the surveillance camera. The predetermined range includes a range that the surveillance camera captures when the installation status of the surveillance camera is normal. The control device determines that the installation status is abnormal when no moving object is detected by the surveillance camera within a first time period after the identification information is acquired by the communication device.

[0009] The surveillance camera management method according to the present disclosure includes a step of a communication device acquiring identification information for identifying the robot from the robot via wireless communication when the robot is installed in a facility where the robot travels and travels within a predetermined range where communication with the robot is possible, a step of acquiring information from a surveillance camera having a function of capturing images of the facility and detecting moving objects, and a step of detecting an abnormality in the surveillance camera based on the information acquired from the communication device and the information acquired from the surveillance camera. The predetermined range includes a range that the surveillance camera captures when the installation status of the surveillance camera is normal. In the surveillance camera management method, the detecting step further includes a step of determining that the installation status of the surveillance camera is abnormal when no moving object is detected by the surveillance camera within a first time period after the identification information is acquired by the communication device. Effect of the Invention

[0010] According to the present disclosure, it is possible to detect an abnormality in a surveillance camera while minimizing the amount of data communication required for the abnormality detection. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a surveillance camera management system. [Diagram 2] FIG. 1 is a diagram illustrating a hardware configuration of a surveillance camera management system. [Diagram 3] FIG. 2 is a diagram for explaining a communication range and a camera imaging range. [Figure 4] 1 is an example of a camera image when the lens of a surveillance camera is not dirty. [Diagram 5] 1 is an example of a camera image when the lens of a surveillance camera is dirty. [Figure 6] 1A and 1B are diagrams for explaining a situation in which the installation state of a surveillance camera is abnormal. [Figure 7] 13 is an example of a camera image when the installation state of a surveillance camera is abnormal. [Figure 8] 11 is an example of detection result data. [Figure 9]13 is a flowchart of a server-side process and a robot-side process. [Figure 10] 13 is a display example of determination result data. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

[0013] Fig. 1 is a diagram showing the configuration of a surveillance camera management system 100. Fig. 2 is a diagram showing the hardware configuration of the surveillance camera management system 100.

[0014] As shown in FIG. 1, the surveillance camera management system 100 includes a server device 10 as a control device, a terminal 30, a gateway 29, a plurality of wireless communication devices 72 as communication devices, a plurality of surveillance cameras 70, and a robot 40.

[0015] Among these, the gateway 29, the wireless communication device 72, the surveillance camera 70, and the robot 40 are installed in a facility 1. The facility 1 is, for example, an office building, a commercial facility, a public facility, or the like.

[0016] The server device 10 is a server that manages the surveillance cameras 70 and is installed in a monitoring center 2 separate from the facility 1. The server device 10 can acquire information acquired from the surveillance cameras 70 and the wireless communication devices 72, etc., via a communication line. The server device 10 is configured to be able to manage the surveillance cameras 70 installed in a plurality of facilities. The terminal 30 may be installed in the facility 1, in the monitoring center 2, or in another facility.

[0017] The robot 40 is an autonomous mobile robot that autonomously moves within the facility 1. The robot 40 is a patrol robot that patrols and monitors the facility 1. However, without being limited thereto, the robot 40 may be a transport robot that transports luggage within the facility 1, a cleaning robot that cleans the facility, or any other robot that autonomously moves within the facility 1.

[0018] The device management device 20 is connected to a plurality of wireless communication devices 72 and a plurality of surveillance cameras 70. The device management device 20 controls the wireless communication devices 72 and the surveillance cameras 70, and is also capable of controlling the robot 40 via the wireless communication devices 72.

[0019] The device management device 20 can be connected to the communication network NW via a gateway 29. The server device 10, the terminal 30, and the device management device 20 can be communicatively connected to one another via the communication network NW.

[0020] A plurality of wireless communication devices 72 are installed on the ceilings 61 of the rooms, corridors, etc. in the facility 1. These wireless communication devices 72 communicate with the wireless communication device 42 provided in the robot 40, and can identify the current position of the robot 40.

[0021] Surveillance cameras 70 are installed on walls 62 of each room, hallway, etc. within facility 1, and capture images of the inside of the facility. Although not shown, images captured by surveillance cameras 70 are displayed on a monitor installed in a management room within facility 1. The manager of facility 1 can monitor the inside of facility 1 using the images displayed on this monitor.

[0022] The robot 40 travels on the floor 63 and patrols within the facility 1. When the robot 40 enters the communication range of the wireless communication device 72, the position of the robot 40 is identified by the wireless communication device 72, and when the robot 40 enters the imaging range of the surveillance camera 70, the image of the robot 40 is captured by the surveillance camera 70. The surveillance camera 70 is also provided with a moving object detection function (described later) that detects moving objects, and detects the robot 40 that enters the imaging range as a moving object.

[0023] 2, the server device 10 includes a processor 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a HDD (Hard Disk Drive) 14, and a communication IF (Interface) 15. The processor 11 is, for example, a CPU (Central Processing Unit). These devices exchange various data through a communication bus 16.

[0024] The processor 11 loads a program stored in the HDD 14 or the ROM 12 into the RAM 13 and executes it. In this program, processes to be executed by the server device 10 are described.

[0025] The communication IF 15 is an input / output device for exchanging signals or data with the device management device 20 and the terminal 30. The server device 10 can obtain information about the robot 40 and the surveillance camera 70 from the device management device 20 and information from the terminal 30 via the communication IF 15.

[0026] The HDD 14 is a storage device that stores various types of information, such as detection result data 81, determination result data 82, information about the facility 1, and information about the robot 40, which will be described later.

[0027] The robot 40 includes a control unit 41 , a wireless communication device 42 , a two-dimensional code 43 , a memory unit 44 , a camera 45 , a battery 48 , and a drive unit 47 .

[0028] A two-dimensional code is displayed on the surface of the robot 40 as an identification image for identifying the robot 40. The two-dimensional code 43 is, for example, a QR code (registered trademark) or the like. It is not limited to a two-dimensional code, and may be a barcode or the like. The robot 40 may be provided with something (a plate, a piece of paper, etc.) on which the two-dimensional code 43 is printed at a predetermined location, the robot 40 may be provided with a display device such as a display, and the two-dimensional code may be displayed on the display device, or any other code may be used as long as it presents an image that can be read by a reading device and that identifies the robot 40.

[0029] The control unit 41 controls the entire robot 40. Although not shown in the figure, the control unit 41 has a CPU, a ROM, a RAM, and a communication IF as main components. The CPU loads a program stored in the ROM into the RAM and executes it. The program stored in the ROM describes the processing to be executed by the robot 40. Note that the processing is not limited to being performed by software, and can also be executed by dedicated hardware (electronic circuits).

[0030] The wireless communication device 42 outputs a signal for detecting the position of the robot 40, for example, using a communication method conforming to the BLE (Bluetooth Low Energy; "Bluetooth" is a registered trademark) communication standard. Instead of the BLE communication standard, a communication method conforming to the UWB (Ultra Wide Band) communication standard may be used. The wireless communication device 42 also transmits a signal indicating an ID for identifying the robot 40 to the equipment management device 20, for example, using a communication method conforming to a wireless communication standard such as LTE (Long Term Evolution).

[0031] The camera 45 captures an image of the surroundings of the robot 40 and outputs the captured image to the control unit 41. Instead of the camera 45, a laser range finder that measures the distance between the robot 40 and an object present in the vicinity of the robot 40 may be provided.

[0032] The driving unit 47 generates a driving force for moving the robot 40. The driving unit 47 includes, for example, wheels for moving the robot 40 and a motor for driving the wheels. The driving unit 47 can be operated by receiving a supply of power from a battery 48.

[0033] The control unit 41 controls the driving unit 47 so that the robot 40 moves autonomously based on the captured image from the camera 45. The battery 48 supplies power for operating the driving unit 47 and other devices of the robot 40. The memory unit 44 temporarily stores various information used by the robot 40.

[0034] The multiple wireless communication devices 72 are installed at an appropriate distance from each other on the ceiling 61, and receive signals transmitted from the robot 40 using a communication method conforming to the same communication standard as the wireless communication device 42 of the robot 40, and detect the reception strength of the signals. The position of the robot 40 within the facility can be detected from the reception strength of each wireless communication device 72. The wireless communication device 72 outputs the reception strength of the signal received from the robot 40 to the equipment management device 20. The wireless communication device 72 may be installed on a wall.

[0035] The equipment management device 20 controls equipment such as the wireless communication devices 72, the surveillance cameras 70, and the robot 40 installed in the facility 1. The equipment management device 20 may directly control these devices, or may control these devices based on commands from the server device 10. The equipment management device 20 identifies the position of the robot 40 based on the reception strength of signals received by each wireless communication device 72.

[0036] The device management device 20 is connected to a communication network NW. A server device 10, a terminal 30, and the device management device 20 connected via a gateway 29 are connected to the communication network NW.

[0037] The server device 10 detects an abnormality in the surveillance camera 70 based on information acquired from the wireless communication device 72 and the surveillance camera 70 via a communication line. The server device 10 may be configured to be capable of outputting commands to the robot 40 and acquiring information on the robot 40, such as its position information.

[0038] The terminal 30 is, for example, a personal computer or a notebook computer. The terminal 30 includes an input unit 34 and a display 35 that displays various information. The display 35 can display abnormality information of the surveillance camera 70 detected by the server device 10. The input unit 34 is, for example, a keyboard and a mouse. Instructions can be given to the terminal 30 by operating the input unit 34.

[0039] The terminal 30 is also configured to include a CPU, a RAM, a ROM, and a communication IF, similar to the server device 10. The management and control of the robot 40 may be performed by the server device 10, the equipment management device 20, or another server.

[0040] A specific description will be given below. Fig. 3 is a diagram for explaining the communication range 102 and the camera image capture range 101. The communication range 102 indicates the range in which the wireless communication device 72 can communicate. The camera image capture range 101 indicates the range in which the surveillance camera 70 captures an image.

[0041] 3, wireless communication device 72 is installed at the center of a circle indicating communication range 102, and surveillance camera 70 is installed at the center of a circle indicating camera imaging range 101. Note that, although these ranges are illustrated as circles for convenience, they are not necessarily circular.

[0042] In this embodiment, surveillance cameras 70 are installed at multiple locations in facility 1, and wireless communication devices 72 are always installed near (for example, within a distance of 1 m) the installed surveillance cameras 70. Also, communication range 102 (for example, within a circle with a diameter of 20 m) is wider than camera image capture range 101 (for example, within a circle with a diameter of 10 m). When surveillance cameras 70 are installed normally, each device is installed so that communication range 102 includes camera image capture range 101 captured by surveillance camera 70.

[0043] When the robot 40 patrols the facility 1, it passes in front of each of the surveillance cameras 70 installed in the facility 1. In this case, the robot 40 first enters the communication range 102, and then travels so as to enter the camera imaging range 101.

[0044] When the robot 40 is traveling within the communication range 102, the wireless communication device 72 acquires robot information including a robot ID as identification information for identifying the robot 40 from the robot 40 via wireless communication. The equipment management device 20 receives the robot ID and the like from the wireless communication device 72, thereby detecting the robot. In addition to the robot ID, the robot information includes information such as the serial number of the robot 40 and the model of the robot 40.

[0045] When the robot 40 moves further and enters the camera imaging range 101, the surveillance camera 70 captures the robot 40. This detects a moving object and detects the two-dimensional code attached to the robot 40. Then, based on this information, it is determined whether or not there is an abnormality in the surveillance camera. This will be explained in detail below.

[0046] 4 is an example of a camera image 91 when the lens of the surveillance camera 70 is not dirty. When the robot 40 enters the camera imaging range 101, the robot 40 is imaged by the surveillance camera 70 as shown in the camera image 91 in FIG.

[0047] The surveillance camera 70 is equipped with a moving object detection function that detects a moving object. In the camera image 91, a rectangular moving object detection range 110 is displayed around the robot 40, thereby indicating that a moving object has been detected. Since there is no other moving object than the robot 40 within the range captured by the surveillance camera 70, the robot 40 is extracted as a moving object by the difference between multiple images captured periodically. When the surveillance camera 70 detects a moving object, it notifies the equipment management device 20 that a moving object has been detected.

[0048] A two-dimensional code 43 is attached to the robot 40. When a two-dimensional code is included in an image, the surveillance camera 70 extracts the two-dimensional code image. The extracted two-dimensional code image is transmitted to the device management device 20. Note that the surveillance camera 70 may directly detect information included in the two-dimensional code (robot ID) instead of the two-dimensional code image.

[0049] Fig. 5 is an example of a camera image 92 when the lens of the surveillance camera 70 is dirty. In this example, the lens of the surveillance camera 70 is dirty, and as shown in the camera image 92 of Fig. 5, a stain 120 is captured in the center of the image.

[0050] 4, when the robot 40 enters the camera imaging range 101, the robot 40 is imaged by the surveillance camera 70. The robot 40 is detected as a moving object (moving object detection range 111) based on image difference information, but the image of the robot 40 is unclear due to dirt 120.

[0051] Because the two-dimensional code portion in the image is unclear, the surveillance camera 70 is unable to extract the two-dimensional code image from the image, and is therefore unable to transmit the two-dimensional code image to the device management device 20.

[0052] Fig. 6 is a diagram for explaining a scene in which the installation state of the surveillance camera 70 is abnormal. Fig. 7 is an example of a camera image 93 when the installation state of the surveillance camera 70 is abnormal. As shown in Fig. 6, the surveillance camera 70 is tilted upward (the installation state is abnormal), so it is unable to capture the range that should be captured. Although the robot 40 is in the same position as in Fig. 1, as shown in Fig. 7, the robot 40 is not captured in the camera image 91.

[0053] If the installation condition of the surveillance camera 70 is abnormal, the robot 40 will first be detected by the wireless communication device 72 when it enters the communication range 102, but since the robot 40 does not then enter the camera imaging range 101, no moving object will be detected.

[0054] As described above, the device management device 20 acquires robot information including a robot ID from the wireless communication device 72, and acquires moving object detection information (whether or not a moving object has been detected) and two-dimensional code information (two-dimensional code image) from the surveillance camera 70. Furthermore, the device management device 20 transmits the robot information, moving object detection information, and two-dimensional code information to the server device 10.

[0055] The server device 10 records these pieces of information as detection result data 81. FIG.

[0056] In the detection result data 81, data on one of the following events is recorded as an "occurrence event": "robot detection," "moving object detection," or "two-dimensional code detection." Each piece of data records the "time" when the event occurred, the "detection device" when the event was detected, and the "acquired information" acquired at that time.

[0057] For example, at 13:00:00 on May 18, 2023, the robot 40 is detected by the communication device X1, and the robot ID: 0001 and other information are acquired as the robot information.

[0058] Five seconds later, at 13:00:05 on May 18th, 2023, a moving object is detected by camera Y1, and five seconds later, at 13:00:10 on May 18th, 2023, a two-dimensional code (robot ID: 0001) is detected by camera Y1.

[0059] The above shows a case where, as shown in Figures 3 and 4, robot 40 is detected when robot 40 enters communication range 102, and then, when robot 40 enters camera imaging range 101, robot 40 detects a moving object and a two-dimensional code.

[0060] Furthermore, at 15:10:20 on May 19, 2023, the robot 40 is detected by the communication device X1, and the robot ID: 0001 and other information are acquired as the robot information. Five seconds later, at 15:10:25 on May 19, 2023, a moving object is detected by the camera Y1. However, after that, the two-dimensional code is not detected by the camera Y1.

[0061] The above shows a case in which, as shown in FIG. 4, robot 40 is detected when it enters communication range 102, and then robot 40 is detected as a moving object when it enters camera imaging range 101, but the two-dimensional code is not detected due to dirt on the lens.

[0062] Furthermore, at 14:05:30 on May 25, 2023, the robot 40 is detected by the communication device X1, and the robot ID: 0001 and other information are acquired as the robot information. However, thereafter, the camera Y1 does not detect any moving object or two-dimensional code.

[0063] This refers to a case where, as shown in Figures 6 and 7, the robot 40 was detected when it entered the communication range 102, but the robot 40 was not subsequently captured on the surveillance camera 70 due to an abnormality in the installation condition of the surveillance camera 70.

[0064] The following is an explanation using flowcharts. Fig. 9 is a flowchart of server-side processing and robot-side processing. Server-side processing is processing executed by the server device 10. Robot-side processing is processing executed by the robot 40. The server-side processing may be executed when the server device 10 is started up, and the robot-side processing may be executed when the robot 40 is started up. Hereinafter, "step" may also be simply referred to as "S".

[0065] When the robot-side processing starts, in S201, the robot 40 determines whether or not communication has been established with the wireless communication device 72. As shown in Fig. 3, when the robot 40 enters the communication range 102, communication with the wireless communication device 72 is established. If communication with the wireless communication device 72 is not established (NO in S201), the robot 40 waits until communication is established.

[0066] When communication is established, in S202, the robot 40 transmits robot information including a robot ID to the wireless communication device 72. Upon receiving the robot information, the wireless communication device 72 transmits the robot information to the device management device 20. The device management device 20 transmits the robot information to the server device 10.

[0067] In S203, the robot 40 acquires the surveillance camera information from the equipment management device 20 via the wireless communication device 72. The surveillance camera information is information indicating the position of the surveillance camera .

[0068] When the robot 40 travels within the imaging range (camera imaging range 101) of the surveillance camera 70, the robot 40 changes its direction so that the identification image (two-dimensional code) is captured, and the process returns to S201.

[0069] Specifically, after the robot 40 establishes communication with the wireless communication device 72, the robot 40 moves so as to enter the camera image pickup range 101 of the surveillance camera 70. At that time, the robot changes its direction so that the two-dimensional code attached to the robot 40 is captured by the surveillance camera 70. For example, after entering the camera image pickup range 101 of the surveillance camera 70, the robot may pause and face the surveillance camera 70.

[0070] In this embodiment, when the robot 40 is patrolling the facility 1, after entering the communication range 102 of the wireless communication device 72, the robot 40 moves in principle so as to enter the imaging range 101 of the surveillance camera 70. However, if the patrol route is such that the robot does not enter the camera imaging range 101 of the surveillance camera 70 after entering the communication range 102 of the wireless communication device 72, the route may be corrected so as to enter the imaging range 101 of the surveillance camera 70, and if the route is not corrected, the abnormality determination process may not be performed.

[0071] When the robot 40 enters the imaging range 101 of the surveillance camera 70, the surveillance camera 70 transmits moving object detection information and two-dimensional code information to the equipment management device 20. The equipment management device 20 further transmits these pieces of information to the server device 10.

[0072] Next, the server-side processing will be described. When the server-side processing starts, the server device 10 waits until it acquires robot information (robot ID, etc.) from the device management device 20 (S101).

[0073] When acquiring the robot information, the server device 10 determines in S102 whether or not a moving object has been detected within a first time period (30 seconds in this embodiment) from the detection of the robot.

[0074] When the server device 10 detects a moving object within a first time period (30 seconds) after detecting the robot (YES in S102), it determines that there is no deviation in the angle of view (the installation state of the surveillance camera 70 is normal) (S103). In this way, when a moving object is detected within the first time period after the identification information is acquired by the wireless communication device 72, the server device 10 determines that the installation state is normal.

[0075] If the server device 10 does not detect a moving object within a first time period (30 seconds) after detecting the robot (NO in S102), it determines that there is a deviation in the angle of view (the installation state of the surveillance camera 70 is abnormal) (S104). In this way, the server device 10 determines that the installation state of the surveillance camera 70 is abnormal if the surveillance camera 70 does not detect a moving object within a first time period after the identification information is acquired by the wireless communication device 72.

[0076] In S105, the server device 10 judges whether or not a two-dimensional code is detected (a two-dimensional code image is extracted) within a second time period (30 seconds in this embodiment) after the moving object is detected. If this condition is met, the process proceeds to S106, and if this condition is not met, the process proceeds to S108.

[0077] In S106, the server device 10 judges whether or not the robot 40 identified from the identification image (two-dimensional code) detected by the surveillance camera 70 matches the robot 40 identified from the identification information (robot ID) received by the wireless communication device 72. In other words, it is judged whether or not the robot IDs match. If this condition is met, the process proceeds to S107, and if this condition is not met, the process proceeds to S108.

[0078] In S107, the server device 10 determines that the lens of the surveillance camera 70 is not dirty (no abnormality). In S108, the server device 10 determines that the lens of the surveillance camera 70 is dirty (no abnormality).

[0079] In this way, when the server device 10 determines that the installation condition is normal and an identification image (two-dimensional code) is not extracted from the image captured by the surveillance camera 70 within a second time period after a moving object is detected, it determines that there is an abnormality in the surveillance camera 70, such as that the lens of the surveillance camera 70 is dirty.

[0080] In addition, when the server device 10 determines that the installation condition is normal, and an identification image (two-dimensional code) is extracted from the image captured by the surveillance camera 70 within a second time period after a moving object is detected, and the robot 40 identified from the identification image (two-dimensional code) does not match the robot 40 identified from the identification information (robot ID), it determines that there is dirt on the lens, which is an abnormality in the surveillance camera 70.

[0081] In S109, the server device 10 updates the detection result data 81 (see FIG. 8) and the determination result data 82 (described later with reference to FIG. 10). In S110, the server device 10 transmits the determination result data 82 to the terminal 30, and returns the process to S101.

[0082] As a result, when an abnormality in the surveillance camera 70 is detected, the display 35 of the terminal 30 can display a message to that effect. Specifically, the display 35 displays the determination result data 82, which indicates that an abnormality in the surveillance camera 70 has been detected. Fig. 10 is a display example of the determination result data 82.

[0083] The “time”, “detection device”, and “occurring event” in the determination result data 82 are the same as those in the detection result data 81. In the determination result data 82, the result of a determination based on the information in the detection result data 81 is recorded as the “determination result”.

[0084] For example, in the data for May 18th, a moving object is detected 5 seconds (within a first time period) after the detection of robot 40 with robot ID "0001", and therefore it is determined that there is "no deviation in the angle of view". Furthermore, a two-dimensional code is detected 5 seconds (within a second time period) after the detection of the moving object. The robot ID identified from this two-dimensional code is "0001", which matches the robot ID when robot 40 was detected, and therefore it is determined that there is "no dirt on the lens".

[0085] In the data for May 19, a moving object was detected 5 seconds (within the first time) after the detection of robot 40 with robot ID "0001", so it was determined that there was "no deviation in the angle of view." Furthermore, since no two-dimensional code was detected within the second time (30 seconds) after the detection of the moving object, it was determined that there was "dirt on the lens," and this was recorded in the determination result data 82, and the fact that an abnormality in "dirt on the lens" had been detected was displayed on the display 35.

[0086] Furthermore, in the data for May 25th, since no moving object was detected within the first hour in which robot 40 with robot ID "0001" was detected, it was determined that "there is a deviation in the angle of view," and this was recorded in the judgment result data 82. In addition, a message was displayed on display 35 indicating that an abnormality in the "angle of view" had been detected.

[0087] In this embodiment, the surveillance camera 70 and the wireless communication device 72 are included in the configuration, but the surveillance camera 70 itself may have the function of the wireless communication device 72. In this case, the surveillance camera 70 is configured to acquire the robot ID of the robot 40 when the surveillance camera device establishes communication with the robot 40. Also, when the surveillance camera device detects a moving object and extracts a two-dimensional code image from the image, the surveillance camera device may acquire the robot ID from the two-dimensional code image. In this case, the surveillance camera device may transmit the robot ID acquired by communication, the moving object detection information, and the robot ID acquired from the two-dimensional code image to the equipment management device 20.

[0088] 9 may be performed by the device management device 20. In this case, the device management device 20 may transmit only the determination result shown in FIG.

[0089] As described above, the surveillance camera management system 100 includes the wireless communication device 72 as a communication device, the surveillance camera 70, and the server device 10 as a control device. The wireless communication device 72 is installed in the facility 1 where the robot 40 moves by itself, and when the robot 40 moves within a predetermined range (communication range 102) where communication with the robot 40 is possible, the wireless communication device 72 acquires identification information (robot ID) for identifying the robot 40 from the robot 40 by wireless communication. The surveillance camera 70 has a function of capturing an image of the facility 1 and detecting a moving object (moving object detection function). The server device 10 detects an abnormality of the surveillance camera 70 based on information acquired from the wireless communication device 72 and the surveillance camera 70 via a communication line. The predetermined range (communication range 102) includes a range (camera imaging range 101) that the surveillance camera 70 captures when the installation state of the surveillance camera 70 is normal. The server device 10 determines that the installation state is abnormal when no moving object is detected by the surveillance camera 70 within a first time period after the identification information is acquired by the wireless communication device 72.

[0090] In this way, it is possible to detect an abnormality (deviation of the angle of view) in the installation state of the surveillance camera 70 without checking the image captured by the surveillance camera 70. Also, since it is not necessary to transmit the image captured by the surveillance camera 70 to the server device 10, it is possible to reduce the amount of data transmitted to the server device 10, and it is possible to suppress communication charges. This makes it possible to detect an abnormality (deviation of the angle of view) in the surveillance camera 70 while minimizing the amount of data communication required for abnormality detection.

[0091] An identification image (two-dimensional code) for identifying the robot 40 is displayed on the surface of the robot 40. The server device 10 determines that the installation state is normal if a moving object is detected within a first time period after the identification information is acquired by the wireless communication device 72. If the installation state is determined to be normal and an identification image (two-dimensional code) is not extracted from the image captured by the surveillance camera 70 within a second time period after the moving object is detected, the server device 10 determines that an abnormality in the surveillance camera 70 exists, that the lens of the surveillance camera 70 is dirty.

[0092] When the server device 10 determines that the installation condition is normal, an identification image (two-dimensional code) is extracted from the image captured by the surveillance camera 70 within a second time period after a moving object is detected, and the robot 40 identified from the identification image (two-dimensional code) does not match the robot 40 identified from the identification information (robot ID), the server device 10 determines that the surveillance camera 70 is abnormal because the lens is dirty.

[0093] In this way, it is possible to detect dirt on the lens of the surveillance camera 70 without checking the image captured by the surveillance camera 70. Also, since it is not necessary to transmit the image captured by the surveillance camera 70 to the server device 10, it is possible to reduce the amount of data transmitted to the server device 10, and communication charges can be reduced. This makes it possible to detect an abnormality in the surveillance camera 70 (deviation of the angle of view, lens dirt) while minimizing the amount of data communication required for abnormality detection.

[0094] The surveillance camera management system 100 further includes a robot 40. When the robot 40 travels within the imaging range (camera imaging range 101) of the surveillance camera 70, it changes its direction so that an identification image (two-dimensional code) is captured. This allows the surveillance camera management system 100 to reliably recognize the identification image.

[0095] The surveillance camera management system 100 further includes a display 35 as a display device for displaying information. When an abnormality in the surveillance camera 70 is detected, the display 35 displays a message to that effect. This allows the abnormality in the surveillance camera 70 to be immediately recognized without checking the image captured by the surveillance camera 70.

[0096] [Note] The above-described embodiment is a specific example of the following supplementary notes.

[0097] (Appendix 1) a communication device that is installed in a facility where the robot travels autonomously and that acquires, when the robot travels within a predetermined range where communication with the robot is possible, identification information for identifying the robot from the robot via wireless communication; A surveillance camera having a function of capturing images of the inside of the facility and detecting moving objects; a control device that detects an abnormality in the surveillance camera based on information acquired from the communication device and the surveillance camera via a communication line; the predetermined range includes a range that the surveillance camera captures when the surveillance camera is installed normally, A surveillance camera management system in which the control device determines that the installation status is abnormal if no moving object is detected by the surveillance camera within a first time period after the identification information is acquired by the communication device.

[0098] (Appendix 2) an identification image for identifying the robot is displayed on a surface of the robot; The control device includes: determining that the installation state is normal when the moving object is detected within the first time period after the identification information is acquired by the communication device; A surveillance camera management system as described in Appendix 1, wherein when the installation condition is determined to be normal and the identification image is not extracted from the image captured by the surveillance camera within a second time period after the moving object is detected, it is determined that the surveillance camera is abnormal because the lens of the surveillance camera is dirty.

[0099] (Appendix 3) The surveillance camera management system described in Appendix 2, wherein the control device determines that the installation condition is normal, and when the identification image is extracted from the image captured by the surveillance camera within the second time after the moving object is detected, and the robot identified from the identification image does not match the robot identified from the identification information, determines that the lens is dirty, which is an abnormality of the surveillance camera.

[0100] (Appendix 4) The robot further comprises: 4. The surveillance camera management system according to claim 2, wherein the robot changes direction when traveling within an imaging range of the surveillance camera so that the identification image is captured.

[0101] (Appendix 5) Further comprising a display device for displaying information, 5. The surveillance camera management system according to any one of Supplementary Note 1 to Supplementary Note 4, wherein, when an abnormality in the surveillance camera is detected, the display device displays a message to the effect that an abnormality in the surveillance camera has been detected.

[0102] (Appendix 6) a communication device acquiring, from the robot via wireless communication, identification information for identifying the robot when the robot is installed in a facility where the robot can travel and travels within a predetermined range where communication with the robot is possible; acquiring information from a surveillance camera having a function of capturing images of the inside of the facility and detecting moving objects; detecting an abnormality in the surveillance camera based on information acquired from the communication device and the surveillance camera via a communication line; the predetermined range includes a range that the surveillance camera captures when the surveillance camera is installed normally, The surveillance camera management method, wherein the detection step further includes a step of determining that the installation status of the surveillance camera is abnormal if no moving object is detected by the surveillance camera within a first time period after the identification information is acquired by the communication device.

[0103] The embodiments disclosed herein are merely examples and are not limited to the above. The scope of the present invention is defined by the claims, and it is intended to include all modifications within the scope and meaning equivalent to the claims. [Explanation of symbols]

[0104] 1 Facility, 2 Monitoring center, 10 Server device, 11, 21 Processor, 12, 22 ROM, 13, 23 RAM, 14, 24 HDD, 15, 25 Communication IF, 16, 26, 46 Communication bus, 20 Device management device, 29 Gateway, 30 Terminal, 34 Input unit, 35 Display, 40 Robot, 41 Control unit, 42, 72 Wireless communication device, 43 Two-dimensional code, 44 Memory unit, 45 Camera, 47 Drive unit, 48 Battery, 61 Ceiling, 62 Wall, 63 Floor, 70 Surveillance camera, 81 Detection result data, 82 Judgment result data, 91-93 Camera image, 100 Surveillance camera management system, 101 Camera imaging range, 102 Communication range, 110, 111 Motion detection range, 120 Dirt, NW Communication network.

Claims

1. a communication device that is installed in a facility where the robot travels autonomously and that acquires, from the robot via wireless communication, identification information that identifies the robot when the robot travels within a predetermined range where communication with the robot is possible; A surveillance camera having a function of capturing images of the inside of the facility and detecting moving objects; a control device that detects an abnormality in the surveillance camera based on information acquired from the communication device and the surveillance camera via a communication line; the predetermined range includes a range that the surveillance camera captures when the surveillance camera is installed normally, A surveillance camera management system in which the control device determines that the installation status is abnormal if no moving object is detected by the surveillance camera within a first time period after the identification information is acquired by the communication device.

2. an identification image for identifying the robot is displayed on a surface of the robot; The control device includes: determining that the installation state is normal when the moving object is detected within the first time period after the identification information is acquired by the communication device; The surveillance camera management system of claim 1, wherein when the installation condition is determined to be normal and the identification image is not extracted from the image captured by the surveillance camera within a second time period after the moving object is detected, the system determines that the surveillance camera has an abnormality due to dirt on the lens of the surveillance camera.

3. The surveillance camera management system of claim 2, wherein the control device determines that the lens is dirty, as an abnormality of the surveillance camera, when the installation condition is determined to be normal, the identification image is extracted from the image captured by the surveillance camera within the second time after the moving object is detected, and the robot identified from the identification image does not match the robot identified from the identification information.

4. The robot further comprises:

4. The surveillance camera management system according to claim 2, wherein the robot changes direction when traveling within an imaging range of the surveillance camera so that the identification image is captured.

5. Further comprising a display device for displaying information, The surveillance camera management system according to claim 1 , wherein the display device, when detecting an abnormality in the surveillance camera, displays a message indicating that an abnormality in the surveillance camera has been detected.

6. a communication device acquiring, from the robot via wireless communication, identification information for identifying the robot when the robot is installed in a facility where the robot can travel and travels within a predetermined range where communication with the robot is possible; acquiring information from a surveillance camera having a function of capturing images of the inside of the facility and detecting moving objects; detecting an abnormality in the surveillance camera based on information acquired from the communication device and the surveillance camera via a communication line; the predetermined range includes a range that the surveillance camera captures when the surveillance camera is installed normally, A surveillance camera management method, wherein the detection step further includes a step of determining that the installation status of the surveillance camera is abnormal if no moving object is detected by the surveillance camera within a first time after the identification information is acquired by the communication device.

Citation Information

Patent Citations

  • Surveillance camera system having camera abnormality detection device

    JP2012034147A

  • Monitor system

    JP2015041913A

  • Robot system

    JP2019063947A

  • Information processing apparatus, information processing method, and program

    JP2019087791A

  • Mobile control system for mobile body, mobile body, and mobile body system

    JP6947336B2