Monitoring device, monitoring method, and program
The monitoring device and system effectively detect and manage safety in environments with heavy machinery by using fixed cameras, wearable devices, and drones to analyze images and alert workers to potential dangers, addressing the challenge of managing safety in construction sites.
Patent Information
- Application Number
- JP2024071000
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-25
- Publication Date
- 2025-11-07
AI Technical Summary
Existing technologies fail to effectively monitor and manage safety in environments with heavy machinery and materials, such as civil engineering and construction sites, where workers' presence and status need to be properly understood and managed to prevent dangers.
A monitoring device and system comprising environmental information acquisition, target detection, monitoring, and result output units, utilizing fixed cameras, wearable devices, and drones to capture and analyze images, and an analysis server to identify and prioritize monitoring targets and alert workers to potential dangers.
Enables appropriate detection and monitoring of workers and objects in work areas, providing real-time alerts and enhancing safety management by identifying and mitigating potential hazards.
Smart Images

Figure 2025166850000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a monitoring device, a monitoring method, and a program. [Background technology]
[0002] There is known a technology for using a mobile object such as a drone to capture an image of a predetermined area and using the captured image to monitor people, etc., in that area. As a related technology, Patent Document 1 discloses a surveillance plan creation device that sets an initial value for the time interval for monitoring small areas created by dividing surveillance map information, and determines the movement route of the unmanned aircraft so as to prioritize monitoring of areas with a short remaining time relative to the initial value. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-152215 Summary of the Invention [Problem to be solved by the invention]
[0004] For example, at civil engineering and construction sites, many workers work in the presence of heavy machinery and materials. At such work sites, proper safety management is required to prevent danger to workers and other on-site personnel. Therefore, it is necessary to properly understand and manage the status of people and items being monitored.
[0005] In view of the above-mentioned problems, an object of the present disclosure is to provide a monitoring device, a monitoring method, and a program that are capable of appropriately detecting and monitoring the presence of a monitoring target in a work area. [Means for solving the problem]
[0006] The monitoring device according to the present disclosure comprises: an environment information acquisition unit that acquires environment information indicating the environment of a predetermined work area; a monitoring target detection unit that detects a monitoring target present in the work area based on the environmental information; a monitoring unit that monitors the state of the monitoring target; and a result output unit that outputs the monitoring results of the monitoring unit.
[0007] The monitoring method according to the present disclosure includes: an environment information acquisition step of acquiring environment information indicating an environment of a predetermined work area; a monitoring target detection step of detecting a monitoring target present in the work area based on the environmental information; a monitoring step of monitoring a state of the object to be monitored; and a result output step of outputting the monitoring result in the monitoring step.
[0008] The program according to the present disclosure is an environment information acquisition step of acquiring environment information indicating an environment of a predetermined work area; a monitoring target detection step of detecting a monitoring target present in the work area based on the environmental information; a monitoring step of monitoring a state of the object to be monitored; and a result output step of outputting the monitoring result in the monitoring step. [Effects of the Invention]
[0009] The monitoring device, monitoring method, and program according to the present disclosure make it possible to appropriately grasp and monitor the presence of a monitoring target in a work area. [Brief explanation of the drawings]
[0010] [Figure 1] FIG. 1 is a block diagram showing the configuration of a monitoring device. [Figure 2] FIG. 2 is a flowchart showing the processing performed by the monitoring device. [Figure 3] FIG. 3 is a block diagram showing the configuration of the monitoring system. [Figure 4]FIG. 4 is a flowchart showing the processing performed by the wearable terminal and the fixed camera. [Figure 5] FIG. 5 is a flowchart showing the processing performed by the analysis server. [Figure 6] FIG. 6 is a flowchart showing the processing performed by the analysis server. [Figure 7] FIG. 7 is a flowchart showing the processing performed by the analysis server. [Figure 8] Figure 8 is a flowchart showing the processing performed by the drone. [Figure 9] FIG. 9 is a flowchart showing the processing performed by the output device. [Figure 10] FIG. 10 is a diagram showing an example of a working area before an image of a specific area is captured. [Figure 11] FIG. 11 is a diagram showing an example of the imaging range of a camera before imaging a specific area. [Figure 12] FIG. 12 is a diagram showing an example of a work area where multiple drones are photographing a specific area. [Figure 13] FIG. 13 is a diagram showing an example of the imaging range of the camera after imaging of the specific area. [Figure 14] FIG. 14 is a block diagram illustrating an example of the hardware configuration of a computer that realizes an analysis server or the like. DETAILED DESCRIPTION OF THE INVENTION
[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals. For clarity of explanation, duplicated explanations will be omitted as necessary.
[0012] <Embodiment 1> (Configuration of monitoring device 100) A first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of a monitoring device 100 according to the present disclosure.
[0013] The monitoring device 100 comprises an environmental information acquisition unit 101, a monitoring target detection unit 102, a monitoring unit 103, and a result output unit 104. The environmental information acquisition unit 101 acquires environmental information indicating the environment of a predetermined work area. The monitoring target detection unit 102 detects a monitoring target present in the work area based on the environmental information. The monitoring unit 103 monitors the status of the monitoring target. The result output unit 104 outputs the monitoring results of the monitoring unit 103.
[0014] The monitoring device 100 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program that implements the processing described herein. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of an environmental information acquisition unit 101, a monitoring target detection unit 102, a monitoring unit 103, and a result output unit 104.
[0015] The environmental information acquisition unit 101, the monitoring target detection unit 102, the monitoring unit 103, and the result output unit 104 may each be realized by dedicated hardware. Some or all of these components may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components may be realized by a combination of the above-mentioned circuits, etc., and a program.
[0016] (Processing of monitoring device 100) Next, the processing performed by the monitoring device 100 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing the processing performed by the monitoring device 100.
[0017] First, the environmental information acquisition unit 101 acquires environmental information (S101). Next, the monitoring target detection unit 102 detects monitoring targets present in the work area based on the environmental information (S102). Next, the monitoring unit 103 monitors the status of the monitoring targets (S103). Then, the result output unit 104 outputs the monitoring results of the monitoring unit 103 (S104).
[0018] As described above, the monitoring device 100 according to the present disclosure detects a monitoring target present in a work area based on environmental information and monitors the status of the monitoring target, thereby making it possible to appropriately grasp and monitor the presence of the monitoring target in the work area.
[0019] <Embodiment 2> Next, a description will be given of embodiment 2. Embodiment 2 is a specific example of embodiment 1 described above.
[0020] (Monitoring System 1) 3 is a block diagram showing the configuration of a monitoring system 1 according to the present disclosure. The monitoring system 1 includes an analysis server 10, a fixed camera 20, a wearable device 30, a drone 40, and an output device 50.
[0021] The analysis server 10, fixed camera 20, wearable device 30, drone 40, and output device 50 communicate with each other via a network N. The network N is a wired or wireless communication line. For example, a wireless LAN (Local Area Network) or an internet line may be used as the network N. The type of communication is not limited.
[0022] The monitoring system 1 is an information processing system capable of monitoring (watching over) a predetermined work area. The work area is an area that is the target of monitoring by the monitoring system 1. In the work area, the target of monitoring by the monitoring system 1 is involved in predetermined work. The predetermined work is, for example, civil engineering work or construction work, but the work content is arbitrary. The predetermined work may include various types of work in which the target of monitoring is involved.
[0023] The monitored object is an object that is monitored by the monitoring system 1. The monitored object may be a person or an object. Hereinafter, the monitored person may be referred to as the "monitored person." The monitored object may be referred to as the "monitored object." The monitored person may be, for example, a worker, a manager, or other person. The monitored object may be, for example, heavy machinery or materials. The monitored object may be a step, a hole, a high place, a slippery place, a place prone to collapse, the operating range of heavy machinery or the like, or a material transportation route. In addition to these, the work area is an area where the monitored object may be placed in a dangerous situation. The work area is not limited to the ground surface but also includes the space above the ground surface.
[0024] It should be noted that there may be any number of analysis servers 10, fixed cameras 20, wearable devices 30, drones 40, and output devices 50. For example, the monitoring system 1 may include a single analysis server 10 with multiple wearable devices 30, drones 40, and output devices 50.
[0025] In the following, an example will be described assuming that one analysis server 10 is provided with multiple wearable devices 30 and multiple drones 40. Each of the multiple wearable devices 30 may have the same configuration, and each of the multiple drones 40 may have the same configuration. Therefore, in the following, the multiple wearable devices 30 will not be distinguished from one another, and will simply be described as wearable devices 30. Similarly, each of the multiple drones 40 will not be distinguished from one another, and will simply be described as drones 40.
[0026] (Fixed Camera 20) The fixed camera 20 is an imaging device installed in the work area. The fixed camera 20 is installed in a location where it can capture images of people or objects that may be targets of surveillance. The fixed camera 20 includes a camera 21 and a communication unit 29.
[0027] The camera 21 photographs the work area from a predetermined direction. The camera 21 photographs the monitored object from above, for example. This is not a limitation, and the camera 21 may photograph the work area from any direction. The camera 21 acquires photographed images by photographing. The photographed images may be still images or moving images (video). The camera 21 transmits the photographed images to the analysis server 10 via the communication unit 29. The camera 21 may transmit the photographed images at predetermined time intervals.
[0028] The communication unit 29 communicates with other devices via the network N. The communication unit 29 may be a communication interface for performing wired or wireless communication.
[0029] (Wearable device 30) The wearable terminal 30 is a terminal device worn by a worker. The wearable terminal 30 is provided, for example, on equipment worn by the worker. The following description uses an example in which the wearable terminal 30 is provided on a helmet. The wearable terminal 30 may also be provided on equipment other than a helmet. The wearable terminal 30 may be provided on various items that can be worn by a worker, such as work clothes, a safety belt, safety shoes, a wristband, or an armband. The wearable terminal 30 may also be worn by a person involved in the work area. The person involved may be, for example, a manager of the work area.
[0030] The wearable terminal 30 includes a camera 31, a GPS (Global Positioning System) sensor 32, an acceleration sensor 33, and a communication unit 39. The camera 31 captures images of the worker's surroundings. For example, the camera 31 is provided on the surface of the helmet so as to capture images in front of the worker. This is not limiting, and the camera 31 may capture images in any direction. The wearable terminal 30 may include multiple cameras 31. This allows the wearable terminal 30 to acquire captured images corresponding to multiple angles of view.
[0031] The camera 31 captures images by taking pictures. The captured images may be still images or moving images. The camera 31 transmits the captured images to the analysis server 10 via the communication unit 39. The camera 31 may transmit the captured images at predetermined time intervals.
[0032] The GPS sensor 32 detects the position of the worker. The GPS sensor 32 transmits worker position information indicating the position of the worker to the analysis server 10 via the communication unit 39. The GPS sensor 32 may transmit the worker position information at predetermined time intervals.
[0033] The worker position information may be expressed by latitude and longitude, or may be expressed by a relative position to a predetermined structure. The wearable device 30 may detect the worker's position using another sensor instead of the GPS sensor 32. For example, a sensor using GNSS (Global Navigation Satellite System) technology other than GPS may be used.
[0034] The acceleration sensor 33 detects the acceleration of the body part on which the wearable device 30 is attached. In this example, the acceleration sensor 33 detects the acceleration corresponding to the movement of the worker's head (helmet). For example, the acceleration sensor 33 is a triaxial acceleration sensor that detects the acceleration of each of the orthogonal x, y and z axes. The acceleration sensor 33 transmits the detected acceleration to the analysis server 10 via the communication unit 39.
[0035] The wearable terminal 30 may include a gyro sensor, instead of the acceleration sensor 33, or in addition to the acceleration sensor 33, that detects the rotation speed of a body part.
[0036] The communication unit 39 communicates with other devices via the network N. The communication unit 39 may be a communication interface for wireless communication. The communication unit 39 may transmit information to the analysis server 10, including a worker ID that identifies the worker wearing the device. This allows the analysis server 10 to manage the received information in association with the worker. Note that the fixed camera 20 and the drone 40 may also be managed by a fixed camera ID or a drone ID.
[0037] (Drone 40) The drone 40 is a mobile object that moves within a work area. The drone 40 includes a camera 41, a GPS sensor 42, a control unit 43, and a communication unit 49. The camera 41, the GPS sensor 42, the control unit 43, and the communication unit 49 are built into the main body of the drone 40, for example.
[0038] The drone 40 is equipped with a moving means (not shown) for moving within the work area. The moving means includes, for example, a drive mechanism for moving in the air, on the ground, on the water surface, or underwater. In the following, the drone 40 will be described as an aerial drone that flies in the air. However, the drone 40 may also be a ground drone that can travel on the ground of the work area or an autonomous vehicle. However, other mobile robots may also be used as the mobile body. The drone 40 moves according to instructions from the analysis server 10. The drone 40 may be configured to be capable of autonomous movement.
[0039] The camera 41 photographs the surroundings of the drone 40. The camera 41 is provided on the main body of the drone 40 so as to photograph, for example, what is in front of the drone 40. This is not a limitation, and the photographing direction of the camera 41 is arbitrary. The drone 40 may be provided with multiple cameras 41. This allows the drone 40 to acquire photographed images corresponding to multiple angles of view. The camera 41 may be provided in advance as an integral part of the drone 40, or may be provided by mounting a separate camera on a drone 40 that does not have a camera.
[0040] The camera 41 captures images by taking pictures. The captured images may be still images or moving images. The camera 41 transmits the captured images to the analysis server 10 via the communication unit 49. The camera 41 may transmit the captured images at predetermined time intervals.
[0041] The GPS sensor 42 detects the position of the drone 40. The GPS sensor 42 transmits drone position information indicating the position of the drone 40 to the analysis server 10 via the communication unit 49. The GPS sensor 42 may transmit the drone position information at predetermined time intervals.
[0042] The control unit 43 controls the operation of the drone 40. For example, the control unit 43 controls the operation of the camera 41 and the GPS sensor 42. For example, the control unit 43 operates the drone 40 in accordance with instructions from the analysis server 10. The control unit 43 controls the drone 40 in accordance with a shooting instruction from the analysis server 10 to take an image of the work area based on the instructed shooting position and shooting direction.
[0043] The communication unit 49 communicates with other devices via the network N. The communication unit 49 may be a communication interface for wireless communication.
[0044] (output device 50) The output device 50 is an output device that outputs various information related to the present disclosure. The output device 50 includes a display unit 51 and a communication unit 59. The output device 50 is provided, for example, in a monitoring center that monitors the work area. A monitor who monitors the work area may be stationed in the monitoring center.
[0045] The display unit 51 outputs various types of information by display. For example, the display unit 51 displays captured images received from the analysis server 10 via the communication unit 59. The captured images received from the analysis server 10 are, for example, images captured by each camera of the fixed camera 20, the wearable device 30, or the drone 40. These captured images may be, for example, moving images transmitted in approximately real time. The display unit 51 may display these moving images in approximately real time. The display unit 51 may display all of the captured images from each camera on the same screen, or may display only some of the captured images and make all of them visible by switching the screen, etc. The output device 50 may also be provided with multiple display units 51, and the captured images from each camera may be displayed simultaneously on multiple display units 51.
[0046] The display unit 51 is, for example, a liquid crystal display, etc. The display unit 51 may be a touch panel having a function as an input unit that receives input from an observer.
[0047] The communication unit 59 communicates with other devices via the network N. The communication unit 59 may be a communication interface for performing wired or wireless communication. The output device 50 may include an audio output unit that outputs information by audio. The audio output unit is, for example, a speaker.
[0048] (Analysis Server 10) The analysis server 10 is an example of the monitoring device 100 described above. The analysis server 10 acquires information such as images from the fixed camera 20, the wearable device 30, and the drone 40, and analyzes the acquired information. The analysis server 10 performs predetermined processing using the analysis results. The analysis server 10 also causes the output device 50 to output the acquired images.
[0049] The analysis server 10 includes an environmental information acquisition unit 11, a monitoring target detection unit 12, a monitoring unit 13, a priority setting unit 14, a result output unit 15, an identification unit 16, an instruction unit 17, a storage unit 18, and a communication unit 19.
[0050] The environmental information acquisition unit 11 is an example of the above-mentioned environmental information acquisition unit 101. The environmental information acquisition unit 11 acquires environmental information that indicates the environment of a predetermined work area. The environmental information includes various information that indicates the environment of the work area. The environmental information may include, for example, an image of a monitoring target present in the work area, the position of the monitoring target, or acceleration corresponding to the movement of the monitoring target.
[0051] For example, the environmental information acquisition unit 11 acquires, in chronological order, as environmental information, at least one of images captured by a camera installed in the work area or around the work area, images captured by a camera installed on a moving object moving within the work area, and information acquired from a wearable terminal worn by a worker within the work area.
[0052] Specifically, the environmental information acquisition unit 11 acquires, as environmental information, images captured by the cameras provided in the fixed camera 20, the wearable terminal 30, and the drone 40. The environmental information acquisition unit 11 may also acquire, as environmental information, position information acquired using a GPS sensor provided in each of the wearable terminal 30 and the drone 40. The environmental information acquisition unit 11 may also acquire, as environmental information, acceleration acquired using an acceleration sensor 33 provided in the wearable terminal 30.
[0053] The environmental information acquisition unit 11 acquires the environmental information at predetermined time intervals, for example, to acquire the information as time-series data. Note that the environmental information acquisition unit 11 may also acquire audio information in the work area as the environmental information.
[0054] In addition, the environmental information acquisition unit 11 acquires an image of a specific area photographed by the drone 40 in accordance with an instruction from the instruction unit 17 as environmental information.
[0055] The monitoring target detection unit 12 is an example of the monitoring target detection unit 102 described above. The monitoring target detection unit 12 detects a monitoring target present in a work area based on environmental information. For example, the monitoring target detection unit 12 extracts the monitoring target from a captured image using any image recognition technology. The monitoring target detection unit 12 may extract the monitoring target using technology such as AI (Artificial Intelligence), machine learning, or deep learning.
[0056] Furthermore, the monitoring target detection unit 12 detects the monitoring target based on the position information of the monitoring target. For example, the monitoring target detection unit 12 detects the monitoring target in the work area by determining whether the worker is in the work area based on the worker position information acquired from the wearable terminal 30. The monitoring target detection unit 12 may calculate the shooting direction and shooting range of the camera 31 of the wearable terminal 30 based on information acquired by the acceleration sensor 33 of the wearable terminal 30, and detect the monitoring target based on the calculation result.
[0057] The monitoring unit 13 is an example of the above-mentioned monitoring unit 103. The monitoring unit 13 monitors the state of the monitoring target. The state of the monitoring target is information related to danger to the monitoring target or the surroundings of the monitoring target.
[0058] The monitoring unit 13 monitors the state of the monitoring target in accordance with the priority set by the priority setting unit 14. For example, when the priority is equal to or higher than a predetermined level, the monitoring unit 13 may instruct the fixed camera 20, the wearable terminal 30, and the drone 40 to increase the frequency of acquiring environmental information related to the monitoring target. For example, the monitoring unit 13 uses a preset threshold value to determine whether the priority is equal to or higher than a predetermined level.
[0059] The monitoring unit 13 may also instruct the drone 40 to increase the frequency of capturing images of a monitoring target or the surrounding area of the monitoring target that has a predetermined priority or higher. The monitoring unit 13 may also cause the drone 40 to track a monitoring target with a high priority and monitor the monitoring target. When the priority of a monitoring target is a predetermined priority or higher, the monitoring unit 13 may output a display to alert the monitoring staff.
[0060] The monitoring unit 13 also identifies the state of the monitored object based on the environmental information, and calculates the degree of danger to the monitored object or its surroundings based on the state of the monitored object. The degree of danger is information indicating the likelihood of a dangerous situation occurring to the monitored object or its surroundings.
[0061] For example, the monitoring unit 13 identifies the state of the monitored object based on the position of the monitored object. For example, the monitoring unit 13 identifies the state of the worker, such as whether the distance between the worker and heavy machinery is within a predetermined range, whether the distance between the worker and another worker carrying materials is within a predetermined range, whether the distance between the worker and a material storage area is within a predetermined range, whether the worker is working at a high altitude, etc. The monitoring unit 13 may acquire the state of the worker by using map information, altitude sensor information, etc. in addition to the captured image and location information.
[0062] The monitoring unit 13 may also monitor the actions of the worker based on captured images, etc., and identify, for example, a state in which the worker is unaware of the approach of heavy machinery. The monitoring unit 13 may also monitor changes over time in the position of the heavy machinery and the position of the worker, and identify states in which heavy machinery is moving toward the worker, or in which another worker carrying materials is approaching the worker, etc. The monitoring unit 13 may also identify states in which materials are piled high in a material storage area.
[0063] Furthermore, the monitoring unit 13 may identify, based on the captured image, that the person being monitored is a person other than a person involved in the work area (for example, a person who has wandered into the work area).
[0064] The monitoring unit 13 calculates the degree of danger based on the identified state so that the higher the likelihood that a dangerous situation will occur at or around the monitored object, the higher the degree of danger. The monitoring unit 13 may calculate the degree of danger by referring to a preset danger table. The danger table is information that associates the state of the monitored object with the degree of danger. The degree of danger may be expressed as a numerical value (for example, 0 to 100), or may be expressed as a number of levels such as "not dangerous," "slightly dangerous," and "very dangerous."
[0065] The priority setting unit 14 sets the monitoring priority for the monitoring target. The priority setting unit 14 sets the priority based on the degree of danger. The priority setting unit 14 sets the priority so that the higher the degree of danger, the higher the priority. For example, the priority setting unit 14 sets a higher priority for a worker who is close to heavy machinery, a worker who is unaware of the approach of heavy machinery, a worker who is approached by another worker carrying materials, a worker working at a high place, or a person who is not involved, than for a person who does not meet the respective conditions.
[0066] The priority setting unit 14 may also set a monitoring priority for a predetermined work area. For example, the priority setting unit 14 may set the priority based on the number and status of monitoring targets present in the predetermined work area. For example, the priority setting unit 14 may set a low priority for a work area in which the number of monitoring targets is less than a predetermined number.
[0067] The priority may be expressed as a numerical value (for example, 0 to 100), or may be expressed in multiple levels such as "low priority," "high priority," and "very high priority."
[0068] When new environmental information is acquired, the priority setting unit 14 may set new priorities and update the priorities for each monitoring target. In this way, the priority setting unit 14 can set priorities according to changes in the environment of the work area.
[0069] The result output unit 15 is an example of the above-mentioned result output unit 104. The result output unit 15 outputs the monitoring results of the monitoring unit 13. For example, the result output unit 15 outputs the state and risk level of the monitoring target to a display unit (not shown) provided in the analysis server 10.
[0070] The result output unit 15 may be configured to output the monitoring result when the risk level is equal to or higher than a predetermined level. The result output unit 15 may control the output mode according to the risk level. For example, the result output unit 15 displays the monitoring result such that the displayed characters become larger as the risk level increases. In addition to displaying the result, the result output unit 15 may also cause an audio output unit (not shown) to output audio.
[0071] Furthermore, the result output unit 15 may output a warning to the monitoring target when the risk level is equal to or higher than a predetermined level. For example, the result output unit 15 determines whether the risk level is equal to or higher than a predetermined level using a preset threshold. The result output unit 15 outputs a warning to the wearable device 30 of the worker whose risk level is equal to or higher than the predetermined level.
[0072] For example, the result output unit 15 causes the wearable terminal 30 to output a warning by display, sound, vibration, or the like. This allows the worker who is the target of the warning to know in real time that he or she is in a dangerous situation. The result output unit 15 may output the warning to the wearable terminal 30 of the worker who operates the heavy machinery related to the warning. The result output unit 15 may also notify the output device 50 of the monitoring center that the worker has been warned. This allows the monitor to understand the danger in the work area.
[0073] The identification unit 16 identifies a specific area within the work area where environmental information has not been acquired or where environmental information is insufficient. The specific area is an area where sufficient environmental information has not been acquired to perform at least one of detecting a monitoring target and identifying the state of the monitoring target. The specific area is an area where environmental information needs to be supplemented.
[0074] For example, the specific area is a work area that is not photographed by any of the fixed camera 20, the wearable terminal 30, and the drone 40. Alternatively, the specific area may be a work area that is photographed by at least one of the fixed camera 20, the wearable terminal 30, and the drone 40, but the photographed image is unclear. The identification unit 16 identifies the specific area from the photographed image acquired by the environmental information acquisition unit 11 using any technology, for example, AI.
[0075] The identification unit 16 also identifies an imaging position and an imaging direction for imaging the specific area with the drone 40. When imaging is possible from multiple imaging positions, the identification unit 16 may identify multiple imaging positions and imaging directions.
[0076] The instruction unit 17 instructs the drone 40 to photograph a specific area. For example, the instruction unit 17 transmits to the drone 40 a photographing instruction including the photographing position and photographing direction identified by the identification unit 16. The instruction unit 17 may transmit a photographing instruction to multiple drones 40.
[0077] Upon receiving the instruction, the drone 40 moves to the shooting position in accordance with the shooting instruction and shoots the specific area based on the shooting direction. The drone 40 transmits the captured image of the specific area to the analysis server 10. This allows the environmental information acquisition unit 11 to acquire environmental information of the specific area, thereby complementing environmental information of the work area where environmental information is not sufficiently acquired. This allows the analysis server 10 to more accurately detect the monitoring target in the monitoring target detection unit 12 and identify the status of the monitoring target in the monitoring unit 13. For example, the analysis server 10 can newly detect monitoring targets that were not detected because they were in the camera's blind spot.
[0078] The instruction unit 17 may also instruct the movement route of the drone 40. For example, the instruction unit 17 instructs the flight route of the drone 40. If the drone 40 is a mobile body that travels on the ground, the instruction unit 17 instructs the travel route. The specific area may be one location or multiple locations.
[0079] Furthermore, when there are multiple specific areas, the instruction unit 17 may instruct the drone 40 on the shooting order. By the instruction unit 17 instructing the movement route and the shooting order, the drone 40 can efficiently take pictures. The instruction unit 17 may instruct either the movement route or the shooting order, or may instruct both of them.
[0080] The instruction unit 17 may instruct the drone 40 not only to photograph a specific area but also to photograph a monitoring target that exists in the specific area. In this way, the instruction unit 17 can give priority to photographing a person or object to be monitored. The instruction unit 17 may instruct at least one of the travel route, the order of photographing, and the monitoring target to be photographed based on the priority of the monitoring target. The instruction unit 17 may also instruct the drone 40 not to photograph a monitoring target or work area with a low priority.
[0081] The storage unit 18 stores various data and programs. At least a portion of the storage unit 18 is configured with non-volatile memory so that data is retained even when the power to the analysis server 10 is turned off. For example, the storage unit 18 stores programs for realizing each function of the analysis server 10. The storage unit 18 also stores data acquired from the fixed camera 20, the wearable terminal 30, and the drone 40. The data may be stored in a predetermined database.
[0082] The communication unit 19 communicates with other devices via the network N. The communication unit 19 may be a communication interface for performing wired or wireless communication.
[0083] The above describes the configuration of the monitoring system 1. The above-described configuration of the monitoring system 1 is merely an example and may be modified as appropriate. For example, when some or all of the components of the analysis server 10, fixed camera 20, wearable terminal 30, drone 40, and output device 50 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, cloud computing system, or other system connected via a communication network. Furthermore, the functions of the analysis server 10 may be provided in a SaaS (Software as a Service) format.
[0084] Next, the processing performed by the monitoring system 1 will be described with reference to Figs. 4 to 9. Fig. 4 is a flowchart showing the processing performed by the wearable terminal 30 and the fixed camera 20. Figs. 5 to 7 are flowcharts showing the processing performed by the analysis server 10. Fig. 8 is a flowchart showing the processing performed by the drone 40. Fig. 9 is a flowchart showing the processing performed by the output device 50.
[0085] (Processing of the wearable device 30 and the fixed camera 20) The processing of the wearable terminal 30 and the fixed camera 20 will be described with reference to Fig. 4. The processing of the wearable terminal 30 and the fixed camera 20 differs in part.
[0086] First, a description will be given of the processing of the wearable terminal 30. The wearable terminal 30 determines whether or not environmental information has been acquired (S11). The environmental information is, for example, a captured image, position information, or acceleration.
[0087] If it is determined that environmental information has not been acquired (NO in S11), the wearable device 30 repeats step S11. If it is determined that environmental information has been acquired (YES in S11), the wearable device 30 transmits the acquired environmental information to the analysis server 10 (S12).
[0088] Specifically, the camera 31 of the wearable device 30 captures an image in a predetermined direction and acquires the captured image. For example, if the wearable device 30 is attached to a helmet, the camera 31 captures an image of the area in front of the worker wearing the wearable device 30 from the head of the worker. The GPS sensor 32 acquires worker position information indicating the worker's location. The acceleration sensor 33 acquires acceleration corresponding to the movement of the body part to which the wearable device 30 is attached. The communication unit 39 of the wearable device 30 transmits the acquired information to the analysis server 10.
[0089] Next, the processing of the fixed camera 20 will be described with reference to the same FIG. 4. The fixed camera 20 determines whether or not a captured image, which is environmental information, has been acquired (S11). If it is determined that a captured image has not been acquired (NO in S11), the fixed camera 20 repeats step S11. If it is determined that a captured image has been acquired (YES in S11), the fixed camera 20 transmits the acquired captured image to the analysis server 10 (S12). Specifically, the camera 21 of the fixed camera 20 captures an image in a predetermined shooting direction and acquires the captured image. The communication unit 29 of the fixed camera 20 transmits the captured image to the analysis server 10.
[0090] (Processing of analysis server 10) The processing of the analysis server 10 will be described with reference to Figures 5 to 7. The environmental information acquisition unit 11 determines whether environmental information has been acquired from the wearable device 30, the fixed camera 20, or the drone 40 (S21). If it is determined that environmental information has not been acquired (NO in S21), the environmental information acquisition unit 11 repeats step S21. If it is determined that environmental information has been acquired (YES in S21), the environmental information acquisition unit 11 stores the acquired environmental information in the storage unit 18 (S22).
[0091] Furthermore, the communication unit 19 transmits the captured image to the output device 50 (S23). In parallel with step S23, the analysis server 10 performs a monitoring process to monitor the monitoring target. The analysis server 10 detects and monitors the monitoring target (S24). The analysis server 10 also identifies a specific area and instructs the drone 40 to take a photograph (S25). Details of steps S24 and S25 will be explained below.
[0092] First, step S24 will be described in detail with reference to Fig. 6. The analysis server 10 performs steps S241 to S243 using information from the wearable device 30. First, the environmental information acquisition unit 11 acquires worker position information acquired by the GPS sensor 32 of the wearable device 30 (S241).
[0093] Next, the monitoring target detection unit 12 calculates the shooting direction and shooting range of the camera 31 of the wearable terminal 30 based on the information acquired by the acceleration sensor 33 of the wearable terminal 30 (S242). Subsequently, the monitoring target detection unit 12 detects the monitoring target based on the image captured by the camera (S243). For example, the monitoring target detection unit 12 may detect the monitoring target using technology such as AI.
[0094] In parallel with steps S241 to S243, the analysis server 10 performs steps S244 and S245 using information on the fixed camera 20 and the drone 40. First, the monitoring target detection unit 12 calculates the shooting ranges of the camera 21 of the fixed camera 20 and the camera 41 of the drone 40 based on the position information and shooting directions of the fixed camera 20 and the drone 40 (S244). Next, the monitoring target detection unit 12 detects the monitoring target based on the images captured by each camera (S245).
[0095] By performing the above steps S241 to S245, the analysis server 10 can detect the monitoring target within the work area. The monitoring target may be a person to be monitored, such as a worker, or an object to be monitored, such as heavy machinery.
[0096] Next, the monitoring unit 13 identifies the state of the monitored object, and calculates the degree of danger at or around the monitored object based on the state of the monitored object (S246). For example, the monitoring unit 13 identifies, as the state of the monitored object, that the distance between the worker and the heavy machinery is within a predetermined range, or that the distance between the worker and another worker carrying materials is within a predetermined range. The monitoring unit 13 calculates a higher degree of danger the more likely it is that a dangerous situation will occur at or around the monitored object.
[0097] The priority setting unit 14 sets the monitoring priority for the monitoring target based on the calculated risk level (S247). The monitoring unit 13 monitors the monitoring target according to the priority (S248).
[0098] The result output unit 15 determines whether the risk level is equal to or greater than a predetermined level (S249). For example, the result output unit 15 determines whether the risk level is equal to or greater than a preset threshold. If it is determined that the risk level is equal to or greater than a predetermined level (YES in S249), the result output unit 15 outputs a warning to the wearable terminal 30 (S250). This allows the worker to understand the risk to themselves.
[0099] Next, step S25 will be described in detail with reference to Fig. 7. First, the identification unit 16 identifies a specific area (S251). Using AI or the like, the identification unit 16 identifies an area within the work area for which environmental information has not been acquired or for which environmental information is insufficient as the specific area.
[0100] The identification unit 16 determines whether or not there is a specific area in the work area (S252). If it is determined that there is no specific area (NO in S252), the processing ends. If it is determined that there is a specific area (YES in S252), the identification unit 16 determines whether or not the priority of the existing monitoring target is lower than a predetermined value (S253). For example, the identification unit 16 determines whether or not the priority of the existing monitoring target is lower than a preset threshold value. An existing monitoring target is a person or object to be monitored that is already being monitored by the drone 40. Note that if there is no existing monitoring target, the identification unit 16 skips step S253 and proceeds to step S254.
[0101] If the priority of the existing monitoring target is equal to or higher than a predetermined level (NO in S253), the process ends. As a result, the drone 40 that is monitoring a monitoring target with a high priority can prioritize monitoring of the monitoring target even if there is a specific area.
[0102] If the priority of the existing monitoring target is lower than a predetermined value (YES in S253), the identification unit 16 creates a shooting instruction (S254). For example, the identification unit 16 identifies the shooting position, shooting direction, moving path, and shooting order. The identification unit 16 may identify only a part of these. The identification unit 16 creates a shooting instruction including the identified information and outputs it to the instruction unit 17. The instruction unit 17 transmits the shooting instruction to the drone 40 (S255).
[0103] In the above description, an example in which the process is terminated when step S253 returns NO has been described, but this is not limiting. The identification unit 16 may identify a shooting position at which both a monitoring target with a predetermined priority or higher and the specific area can be photographed, and create a shooting instruction including the identified shooting position and output it to the instruction unit 17. In this way, the drone 40 can both monitor a monitoring target with a predetermined priority or higher and photograph the specific area. Even in this case, the identification unit 16 may identify some or all of the shooting direction, movement path, and shooting order in addition to the shooting position.
[0104] (Drone 40 processing) Next, the processing performed by the drone 40 will be described with reference to Fig. 8. First, the communication unit 49 of the drone 40 determines whether or not a shooting instruction has been received from the analysis server 10 (S31). If it is determined that a shooting instruction has not been received (NO in S31), the communication unit 49 repeats step S31.
[0105] If it is determined that a photographing instruction has been received (YES in S31), the control unit 43 moves the drone 40 in accordance with the photographing instruction. For example, if the photographing instruction includes a photographing position and a photographing direction, the control unit 43 moves the drone 40 to the instructed photographing position. The camera 41 of the drone 40 photographs a specific area (S33). If a photographing direction has been instructed, the camera 41 photographs in that direction. The communication unit 49 transmits the photographed image to the analysis server 10 (S34).
[0106] (Processing of output device 50) Next, the processing of the output device 50 will be described with reference to Fig. 9. First, the communication unit 59 of the output device 50 determines whether or not an image captured by the fixed camera 20, the wearable terminal 30, or the drone 40 has been received from the analysis server 10 (S41). The captured image may be a still image or a moving image. If it is determined that a captured image has not been received (NO in S41), the communication unit 59 repeats step S41. If it is determined that a captured image has been received (YES in S41), the display unit 51 outputs the captured image (S42). For example, the display unit 51 displays a moving image captured by each camera of the fixed camera 20, the wearable terminal 30, or the drone 40.
[0107] (Example of photographing a specific area) Next, a specific example of the imaging of a specific area performed by the drone 40 will be described with reference to FIGS.
[0108] First, an example of a working area and an example of a camera's imaging range before a specific area is photographed will be described with reference to Fig. 10 and Fig. 11. Fig. 10 is a diagram showing an example of a working area before a specific area is photographed. Fig. 11 is a diagram showing an example of a camera's imaging range before a specific area is photographed.
[0109] Figure 11 shows a mapping of the area photographed by the camera and the area not photographed (specific area) in the work area shown in Figure 10, performed by the analysis server 10. The identification unit 16 of the analysis server 10 may identify the specific area and generate the images shown in these figures. The result output unit 15 of the analysis server 10 may output the images shown in these figures to the display unit or output device 50 of the analysis server 10.
[0110] In the example of Fig. 10, there are workers U1 to U3, heavy machinery H1 to H3, and materials M1 to M3 to be monitored in the work area. Each of the workers U1 to U3 is wearing a helmet-type wearable device 30. A camera 31 attached to the wearable device 30 captures an image in front of the worker. Note that the reference numerals for the wearable device 30 and the camera 31 are omitted in Figs. 10 to 13.
[0111] FIG. 11 shows an example of the camera's imaging range corresponding to FIG. 10. The triangular area indicates the camera's angle of view (imaging range), the circles indicate workers, and the square areas indicate heavy machinery and materials. The blank areas indicate specific areas. The specific areas are areas that are not photographed because they are not within the camera's angle of view. Furthermore, since there are no workers in the specific areas, the wearable device 30 does not acquire location information therefrom.
[0112] 10 and 11, the heavy machine H2 and materials M2 and M3, which are not within the camera's field of view, are not included in the captured image. Therefore, they are not extracted as monitoring targets by the analysis server 10. Therefore, the instruction unit 17 of the analysis server 10 sends a capture instruction to the drone 40 to capture an image of the specific area shown in the blank area. The drone 40 moves in accordance with the capture instruction and captures the specific area.
[0113] Next, an example of a work area after photographing a specific area and an example of a camera's photographing range will be described with reference to Figures 12 and 13. Figure 12 is a diagram showing an example of a work area in which photographing of a specific area is being performed by multiple drones 40. Figure 13 is a diagram showing an example of a camera's photographing range after photographing of a specific area. Figure 13 shows a mapping, performed by the analysis server 10, of the area photographed by the camera and the area not photographed (specific area) in the work area shown in Figure 12.
[0114] As shown in Fig. 12, drones 40-1 and 40-2 fly over the work area and photograph specific areas. As shown by drone 40-1 in the same figure, drone 40 may photograph specific areas in multiple locations. Drone 40-1 moves along the route indicated by the dashed arrow and photographs two specific areas.
[0115] FIG. 13 shows an example of the camera's imaging range corresponding to FIG. 12. In addition to the example of FIG. 11, FIG. 13 maps areas corresponding to the angles of view of drones 40-1 and 40-2. Unlike FIG. 11, FIG. 13 includes heavy equipment H2 and materials M2 and M3 in the captured image. In this way, by supplementing the imaging range with drones 40-1 and 40-2, the analysis server 10 can identify and monitor heavy equipment H2 and materials M2 and M3 as monitoring targets. Furthermore, by using mobile objects that can move within the work area, it is possible to capture the required area with a limited number of mobile objects. Furthermore, it is possible to reduce the costs associated with installing a large number of cameras and installing expensive cameras.
[0116] As described above, in the monitoring system 1 according to the present disclosure, the analysis server 10 acquires environmental information about a predetermined work area and detects a monitoring target based on the environmental information. The analysis server 10 also monitors the status of the detected monitoring target and outputs the monitoring results. The analysis server 10 can set a monitoring priority for the monitoring target and perform monitoring based on the priority. The analysis server 10 can calculate the degree of danger for the monitoring target or its surroundings based on the status of the monitoring target and set the priority based on the degree of danger. This allows the monitoring system 1 to prioritize monitoring of monitoring targets with high danger levels. Furthermore, the analysis server 10 outputs a warning to the monitoring target when the degree of danger is equal to or greater than a predetermined level, allowing workers to grasp dangers, such as approaching heavy machinery, in real time.
[0117] Furthermore, the analysis server 10 identifies specific areas within the work area for which environmental information has not been acquired or for which environmental information is insufficient, and instructs the drone 40 to photograph the specific areas. This allows the analysis server 10 to extract monitoring targets using images captured by the drone 40 in addition to images captured by the fixed camera 20 and the wearable device 30. Furthermore, the analysis server 10 can instruct the drone 40 on the photographing position, photographing direction, movement route, photographing order, etc. for photographing the specific area, so the drone 40 can efficiently photograph the specific area.
[0118] With this configuration, the monitoring system 1 according to the present disclosure can appropriately grasp and monitor the presence of a monitoring target in a work area. The monitoring system 1 enables the situation at a civil engineering or construction site to be grasped from a remote location and appropriate safety management to be performed. As a result, the monitoring system 1 can contribute to improving productivity and safety at the work site. Furthermore, by utilizing a mobile object such as a drone, the monitoring system 1 does not require operation by on-site workers, thereby reducing the burden of introducing the system.
[0119] <Hardware configuration example> Each functional component of the analysis server 10, fixed camera 20, wearable terminal 30, drone 40, and output device 50 (hereinafter referred to as "analysis server 10, etc.") may be realized by hardware (e.g., hardwired electronic circuits, etc.) that realizes each functional component, or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it). Below, we will further explain the case where each functional component of the analysis server 10, etc. is realized by a combination of hardware and software.
[0120] 14 is a block diagram illustrating the hardware configuration of a computer 900 that realizes the analysis server 10, etc. The computer 900 may be a dedicated computer designed to realize the analysis server 10, etc., or may be a general-purpose computer. The computer 900 may also be a portable computer such as a smartphone or tablet terminal.
[0121] For example, by installing a predetermined application on the computer 900, the functions of the analysis server 10 and the like are realized on the computer 900. The application is configured as a program for realizing the functional components of the analysis server 10 and the like.
[0122] The computer 900 includes a bus 902, a processor 904, a memory 906, a storage device 908, an input / output interface 910, and a network interface 912. The bus 902 is a data transmission path that allows the processor 904, the memory 906, the storage device 908, the input / output interface 910, and the network interface 912 to transmit and receive data to and from each other. However, the method of connecting the processor 904 and other components to each other is not limited to a bus connection.
[0123] The processor 904 is a variety of processors such as a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), or a quantum processor (quantum computer control chip). The memory 906 is a main storage device realized using a random access memory (RAM) or the like. The storage device 908 is an auxiliary storage device realized using a hard disk, a solid state drive (SSD), a memory card, a read only memory (ROM), or the like.
[0124] The input / output interface 910 is an interface for connecting the computer 900 to an input / output device. For example, the input / output interface 910 is connected to an input device such as a keyboard and an output device such as a display device.
[0125] The network interface 912 is an interface for connecting the computer 900 to a network. This network may be a LAN (Local Area Network) or a WAN (Wide Area Network).
[0126] The storage device 908 stores programs (programs that realize the above-mentioned applications) that realize the various functional components of the analysis server 10, etc. The processor 904 reads these programs into the memory 906 and executes them to realize the various functional components of the analysis server 10, etc.
[0127] Each processor executes one or more programs containing instructions for causing a computer to perform an algorithm. The programs contain instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The programs may be stored on various types of non-transitory computer-readable media or tangible storage media. By way of example and not limitation, non-transitory computer-readable media or tangible storage media include RAM, ROM, flash memory, SSD or other memory technologies, CD-ROM, DVD (Digital Versatile Disc), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The programs may also be transmitted over various types of transitory computer-readable media or communication media. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.
[0128] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.
[0129] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but also to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.
[0130] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. (Appendix 1) an environment information acquisition unit that acquires environment information indicating the environment of a predetermined work area; a monitoring target detection unit that detects a monitoring target present in the work area based on the environmental information; a monitoring unit that monitors the state of the monitoring target; a result output unit that outputs the monitoring result of the monitoring unit; monitoring equipment. (Appendix 2) a priority setting unit that sets a monitoring priority for the monitoring target, the monitoring unit identifies a state of the monitoring target based on the environmental information, and calculates a degree of danger to the monitoring target or to the surroundings of the monitoring target based on the state of the monitoring target; The priority setting unit sets the priority based on the degree of risk. 10. The monitoring device described in Appendix 1. (Appendix 3) The result output unit outputs a warning to the monitoring target when the risk level is equal to or greater than a predetermined level. 10. The monitoring device described in Appendix 2. (Appendix 4) The environmental information acquisition unit chronologically acquires, as the environmental information, at least one of an image captured by a camera installed in the work area or in the vicinity of the work area, an image captured by a camera installed on a moving body moving within the work area, and information acquired from a wearable device worn by a worker within the work area. 4. The monitoring device according to any one of claims 1 to 3. (Appendix 5) an identification unit that identifies a specific area within the work area, the specific area being an area for which the environmental information has not been acquired or for which the environmental information is insufficient; an instruction unit that instructs a moving object moving within the work area to photograph the specific area, The environmental information acquisition unit acquires, as the environmental information, an image of the specific area captured in accordance with an instruction from the instruction unit. 5. The monitoring device according to any one of appendices 1 to 4. (Appendix 6) the specifying unit specifies an imaging position and an imaging direction for imaging the specific area; The instruction unit instructs the moving body about the photographing position and the photographing direction. 10. The monitoring device described in Appendix 5. (Appendix 7) The instruction unit instructs the moving body on at least one of a movement path of the moving body and an order of photographing the specific areas when there are a plurality of the specific areas. 7. The monitoring device of claim 5 or 6. (Appendix 8) The instruction unit instructs the monitoring target present in the specific area to be photographed. 8. The monitoring device according to any one of appendices 5 to 7. (Appendix 9) an environment information acquisition step of acquiring environment information indicating an environment of a predetermined work area; a monitoring target detection step of detecting a monitoring target present in the work area based on the environmental information; a monitoring step of monitoring a state of the object to be monitored; a result output step of outputting a monitoring result in the monitoring step. Monitoring method. (Appendix 10) an environment information acquisition step of acquiring environment information indicating an environment of a predetermined work area; a monitoring target detection step of detecting a monitoring target present in the work area based on the environmental information; a monitoring step of monitoring a state of the object to be monitored; a result output step of outputting a monitoring result in the monitoring step, program.
[0131] Some or all of the elements (e.g., configurations and functions) described in Supplements 2 to 8 that are dependent on Supplement 1 may also be dependent on Supplements 9 and 10 in the same dependency relationship as Supplements 2 to 8. Some or all of the elements described in any Supplement may be applied to various hardware, software, recording means for recording software, systems, and methods. [Explanation of symbols]
[0132] 1. Surveillance System 10 Analysis Server 11 Environmental Information Acquisition Department 12 Monitoring target detection unit 13 Monitoring Department 14 Priority setting section 15 Result output section 16 Specific section 17 Instruction section 18 Memory section 19 Communications Department 20 Fixed Camera 21 Camera 29 Communications Department 30 Wearable devices 31 Camera 32 GPS sensors 33 Acceleration sensor 39 Communications Department 40, 40-1, 40-2 drones 41 Camera 42 GPS sensor 43 Control Unit 49 Communications Department 50 Output Device 51 Display section 59 Communications Department 100 Monitoring equipment 101 Environmental Information Acquisition Department 102 Monitoring target detection unit 103 Monitoring Department 104 Result output section 900 Computers 902 Bus 904 processor 906 memory 908 Storage Devices 910 Input / Output Interface 912 Network Interface H1~H3 Heavy equipment M1~M3 Materials N Network U1~U3 workers
Claims
1. an environment information acquisition unit that acquires environment information indicating the environment of a predetermined work area; a monitoring target detection unit that detects a monitoring target present in the work area based on the environmental information; a monitoring unit that monitors the state of the monitoring target; a result output unit that outputs the monitoring result of the monitoring unit; monitoring equipment.
2. a priority setting unit that sets a monitoring priority for the monitoring target, the monitoring unit identifies a state of the monitoring target based on the environmental information, and calculates a degree of danger to the monitoring target or to the surroundings of the monitoring target based on the state of the monitoring target; The priority setting unit sets the priority based on the degree of risk. The monitoring device of claim 1 .
3. The result output unit outputs a warning to the monitoring target when the risk level is equal to or greater than a predetermined level. The monitoring device according to claim 2 .
4. The environmental information acquisition unit chronologically acquires, as the environmental information, at least one of an image captured by a camera installed in the work area or in the vicinity of the work area, an image captured by a camera installed on a moving body moving within the work area, and information acquired from a wearable device worn by a worker within the work area. The monitoring device according to claim 1 or 2.
5. an identification unit that identifies a specific area within the work area, the specific area being an area for which the environmental information has not been acquired or for which the environmental information is insufficient; an instruction unit that instructs a moving object moving within the work area to photograph the specific area, The environmental information acquisition unit acquires, as the environmental information, an image of the specific area captured in accordance with an instruction from the instruction unit. The monitoring device according to claim 1 or 2.
6. the specifying unit specifies an imaging position and an imaging direction for imaging the specific area; The instruction unit instructs the moving body about the photographing position and the photographing direction. The monitoring device according to claim 5.
7. The instruction unit instructs the moving body on at least one of a movement path of the moving body and an order of photographing the specific areas when there are a plurality of the specific areas. The monitoring device according to claim 5.
8. The instruction unit instructs the monitoring target present in the specific area to be photographed. The monitoring device according to claim 5.
9. an environment information acquisition step of acquiring environment information indicating an environment of a predetermined work area; a monitoring target detection step of detecting a monitoring target present in the work area based on the environmental information; a monitoring step of monitoring a state of the object to be monitored; a result output step of outputting a monitoring result in the monitoring step. Monitoring method.
10. an environment information acquisition step of acquiring environment information indicating an environment of a predetermined work area; a monitoring target detection step of detecting a monitoring target present in the work area based on the environmental information; a monitoring step of monitoring a state of the object to be monitored; a result output step of outputting a monitoring result in the monitoring step, program.
Citation Information
Patent Citations
Monitoring plan creation device, monitoring system, monitoring plan creation method, and program
JP2022152215A