Monitoring device, monitoring method, and program
The monitoring device and system address the challenge of ensuring worker safety in substation environments by using 3D data and sensor information to identify hazardous situations and provide timely warnings.
Patent Information
- Application Number
- JP2023171422
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-10-02
- Publication Date
- 2025-04-14
- Estimated Expiration
- 2043-10-02
AI Technical Summary
Existing monitoring systems for workers in facilities like substations cannot determine whether workers are performing their tasks safely, despite being able to assess the accuracy of their work based on physical information.
A monitoring device and system that generate 3D data of facilities, identify worker operations based on their position and sensor data, and output warning information when the sensor enters a dangerous area.
The system effectively assists operators in performing their work safely by providing real-time warning information when they approach hazardous areas, enhancing safety in substation environments.
Smart Images

Figure 2025062390000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a monitoring device, a monitoring system, a monitoring method, and a program. [Background technology]
[0002] In facilities such as substations, it is necessary to monitor the actions of workers so that they can work safely. The monitor gives instructions to the workers using a communication terminal or the like so that the workers can continue to work safely.
[0003] Patent Document 1 discloses a system that enables a worker to perform work while watching a work video that captures the work of a skilled worker. The work video also includes the voice of the skilled worker. For example, the work video includes voice such as "Beware of electric shock," and the worker can continue working while listening to the voice. Patent Document 1 also discloses a system that determines whether the worker is performing the work correctly based on body information obtained from a body sensor worn by the worker. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2022-103336 A Summary of the Invention [Problem to be solved by the invention]
[0005] In facilities such as substations, an environment where workers can work safely is required. However, the system disclosed in Patent Document 1 has a problem in that although it can determine whether the worker is working correctly based on the worker's physical information, it cannot determine whether the worker is working safely.
[0006] In view of the above-mentioned problems, an object of the present disclosure is to provide a monitoring device, a monitoring system, a monitoring method, and a program that can assist a worker in performing work safely. [Means for solving the problem]
[0007] A monitoring device according to a first aspect of the present disclosure includes a generation unit that generates three-dimensional data including a facility within a three-dimensional space, an identification unit that identifies the movement of a worker present at the facility in the three-dimensional data based on a position of the worker in the three-dimensional data and sensor data generated by a sensor attached to the worker, and an output unit that outputs warning information when the sensor enters a danger area.
[0008] A monitoring system according to a second aspect of the present disclosure includes a sensor attached to a worker and a monitoring device that monitors the behavior of the worker, the monitoring device having a generation unit that generates three-dimensional data including a facility in a three-dimensional space, an identification unit that identifies the movements of the worker in the three-dimensional data based on the position of the worker present at the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker, and an output unit that outputs warning information if the sensor enters a danger area.
[0009] A monitoring method according to a third aspect of the present disclosure generates three-dimensional data including a facility in a three-dimensional space, identifies the movements of a worker present at the facility in the three-dimensional data based on a position of the worker in the three-dimensional data and sensor data generated by a sensor attached to the worker, and outputs warning information if the sensor enters a danger area.
[0010] A program according to a fourth aspect of the present disclosure causes a computer to generate three-dimensional data including a facility in a three-dimensional space, identify the movements of a worker in the three-dimensional data based on the position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker, and output warning information if the sensor enters a danger area. Effect of the Invention
[0011] The present disclosure makes it possible to provide a monitoring device, a monitoring system, a monitoring method, and a program that can assist a worker in performing work safely. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is a configuration diagram of a monitoring device according to the present disclosure. [Diagram 2] FIG. 13 is a diagram showing a flow of a monitoring process according to the present disclosure. [Diagram 3] FIG. 1 is a configuration diagram of a monitoring system according to the present disclosure. [Figure 4] FIG. 1 illustrates a sensor attached to a worker according to the present disclosure. [Diagram 5] FIG. 1 is a configuration diagram of a monitoring device according to the present disclosure. [Figure 6] FIG. 1 is a configuration diagram of a communication device according to the present disclosure. [Figure 7] FIG. 13 is a diagram showing a flow of a monitoring process according to the present disclosure. [Figure 8] FIG. 11 is a diagram showing a flow of a warning information output process according to the present disclosure. [Figure 9] FIG. 1 shows an image in which the location of a sensor according to the present disclosure is indicated. [Figure 10] FIG. 2 is a configuration diagram of a monitoring device and a communication device according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] (Embodiment 1) An example of the configuration of the monitoring device 10 will be described below with reference to Fig. 1. The monitoring device 10 may be a computer device that operates when a processor executes a program stored in a memory. The monitoring device 10 may also be an information processing device.
[0014] The monitoring device 10 has a generating unit 11, an identifying unit 12, and an output unit 13. The generating unit 11, the identifying unit 12, and the output unit 13 may be software or a module that performs processing by a processor executing a program stored in a memory. Alternatively, the generating unit 11, the identifying unit 12, and the output unit 13 may be hardware such as a circuit or a chip.
[0015] The generating unit 11 generates three-dimensional data including facilities in a three-dimensional space. The facilities may include, for example, buildings, roads, plants, etc. The facilities may be, for example, equipment such as substations. The three-dimensional data may be, for example, data indicating the three-dimensional positions of facilities included in the three-dimensional space. That is, the three-dimensional data may be referred to as a three-dimensional map indicating the positions of facilities, etc. The three-dimensional data may be generated based on data measured using a sensor or the like. Alternatively, the three-dimensional data may be generated using software that generates three-dimensional data from two-dimensional data such as drawings. The three-dimensional data may be, for example, point cloud data. Alternatively, the three-dimensional data may be mesh data, polygon data, etc. generated using point cloud data. Alternatively, the three-dimensional data may be data represented using a depth map.
[0016] The identification unit 12 identifies the movement of a worker in the three-dimensional data based on the position of the worker in the facility in the three-dimensional data and the sensor data generated by a sensor attached to the worker. The three-dimensional data may be data indicating the position of the facility, for example, using a predetermined coordinate system. The predetermined coordinate system may be a coordinate system converted from a world coordinate system representing an actual three-dimensional space according to a predetermined criterion. The predetermined criterion may be determined using, for example, a scale, a rotation angle, a matrix, or the like. In other words, a position in the world coordinate system may be converted to a position in the predetermined coordinate system according to a predetermined conversion formula.
[0017] The position of a worker in a facility in the three-dimensional data may be, for example, a position of the worker in the facility after the position determined in a world coordinate system is converted into a predetermined coordinate system indicating the three-dimensional data. The position of the worker in the three-dimensional data may be, for example, the position of a device used to measure the position of the worker. The device used to measure the position of the worker may be attached or affixed to the worker. Alternatively, the device used to measure the position of the worker may be stored in a pocket or the like of the worker's clothes.
[0018] The sensor attached to the worker may be, for example, a motion sensor, a temperature sensor, a sensor that emits light, a sensor that emits heat, etc. More specifically, the motion sensor may be an acceleration sensor. Alternatively, the motion sensor may be configured by an acceleration sensor, a gyro sensor, etc.
[0019] The worker's movement may be, for example, a movement of a sensor attached to the worker. Identifying the worker's movement may be, for example, identifying a position or a transition of a position of the sensor attached to the worker.
[0020] The output unit 13 outputs warning information when the sensor enters a danger area. The danger area may be, for example, the vicinity of energized equipment in a substation. The vicinity of energized equipment may be, for example, an area within a predetermined distance from the energized equipment. The danger area may also be changed by changing the energized parts in the equipment.
[0021] The intrusion of the sensor into the dangerous area may be when a worker approaches the dangerous area and the sensor attached to the worker enters the dangerous area. In other words, the intrusion of the sensor into the dangerous area may be when a part of the body of the worker to which the sensor is attached enters the dangerous area.
[0022] The warning information may be output as a sound that can be sensed by hearing, or may be output as a light that can be sensed by sight. Alternatively, the warning information may be transmitted to a communication device or the like held by the worker. In this case, the communication device that receives the warning information may output a sound, a light, or the like, may display a message indicating the warning information on a display, or may vibrate the communication device itself.
[0023] Next, the flow of the monitoring process executed by the monitoring device 10 will be described with reference to Fig. 2. First, the generating unit 11 generates three-dimensional data including a facility in a three-dimensional space (S11). Next, the identifying unit 12 identifies the movement of a worker in the three-dimensional data based on the position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker (S12). Next, the output unit 13 outputs warning information when the sensor enters a dangerous area (S13).
[0024] As described above, the monitoring device 10 identifies the motion of the worker in the three-dimensional data by using the position of the worker in the three-dimensional data and the sensor data generated by the sensor attached to the worker. Furthermore, the monitoring device 10 outputs warning information when the sensor enters a dangerous area. In this way, even if most parts of the worker's body are not within the dangerous area, the monitoring device 10 can output warning information when some parts of the worker's body enter the dangerous area. As a result, the monitoring device 10 can support the worker to whom the sensor is attached to perform the work safely.
[0025] 1 shows that the generating unit 11, the identifying unit 12, and the output unit 13 are included in one monitoring device 10, but the generating unit 11, the identifying unit 12, and the output unit 13 may be provided in different devices. In this case, the generating unit 11, the identifying unit 12, and the output unit 13 may transmit and receive information via a network. Alternatively, one of the generating unit 11, the identifying unit 12, and the output unit 13 may be provided in a device different from the other components.
[0026] 2 may be performed as an independent process unrelated to steps S12 and S13. That is, after the generator 11 generates the three-dimensional data, the processes related to steps S12 and S13 may be performed at any timing.
[0027] (Embodiment 2) Next, a configuration example of the monitoring system will be described with reference to FIG. 3. The monitoring system of FIG. 3 includes a sensor 21, a sensor 22, a monitoring device 30, and a communication device 40. The monitoring device 30 communicates with the sensor 21, the sensor 22, and the communication device 40 via a network 50. FIG. 3 shows an example in which two sensors are connected to the network 50, but the number of sensors may be one or three or more. FIG. 3 also shows an example in which the sensor 21 and the sensor 22 are directly connected to the network 50, but for example, the sensor 21 and the sensor 22 may be connected to the network 50 via the communication device 40. Specifically, the sensor 21 and the sensor 22 may communicate with the communication device 40 that operates as an access point as a slave device in wireless LAN (Local Area Network) communication.
[0028] The sensor 21, the sensor 22, and the communication device 40 may be held by a single worker. Holding the sensor 21, the sensor 22, and the communication device 40 also includes being attached to the worker.
[0029] Here, the sensor 21 may be a GPS (Global Positioning System) sensor. The sensor 21 may be referred to as a measuring device that measures location information. The sensor 21, which is a GPS sensor, may be built into the communication device 40. The sensor 22 may be a motion sensor. A worker may be fitted with multiple motion sensors, rather than only one motion sensor. In other words, a worker may be fitted with multiple sensors 22.
[0030] The sensor 21 generates sensor data indicating the position of the sensor 21. The sensor data indicating the position of the sensor 21 is represented using a world coordinate system.
[0031] The sensor data indicating the position of the sensor 22 may be represented using a world coordinate system or a predetermined coordinate system. The predetermined coordinate system may be, for example, a coordinate system based on the sensor 22, or a coordinate system commonly used to indicate the positions of a plurality of sensors 22. The sensor 22 may be combined with another sensor, such as a geomagnetic sensor, to generate sensor data indicating the position of the sensor 22 in the world coordinate system.
[0032] The communication device 40 receives the warning information transmitted from the monitoring device 30. When the communication device 40 receives the warning information, the communication device 40 may vibrate the communication device 40 or may output a sound indicating a warning from an output speaker. Alternatively, the communication device 40 may display the warning information on a display.
[0033] The network 40 may be, for example, an IP (Internet Protocol) network. The network 40 may be an open network such as the Internet, or a closed network such as an intranet.
[0034] Here, the sensors attached to the worker will be described with reference to Fig. 4. Fig. 4 shows that one sensor 21 as a GPS sensor and multiple sensors 22 as motion sensors are attached to the worker. Fig. 4 shows that the sensor 21 is attached to the worker's torso. Fig. 4 also shows that the sensor 22 is attached to the extremities of the worker. Specifically, Fig. 4 shows that the sensors 22 are attached to the head, feet, and hands of the worker.
[0035] Further, Fig. 4 shows a safe area and a dangerous area. Fig. 4 shows that the torso of the worker is present in the safe area. The dotted line shows the boundary between the safe area and the dangerous area. Fig. 4 shows that the sensor 22 attached to the hand of the worker is present on the boundary. In this way, the monitoring device 30 may output warning information when the sensor attached to the worker enters the dangerous area including the boundary.
[0036] Next, a configuration example of the monitoring device 30 will be described with reference to Fig. 5. The monitoring device 30 in Fig. 5 has a configuration in which a determination unit 31 and a communication unit 32 are added to the monitoring device 10 in Fig. 1. In the description of the monitoring device 30, detailed description of operations or functions similar to those of the monitoring device 10 will be omitted. Furthermore, each of the components constituting the monitoring device 30 may be included in one device as shown in Fig. 5, or may be distributed and arranged in different devices.
[0037] The generating unit 11 generates point cloud data as three-dimensional data. The generating unit 11 may generate the point cloud data by using, for example, LiDAR (Light Detection And Ranging). The LiDAR device may be called a laser scanner. The generating unit 11 may use a LiDAR device. Alternatively, the generating unit 11 may acquire the point cloud data generated in the LiDAR device from the LiDAR device via a network or the like.
[0038] The LiDAR device measures the distance to an object using, for example, a ToF (Time of Flight) method, and generates points that indicate the shape of the object. A collection of points that indicate the shape of the object becomes point cloud data. The points that indicate the shape of the object may be specified using three-dimensional coordinates in a predetermined space. In other words, the points that indicate the shape of the object may be indicated using three-dimensional coordinates in a predetermined coordinate system.
[0039] The identification unit 12 identifies the position of the sensor 21 attached to the worker as the position of the worker. The position of the sensor 21 may be a position identified using a GPS. Furthermore, the identification unit 12 identifies the sensor 22 associated with the sensor 21 as a sensor attached to the same worker as the worker to which the sensor 21 is attached.
[0040] For example, the identification unit 12 may identify that the sensor 21 and the sensor 22 existing within a predetermined range from the sensor 21 are attached to the same worker. The sensor 22 generates sensor data indicating a position where the sensor 22 is attached as a motion sensor. When the sensor data indicates a position in a world coordinate system, the identification unit 12 determines whether or not the sensor data indicates a position within a predetermined range from the sensor 21. When the sensor data indicates a position in a predetermined coordinate system, the identification unit 12 may convert the position indicated by the sensor data into the world coordinate system and determine whether or not the converted position indicates a position within a predetermined range from the sensor 21. Alternatively, the identification unit 12 may convert the coordinate system used for the positions indicated by the sensor 21 and the sensor 22 into the coordinate system used for the point cloud data. The identification unit 12 may determine whether or not the sensor 22 exists at a position within a predetermined range from the sensor 21 by using information indicating the positions of the sensor 21 and the sensor 22 converted into the coordinate system used for the point cloud data.
[0041] Alternatively, the identification unit 12 may determine whether the sensors 21 and 22 are attached to the same worker by using identification information included in the measurement data generated by the sensor 21 and identification information included in the sensor data generated by the sensor 22. The identification unit 12 may determine that the sensors 21 and 22 are attached to the same worker when the identification information included in the measurement data generated by the sensor 21 matches the identification information included in the sensor data generated by the sensor 22. The same identification information may be input in advance to the sensors 21 and 22 attached to the same worker.
[0042] The determination unit 31 determines whether the sensor 22 has entered a danger area. The danger area in the three-dimensional data may be set, for example, by an administrator who manages the monitoring device 30 or a supervisor who monitors workers using the monitoring device 30. For example, the administrator may specify an area around an energized facility as the danger area. The administrator may input the location of the danger area into the point cloud data generated by the generation unit 11.
[0043] The determination unit 31 determines whether the position of the sensor 22 in the three-dimensional data has entered a dangerous area. The determination unit 31 may also determine whether the position of the sensor 21 in the three-dimensional data has entered a dangerous area. The determination unit 31 outputs the determination result to the output unit 13.
[0044] When the determination unit 31 determines that the position of at least one of the sensors 21 and 22 has entered the dangerous area, the output unit 13 may display warning information on the display of the monitoring device 30. Alternatively, the output unit 13 may output the warning information from the speaker as a warning sound. By recognizing the warning information output from the display or speaker, the manager or the like recognizes that the worker has entered the dangerous area.
[0045] When the determination unit 31 determines that the position of at least one of the sensors 21 and 22 has entered a dangerous area, the communication unit 32 transmits warning information to the communication device 40 held by the worker to which the sensor 21 and the sensor 22 are attached. The monitoring device 30 may manage, for example, information that associates the sensor 21 with the communication device 40 held by the worker to which the sensor 21 is attached. Specifically, the monitoring device 30 may manage the sensor 21 in association with destination information of the communication device 40 held by the worker to which the sensor 21 is attached.
[0046] The communication unit 32 transmits warning information to the communication device 40 held by the worker to whom the sensor determined to have entered the dangerous area is attached. When there are multiple workers in a facility, the communication unit 32 transmits warning information to the communication device held by the worker who has entered the dangerous area, thereby making it possible to avoid transmitting unnecessary warning information to workers who are working safely.
[0047] Alternatively, the communication unit 32 may also transmit the warning information to a communication device held by a worker who is in the vicinity of the worker who has entered the dangerous area. The workers who are in the vicinity of the worker who has entered the dangerous area may be determined based on the position indicated by the GPS sensor of each worker. That is, the communication unit 32 may transmit the warning information to a communication device held by a worker who is within a predetermined distance from the worker who has entered the dangerous area. The warning information may also include information for identifying the worker who has entered the dangerous area. This allows the worker who receives the warning information to take action, such as giving a warning to the worker who has entered the dangerous area.
[0048] Next, a configuration example of the communication device 40 will be described with reference to Fig. 6. The communication device 40 may be a computer device that operates when a processor executes a program stored in a memory.
[0049] The communication device 40 includes a communication unit 41 and an output unit 42. The communication unit 41 and the output unit 42 may be software or a module that performs processing by causing a processor to execute a program stored in a memory.
[0050] The communication unit 41 receives warning information from the monitoring device 30 via the network 50. The output unit 42 outputs the received warning information. For example, the output unit 42 may cause the warning information to be displayed on a display of the communication device 40. Alternatively, the output unit 42 may output a warning sound to a speaker of the communication device 40 as the warning information.
[0051] Next, the flow of the monitoring process in the monitoring device 30 will be described with reference to Fig. 7. First, the generating unit 11 generates point cloud data including facilities in a three-dimensional space (S21).
[0052] Next, the identification unit 12 acquires position information from the sensor 21, which is a GPS sensor attached to the worker (S22). The identification unit 12 acquiring the position information from the sensor 21 means that the identification unit 12 identifies the position of the sensor 21. The position information may indicate the position of the sensor 21 using, for example, latitude and longitude. Alternatively, the position information may indicate the position of the sensor 21 using coordinates in a world coordinate system.
[0053] Next, the identification unit 12 acquires sensor data of the sensor 22, which is a motion sensor (S24). The sensor data may be data indicating the position of the sensor 22 in a world coordinate system or a predetermined coordinate system. When the sensor data is data indicating the position in the predetermined coordinate system, the identification unit 12 may convert the position in the predetermined coordinate system into a position in the world coordinate system. The identification unit 12 may acquire sensor data from one motion sensor or from each of a plurality of motion sensors.
[0054] Next, the identification unit 12 identifies the sensor 22 attached to the same worker as the worker to which the sensor 21 is attached (S24). The identification unit 12 may identify that the sensor 21 and the sensor 22 present within a predetermined range from the sensor 21 are attached to the same worker. The identification unit 12 may determine whether the sensors 21 and 22 are attached to the same worker based on the positions in the world coordinate system. Alternatively, the identification unit 12 may convert the positions of the sensors 21 and 22 into the coordinate system used in the point cloud data. In this case, the identification unit 12 may determine whether the sensors 21 and 22 are attached to the same worker based on the positions in the coordinate system used in the point cloud data.
[0055] Alternatively, the identification unit 12 may determine whether the sensors 21 and 22 are attached to the same worker, using identification information included in the measurement data generated by the sensor 21 and identification information included in the sensor data generated by the sensor 22. The identification unit 12 may determine that the sensors 21 and 22 are attached to the same worker when the identification information included in the measurement data generated by the sensor 21 matches the identification information included in the sensor data generated by the sensor 22.
[0056] In step S24, it is assumed that the identification unit 12 has identified that the sensor 21 and the sensor 22 are attached to the same worker.
[0057] Next, the determination unit 31 determines whether the sensor 22, which is a motion sensor, has entered a dangerous area (S25). The dangerous area is set in the point cloud data. The determination unit 31 may determine whether the position of the sensor 22 in the point cloud data has entered the dangerous area.
[0058] When the determination unit 31 determines that the sensor 22, which is a motion sensor, has entered a dangerous area, the communication unit 32 transmits warning information to the communication device 40 (S26). The communication device 40 to which the warning information is transmitted is the communication device 40 held by the worker to which the sensor 22 is attached.
[0059] When the determination unit 31 determines that the sensor 22, which is a motion sensor, has not entered the dangerous area, the determination unit 31 repeats the process of step S25. The determination unit 31 may periodically determine whether or not the sensor 22, which is a motion sensor, has entered the dangerous area.
[0060] Next, a flow of a process for outputting warning information in the communication device 40 will be described with reference to Fig. 8. First, the communication unit 41 receives warning information from the monitoring device 30 (S31). Next, the output unit 42 outputs the warning information (S32). For example, the output unit 42 may cause the display of the communication device 40 to display the warning information. Alternatively, the output unit 42 may output a warning sound to a speaker of the communication device 40 as the warning information.
[0061] As described above, the monitoring device 30 uses the measurement data from the sensor 21 and the sensor data from the sensor 22 to determine whether the sensors 21 and 22 are attached to the same worker. Furthermore, the monitoring device 30 determines whether the sensor 22 has entered a dangerous area. As a result, even if the position of the sensor 21, which is generally recognized as the position of the worker, is outside the dangerous area, the sensor 22 attached to the end of the worker may be present within the dangerous area. In this case, the monitoring device 30 transmits warning information to the communication device 40 held by the worker. As a result, the worker can recognize that a part of his or her body has entered the dangerous area.
[0062] (Embodiment 3) Next, the process of identifying the position of the sensor 22 in the identification unit 12 will be described with reference to Fig. 9. The sensor 22 is, for example, a motion sensor. Fig. 9 also shows an image 60 in which the position of the sensor 22, which is a motion sensor, is indicated. For example, the image 60 may be an image displayed on an information processing device. The information processing device that displays the image 60 receives information indicating the position from the motion sensor and indicates the trajectory of the movement of the motion sensor. The position of the sensor 22 may be, for example, a camera coordinate determined by a camera that captured the image 60.
[0063] Here, the sensor 22, which is a motion sensor, may be attached at the same position as the sensor 21, which is a GPS sensor. The identification unit 12 identifies the distance between the sensor 22 attached at the same position as the sensor 21 and each sensor 22 attached to the worker's end. Furthermore, the identification unit 12 identifies the direction or orientation in which the sensor 22 attached to the worker's end is attached, using the sensor 21 as a reference.
[0064] Furthermore, the identification unit 12 identifies the position of the sensor 22 based on the direction or orientation identified as the position of the sensor 22 and the distance between the sensor 21 and the sensor 22, using the position of the sensor 21 identified in the point cloud data including the facilities in the three-dimensional space as a reference. By the identification unit 12 identifying the position of the sensor 22 in the point cloud data, the monitoring device 30 can generate warning information when the sensor 22 enters a dangerous area.
[0065] In this way, the determination unit 12 may determine the direction or orientation in which the sensor 22 is located relative to the sensor 21, and further determine the distance between the sensors 21 and 22, thereby determining the position of the sensor 22.
[0066] Furthermore, other than a motion sensor, for example, a temperature sensor, a sensor that emits light, or a sensor that emits heat may be used as the sensor 22, and the trajectory of the sensor may be shown in the image 60.
[0067] Fig. 10 is a block diagram showing a configuration example of a monitoring device 10, a monitoring device 30, and a communication device 40 (hereinafter referred to as the monitoring device 10, etc.). Referring to Fig. 10, the monitoring device 10, etc. includes a network interface 1201, a processor 1202, and a memory 1203. The network interface 1201 may be used to communicate with a network node. The network interface 1201 may include, for example, a network interface card (NIC) that complies with the IEEE 802.3 series. IEEE stands for Institute of Electrical and Electronics Engineers.
[0068] The processor 1202 reads out and executes software (computer programs) from the memory 1203 to perform the processing of the monitoring device 10 and the like described using the flowcharts. The processor 1202 may be, for example, a microprocessor, an MPU, or a CPU. The processor 1202 may include multiple processors.
[0069] The memory 1203 is configured by a combination of volatile memory and non-volatile memory. The memory 1203 may include storage located away from the processor 1202. In this case, the processor 1202 may access the memory 1203 via an I / O (Input / Output) interface (not shown).
[0070] 10, the memory 1203 is used to store a group of software modules. The processor 1202 can perform processing of the monitoring device 10, etc. by reading out the group of software modules from the memory 1203 and executing them.
[0071] As described with reference to FIG. 10, each of the processors included in the monitoring device 10 etc. executes one or more programs including a set of instructions for causing a computer to execute the algorithm described with reference to the drawing.
[0072] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, the transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.
[0073] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be appropriately combined with other embodiments.
[0074] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but to one or more other embodiments. As can be understood by those skilled in the art, various features or steps described with reference to any one drawing may be combined with features or steps shown in one or more other drawings to create an embodiment not explicitly shown or described, for example. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.
[0075] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) A generation unit that generates three-dimensional data including facilities in a three-dimensional space; an identification unit that identifies a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; and an output unit that outputs warning information when the sensor enters a dangerous area. (Appendix 2) The identification unit is 2. The monitoring device of claim 1, wherein the location of a measuring device attached to the worker is identified as the location of the worker, and the sensor associated with the measuring device is identified as a sensor attached to the worker. (Appendix 3) The identification unit is 3. The monitoring device of claim 2, wherein the sensor that is within a predetermined range of the measuring device is identified as a sensor attached to the worker. (Appendix 4) The identification unit is 3. The monitoring device of claim 2, wherein the sensor that generates sensor data including identification information that is the same as identification information included in the measurement data generated by the measuring device is identified as the sensor attached to the worker. (Appendix 5) 5. The monitoring device according to claim 3 or 4, further comprising a communication unit that transmits warning information to a communication terminal held by the worker to which the sensor is attached. (Appendix 6) The sensor is attached to an extremity of the worker; 6. The monitoring device of claim 5, wherein the communication unit receives the sensor data from the sensor. (Appendix 7) 7. The monitoring device according to any one of claims 1 to 6, wherein the sensor attached to the worker is a motion sensor. (Appendix 8) The generation unit is 8. The monitoring device according to claim 1, further comprising: a danger area set within the three-dimensional data. (Appendix 9) 9. The monitoring device according to any one of claims 1 to 8, further comprising a determination unit that determines whether the sensor has entered the dangerous area. (Appendix 10) A plurality of sensors are attached to the worker, The output unit is 10. The monitoring device according to claim 1, wherein the monitoring device outputs warning information when at least one of the plurality of sensors enters the dangerous area. (Appendix 11) A sensor attached to a worker; A monitoring device for monitoring the behavior of the worker, The monitoring device includes: A generation unit that generates three-dimensional data including facilities in a three-dimensional space; an identification unit that identifies a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; and an output unit that outputs warning information when the sensor enters a dangerous area. (Appendix 12) an acquisition unit for acquiring three-dimensional data including a facility in a three-dimensional space; an identification unit that identifies a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; and an output unit that outputs warning information when the sensor enters a dangerous area. (Appendix 13) an identification unit that identifies a motion of a worker in a facility in three-dimensional data based on a position of the worker in the three-dimensional data that indicates the facility in a three-dimensional space and on sensor data generated by a sensor attached to the worker; and an output unit that outputs warning information when the sensor enters a dangerous area. (Appendix 14) Generate 3D data including facilities in 3D space, Identifying a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; A monitoring method, comprising: outputting warning information when the sensor enters a dangerous area. (Appendix 15) 15. The monitoring method according to claim 14, further comprising transmitting the warning information to a communication terminal held by the worker to which the sensor is attached. (Appendix 16) Acquire 3D data including facilities in 3D space, Identifying a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; A monitoring method, comprising: outputting warning information when the sensor enters a dangerous area. (Appendix 17) Identifying a movement of a worker in a facility in three-dimensional data based on a position of the worker in the three-dimensional data indicating the facility in a three-dimensional space and sensor data generated by a sensor attached to the worker; A monitoring method, comprising: outputting warning information when the sensor enters a dangerous area. (Appendix 18) Generate 3D data including facilities in 3D space, Identifying a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; A program that causes a computer to execute the following: outputting warning information when the sensor enters a dangerous area. (Appendix 19) Acquire 3D data including facilities in 3D space, Identifying a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; A program that causes a computer to execute the following: outputting warning information when the sensor enters a dangerous area. (Appendix 20) Identifying a movement of a worker in a facility in three-dimensional data based on a position of the worker in the three-dimensional data indicating the facility in a three-dimensional space and sensor data generated by a sensor attached to the worker; A program that causes a computer to execute the following: outputting warning information when the sensor enters a dangerous area.
[0076] Some or all of the elements (e.g., configurations and functions) described in Supplementary Notes 2 to 10 that are dependent on Supplementary Note 1 may also be dependent on Supplements 11 to 14 and 16 to 20 in the same dependent relationship as Supplementary Notes 2 to 10. Some or all of the elements described in any Supplementary Note may be applied to various hardware, software, recording means for recording software, systems, and methods. [Explanation of symbols]
[0077] 10 Monitoring equipment 11 Generation part 12 Specific part 13 Output section 21 Sensors 22 Sensors 30 Monitoring equipment 31 Judgment section 32 Communications Department 40 Communication Equipment 41 Communications Department 42 Output section 50 Network 60 images
Claims
1. a generation unit that generates three-dimensional data including facilities in a three-dimensional space; an identification unit that identifies a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; an output unit that outputs warning information when the sensor enters a dangerous area.
2. The identification unit The monitoring device of claim 1 , wherein the location of a measurement device attached to the worker is identified as the location of the worker, and the sensor associated with the measurement device is identified as the sensor attached to the worker.
3. The identification unit The monitoring device according to claim 2 , wherein the sensor present within a predetermined range from the measurement device is identified as the sensor attached to the worker.
4. The identification unit The monitoring device according to claim 2 , wherein the sensor that generates sensor data containing the same identification information as identification information contained in the measurement data generated by the measurement device is identified as the sensor attached to the worker.
5. The monitoring device according to claim 3 , further comprising a communication unit configured to transmit warning information to a communication terminal held by the worker to which the sensor is attached.
6. the sensor is attached to an extremity of the worker; The monitoring device according to claim 5 , wherein the communication unit receives the sensor data from the sensor.
7. The monitoring device according to claim 1 , wherein the sensor attached to the worker is a motion sensor.
8. The generation unit The monitoring device according to claim 1 , wherein the danger area is set within the three-dimensional data.
9. Generate three-dimensional data including the facility in the three-dimensional space; Identifying a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; A monitoring method in which warning information is output when the sensor enters a dangerous area.
10. Generate three-dimensional data including the facility in the three-dimensional space; Identifying a movement of a worker in the three-dimensional data based on a position of the worker in the facility in the three-dimensional data and sensor data generated by a sensor attached to the worker; A program that causes a computer to output warning information when the sensor enters a dangerous area.
Citation Information
Patent Citations
Safety management system
JP2006316862A
Operator management system in power transmission facility
JP2017122988A
System and program
JP2020101872A
System and method for monitoring field based augmented reality using digital twin
US20210201584A1
Work support system and work support method
JP2022103336A