Generating device and generating method

The generation device addresses the inadequacy of existing near miss information sharing by creating a comprehensive database and map-based system using sensors and cameras, enhancing incident awareness and prevention.

JP7770937B2Active Publication Date: 2025-11-17FUJITA CO LTD
View PDF 12 Cites 0 Cited by

Patent Information

Application Number
JP2022011668
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-01-28
Publication Date
2025-11-17
Estimated Expiration
2042-01-28

AI Technical Summary

Technical Problem

Existing methods for sharing near miss information at construction sites and nursing homes are inadequate, often relying on verbal reports or physical markers, leading to insufficient information dissemination.

Method used

A generation device that integrates identification, status, and environmental information to create a near-miss database, using sensors and cameras to capture and analyze data, generating map information with classified records based on environmental conditions.

Benefits of technology

Effectively provides comprehensive near miss information, enabling understanding of incident locations, trends, and facilitating preventive measures by generating detailed maps and alerts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007770937000001
    Figure 0007770937000001
  • Figure 0007770937000002
    Figure 0007770937000002
  • Figure 0007770937000003
    Figure 0007770937000003
Patent Text Reader

Abstract

To effectively provide near-miss information.SOLUTION: A generating device according to one embodiment comprises: a generation unit for registering, on a map of the location of a target person, based on a near-miss database which contains identification information for identifying the target person, state information about a state of the target person, state information acquiring time information which indicates a time when the state information was acquired, state information acquisition position information for indicating a position where the state information was acquired, and an image obtained by photographing the acquisition position of the state information in association with each other, a position indicated in the state information acquisition position information at the time when the state of the target person is abnormal, and for generating map information.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a generating device and a generating method. [Background technology]

[0002] Efforts are being made to prevent disasters and accidents by collecting and sharing information on near misses experienced by workers at construction sites, factories, and other worksites, as well as by people requiring care in nursing homes. Near misses are, for example, incidents that do not result in a serious disaster or accident, but which could have led directly to one. When a danger occurs, there are often many near misses lurking before it occurs, and collecting and analyzing near miss cases can be useful in preventing danger.

[0003] Furthermore, in recent years, attempts have been made to attach sensors to the bodies of subjects such as workers and people requiring care, and to monitor the condition of the subjects based on the measured values ​​of the sensors.

[0004] For example, techniques relating to human condition management using sensor measurement values ​​are known (for example, Patent Document 1 and Non-Patent Document 1). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-80304 [Non-patent literature]

[0006] [Non-Patent Document 1] Yoshimitsu Shinagawa et al., "Detection of Human Walking and Falling Using Acceleration Sensors," Kawasaki Journal of Medical Welfare, 1999, Vol. 9 No. 2 243-250 Summary of the Invention [Problem to be solved by the invention]

[0007] However, for example, information about near misses is sometimes reported verbally, or the information is shared in a list, or it is sometimes shared by placing a marker such as a ribbon at the site where the near miss occurred. However, this type of information sharing does not always result in sufficient information being shared.

[0008] An object of the present invention is to effectively provide near miss information. [Means for solving the problem]

[0009] A generation device according to one aspect of the present invention includes identification information for identifying a subject, status information relating to the status of the subject, status information acquisition time information indicating the time when the status information was acquired, status information acquisition position information indicating the position where the status information was acquired, and an image of the acquisition position of the status information. Environmental information including at least the time period, season, and weather of the near miss occurrence; a generation unit that generates map information by registering the position indicated in the state information acquisition position information when the state of the subject is determined to be abnormal in a map of the location of the subject based on a near-miss database including the above-mentioned items in association with each other. The generation unit classifies records of the near-miss database in accordance with predetermined conditions for the environmental information, and generates the map information by registering the position indicated in the status information acquisition position information in the map based on the result of the classification, and varies the generation mode of the map information depending on the environmental information. [Effects of the Invention]

[0010] It is possible to provide near miss information effectively. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 illustrates an example of a generation system according to an embodiment. [Figure 2] FIG. 10 is a diagram illustrating an example of acquired information acquired by an acquisition device. [Figure 3] FIG. 2 is a diagram showing an example of photographing information acquired by a photographing device. [Figure 4] FIG. 2 is a diagram illustrating an example of a near-miss database according to the embodiment. [Figure 5] 10 is a diagram illustrating map information including information of a near-miss database according to an embodiment. FIG. [Figure 6] FIG. 10 is a diagram illustrating an example of an operational flow of a process for generating near-miss map information according to an embodiment. [Figure 7] FIG. 10 is a diagram showing another example of map information including information of the near-miss database according to the embodiment. [Figure 8] FIG. 10 is a diagram illustrating an example of an operational flow of a notification process according to the embodiment. [Figure 9] FIG. 10 is a diagram showing another example of map information including information of the near-miss database according to the embodiment. [Figure 10] FIG. 1 illustrates an example of a computer for implementing a generating device according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, several embodiments of the present invention will be described in detail with reference to the drawings, in which the same reference numerals are used to designate corresponding elements in the drawings.

[0013] In the embodiment described below, a near miss occurs in a subject (i.e., the subject's condition is abnormal) based on the measurement values ​​of a sensor attached to the subject, such as a worker performing work at a workplace or a person requiring care living in a nursing facility. When the subject's condition is determined to be abnormal, the sensor measurement values, acquisition time, and acquisition location are acquired. Furthermore, images (still images or video images) captured by a fixed surveillance camera, an unmanned vehicle, or a camera worn by the user installed near the sensor measurement value acquisition location are included in the near miss database. This allows a manager managing the subject or the subject's activities to confirm the subject's condition when a near miss occurs from the images. Therefore, the situation when the subject's condition becomes abnormal (such as when, where, who, what, why, and what happened) can be understood based on the sensor measurement values, acquisition time, and acquisition location. In other words, a near miss database that can understand the subject's condition, including the time of the near miss, can be automatically generated.

[0014] In the embodiment, the generated near-miss database is used to map the locations of near-miss incidents. This allows the target person to easily understand the locations of near-miss incidents. It is also possible to alert the target person when they approach the locations of near-miss incidents marked on the map. The embodiment will be described in more detail below.

[0015] FIG. 1 is a diagram illustrating an example of a generation system 1 according to an embodiment. The generation system 1 illustrated in FIG. 1 includes an acquisition device 2, one or more image capture devices 3, and a generation device 4. The generation device 4 may acquire information from the acquisition device 2 and the image capture device 3 via wireless communication, wired communication, or a network such as the Internet, or may acquire information from the acquisition device 2 and the image capture device 3 via a recording medium such as a memory card. In the example of FIG. 1, the generation system 1 is configured with the acquisition device 2, the image capture device 3, and the generation device 4, but the embodiment is not limited thereto. For example, the acquisition device 2, the image capture device 3, and the generation device 4 may be integrated into a single device.

[0016] The acquisition device 2 is attached to the subject's body and includes a state information acquisition unit 21, a time information acquisition unit 22, a position information acquisition unit 23, a storage unit 24, and a control unit 25. The state information acquisition unit 21 may be configured to include the time information acquisition unit 22 and the position information acquisition unit 23. The acquisition device 2 may be held by the subject in the form of an activity meter, a smart watch, a smartphone, a mobile terminal, or the like. The acquisition device 2 may also be embedded in the subject's body.

[0017] The status information acquisition unit 21 is an acceleration sensor, tilt sensor, heart rate monitor, blood pressure monitor, electrodermal activity sensor, sole pressure sensor, barometric pressure sensor, etc., and acquires status information regarding the subject's status, such as the subject's movements, position, posture, and vital data.

[0018] For example, when the acquisition device 2 is attached to the subject's central part (such as the waist), the status information acquisition unit 21 is configured with an acceleration sensor or a tilt sensor. When the status information acquisition unit 21 is configured with an acceleration sensor or a tilt sensor, it can measure the acceleration and tilt angle near the center of the subject's body, thereby measuring the subject's movements while suppressing the influence of movements of local body parts such as the arms and legs. Alternatively, when the acquisition device 2 is attached to the subject's palm, finger, arm, or the like, the status information acquisition unit 21 is configured with a heart rate monitor, a blood pressure monitor, an electrodermal activity sensor, or the like. When the status information acquisition unit 21 is configured with a heart rate monitor, a blood pressure monitor, an electrodermal activity sensor, or the like, if the subject's condition becomes abnormal, the subject's heart rate will rise sharply or the subject will break out into a cold sweat (emotional sweating). Therefore, by detecting a sharp increase in the measurement values ​​of the heart rate monitor, the blood pressure monitor, or the electrodermal activity sensor, it is possible to determine that the subject's condition has become abnormal. Alternatively, when the acquisition device 2 is attached to the sole of the subject's foot, the status information acquisition unit 21 is configured with a pressure sensor. In this way, when the status information acquisition unit 21 is configured with a pressure sensor, if the subject's condition becomes abnormal, the pressure distribution and center of gravity movement of the pressure on the soles of the subject's feet will change compared to normal times, and by detecting the change in the measurement value of the pressure sensor, it can be determined that the subject's condition has become abnormal.

[0019] The time information acquisition unit 22 is a radio clock or a GPS (Global Positioning System), and acquires state information acquisition time information indicating the time (date and time) when the state information acquisition unit 21 acquired the state information.

[0020] The position information acquisition unit 23 is a GPS or an indoor position information acquisition terminal, and acquires the position information of the acquisition device 2 when the status information is acquired by the status information acquisition unit 21. When the time information acquisition unit 22 and the position information acquisition unit 23 are configured by a GPS, the time information acquisition unit 22 and the position information acquisition unit 23 may be integrated into one unit.

[0021] The memory unit 24 is a RAM (Random Access Memory), a ROM (Read Only Memory), or a memory card, and stores information acquired by the acquisition device 2 (identification information, status information, status information acquisition time information, status information acquisition location information).

[0022] The control unit 25 is configured with a CPU (Central Processing Unit) or a programmable device (such as an FPGA (Field Programmable Gate Array) or a PLD (Programmable Logic Device)), and controls the operations of the state information acquisition unit 21, the time information acquisition unit 22, the position information acquisition unit 23, and the storage unit 24. The control unit 25 also associates identification information for identifying the subject, the state information acquired by the state information acquisition unit 21, the state information acquisition time information acquired by the time information acquisition unit 22, and the state information acquisition position information acquired by the position information acquisition unit 23, and stores them in the storage unit 24. The information stored in the storage unit 24 is transmitted to the generation device 4 via wireless communication, wired communication, or a network. Alternatively, the information stored in the storage unit 24 is provided to the generation device 4 via a memory card.

[0023] The photographing device 3 also includes a photographing unit 31, a time information acquiring unit 32, a position information acquiring unit 33, a storage unit , and a control unit .

[0024] The image capturing unit 31 may be a fixed surveillance camera installed at a work site or a nursing facility, a camera equipped on an unmanned mobile body such as a drone or a robot, or a camera attached to a helmet worn by the subject, and captures images (still images or moving images). This camera may be, for example, a 360-degree camera or a 3D scanner. When capturing still images, the image capturing unit 31 captures images at set intervals, for example. The set interval is preferably set appropriately taking into consideration the searchability of the images. Furthermore, when the image capturing unit 31 is a fixed surveillance camera or an unmanned mobile camera, the image capturing unit 31 is capable of capturing images of the subject and the subject's surroundings. Furthermore, when the image capturing unit 31 is a camera attached to the subject's body, such as a 360-degree camera, the image capturing unit 31 is capable of capturing images of the subject's surroundings.

[0025] The time information acquisition unit 32 is a radio clock, a GPS, or the like, and acquires photographing time information indicating the time (date and time) when the image was photographed by the photographing unit 31.

[0026] The location information acquisition unit 33 is a GPS or an indoor location information acquisition terminal, and acquires shooting location information that indicates the location of the shooting device 3 when an image was captured by the shooting unit 31. When the time information acquisition unit 32 and the location information acquisition unit 33 are configured by a GPS, the time information acquisition unit 32 and the location information acquisition unit 33 may be integrated into one unit.

[0027] The storage unit 34 is a RAM, a ROM, a memory card, or the like, and stores information acquired by the photographing device 3 (images, photographing time information, photographing position information).

[0028] The control unit 35 is configured with a CPU or a programmable device, and controls the operations of the photographing unit 31, the time information acquisition unit 32, the position information acquisition unit 33, and the storage unit 34. The control unit 35 also stores in the storage unit 34 an image photographed by the photographing unit 31, photographing time information acquired by the time information acquisition unit 32, and photographing position information acquired by the position information acquisition unit 33, in association with each other. The information stored in the storage unit 34 is transmitted to the generation device 4 via wireless communication, wired communication, or a network. Alternatively, the information stored in the storage unit 34 is provided to the generation device 4 via a memory card.

[0029] The generation device 4 is configured by a computer such as a personal computer (PC), a mobile PC, a tablet terminal, a smartphone, a mobile phone, or a server computer on a network.

[0030] In addition, the generation device 4 includes a judgment unit 41, a generation unit 42, and a memory unit 43, and generates a near-miss database using information acquired by the acquisition device 2 and information acquired by the photographing device 3.

[0031] The determination unit 41 detects a sudden change in the state information acquired by the acquisition device 2 as a near miss. For example, if the determination unit 41 determines that the acceleration measured by the acceleration sensor serving as the state information acquisition unit 21 falls within an acceleration range corresponding to a "stationary state" for a certain period of time, the determination unit 41 determines that the state of the subject is "stationary." Next, after identifying the "stationary state" as the state of the subject, if the determination unit 41 determines that the acceleration measured by the acceleration sensor falls within an acceleration range corresponding to a "walking state" for a certain period of time, the determination unit 41 determines that the state of the subject has changed from "stationary state" to "walking state." On the other hand, if the determination unit 41 determines that the acceleration measured by the acceleration sensor does not fall within any of the pre-defined acceleration ranges after identifying the "stationary state" as the state of the subject, the determination unit 41 determines that the state of the subject is abnormal, i.e., that a near miss has occurred.

[0032] The determination range of the acceleration range may be set to thresholds such as minimum and maximum values. For example, the acceleration range corresponding to the "stationary state" is the range from the minimum to maximum of multiple accelerations measured continuously for a certain period by the acceleration sensor when the subject is stationary. Similarly, the acceleration range corresponding to the "walking state" is the range from the minimum to maximum of multiple accelerations measured continuously for a certain period by the acceleration sensor when the subject is walking. The minimum and maximum values ​​of the acceleration range may be fixed values, may be changed depending on the subject, or may be changed depending on the amount of change per unit time in the measurement value of the acceleration sensor.

[0033] Note that, when the status information acquisition unit 21 of the acquisition device 2 is configured with a plurality of sensors, the determination unit 41 may be configured to determine whether the status of the subject is abnormal using the measurement values ​​measured by each of the plurality of sensors. Alternatively, when the status information acquisition unit 21 of the acquisition device 2 is configured with a plurality of sensors, the determination unit 41 may be configured to identify the status of the subject and then determine whether the status of the subject has become abnormal from the identified status. For example, the determination unit 41 may be configured to identify that the subject is descending stairs using the measurement values ​​measured by an acceleration sensor and the measurement values ​​measured by a barometric pressure sensor, and then determine whether the status of the subject has become abnormal from the state of descending stairs.

[0034] Furthermore, when the status information acquisition unit 21 of the acquisition device 2 is configured with a photographing device such as a camera, the determination unit 41 may be configured to determine whether the subject's status is abnormal using an image (still image or moving image) captured by the photographing device. Alternatively, when the status information acquisition unit 21 of the acquisition device 2 is configured with a photographing device, the determination unit 41 may be configured to identify the subject's status using an image captured by the photographing device, and then determine whether the subject's status has changed from the identified status to an abnormal status. For example, the determination unit 41 may be configured to analyze a moving image and track the subject in the moving image, thereby identifying that the subject is walking, and then determine whether the subject's status has changed from a walking status to an abnormal status.

[0035] Furthermore, when the status information acquisition unit 21 of the acquisition device 2 is configured with a sensor such as an acceleration sensor and an imaging device such as a camera, the determination unit 41 may be configured to determine whether the subject's status is abnormal using both the sensor measurement value and an image from the imaging device. Alternatively, when the status information acquisition unit 21 of the acquisition device 2 is configured with a sensor and an imaging device, the determination unit 41 may be configured to identify the subject's status using both the sensor measurement value and an image from the imaging device, and then determine whether the subject's status has become abnormal from the identified status. For example, the determination unit 41 may be configured to confirm the identified subject's status when the subject's status identified using the sensor measurement value and the subject's status identified using the image from the imaging device match. Furthermore, the determination unit 41 may be configured to determine that the subject's status has become abnormal from the identified status using the sensor measurement value and, when the subject's status has become abnormal from the identified status using the image from the imaging device, determine that the subject's status is abnormal.

[0036] When the judgment unit 41 judges that the subject's condition is abnormal, the generation unit 42 generates a near-miss database by associating identification information for identifying the subject, status information acquisition time information indicating the acquisition time of the status information used when the subject's condition was judged to be abnormal, status information acquisition position information indicating the acquisition position of the status information used when the subject's condition was judged to be abnormal, and an image captured of the acquisition position of the status information used when the subject's condition was judged to be abnormal.

[0037] In addition, when the generation system 1 is configured to include multiple photographing devices 3, the generation unit 42 may be configured to generate a near-miss database by correlating identification information, status information acquisition time information, status information acquisition location information, and images captured by each of the multiple photographing devices 3.

[0038] The memory unit 43 is a RAM or ROM, etc., and stores information acquired by the acquisition device 2 (identification information, status information, status information acquisition time information, status information acquisition location information), information acquired by the photographing device 3 (image information, photographing time information, photographing location information), and the near-miss database generated by the generation unit 42.

[0039] FIG. 2 is a diagram showing an example of acquired information 200 acquired by the acquisition device 2. As shown in FIG.

[0040] The acquired information 200 shown in FIG. 2 is information stored in the storage unit 24 of the acquisition device 2 or the storage unit 43 of the generation device 4. The acquired information 200 also has a field F11 in which identification information is stored, a field F12 in which state information is stored, a field F13 in which state information acquisition time information is stored, and a field F14 in which state information acquisition position information is stored. That is, the acquired information 200 is information in which identification information, state information, state information acquisition time information, and state information acquisition position information are associated with one another. In the example of FIG. 2, "ID1" is stored in field F11 of each of records R11 to R20 of the acquired information 200, and "latitude: 35 degrees 41 minutes 29 seconds, longitude: 139 degrees 44 minutes 16 seconds" is stored in field F14 of each of records R11 to R20. In addition, "1.1[G]" is stored in field F12 of record R11 of the acquired information 200, and "January 15, 2021, 9:30:31" is stored in field F13 of record R11.

[0041] FIG. 3 is a diagram showing an example of photographic information 300 acquired by the photographing device 3. As shown in FIG.

[0042] The photographing information 300 shown in FIG. 3 is information stored in the storage unit 34 of the photographing device 3 and the storage unit 43 of the generation device 4. The photographing information 300 also has a field F21 in which an image is stored, a field F22 in which photographing time information is stored, and a field F23 in which photographing location information is stored. That is, the photographing information 300 is information in which image information, photographing time information, and photographing location information are associated with one another. In the example of FIG. 3, "Image1" is stored in field F21 of record R21 of the photographing information 300, and "January 15, 2021, 9:30:31" is stored in field F22 of record R21. Furthermore, "Latitude: 35 degrees 41 minutes 29 seconds, Longitude: 139 degrees 44 minutes 16 seconds" is stored in field F23 of record R21 of the photographing information 300.

[0043] FIG. 4 is a diagram illustrating an example of the near-miss incident database 400. As shown in FIG.

[0044] 4 is information stored in the storage unit 43 of the generating device 4. The near-miss database 400 also has a field F31 in which identification information is stored, a field F32 in which status information is stored, a field F33 in which status information acquisition time information is stored, a field F34 in which status information acquisition position information is stored, and a field F35 in which image information is stored. In other words, the near-miss database 400 is information in which identification information, status information, status information acquisition time information, status information acquisition position information, and image information are associated with one another. In the example of Figure 4, "ID1" is stored in field F31 of record R31 of information D3, "2.9[G]" is stored in field F32 of record R31, "January 15, 2021, 9:30:38" is stored in field F33 of record R31, "Latitude: 35 degrees 41 minutes 29 seconds, Longitude: 139 degrees 44 minutes 16 seconds" is stored in field F34 of record R31, and "Image8" is stored in field F35 of record R31.

[0045] Here, when the acquired information 200 shown in Figure 2 and the shooting information 300 shown in Figure 3 are stored in the memory unit 43 of the generation device 4, it is assumed that the minimum value of the acceleration range for identifying the state in which the subject is walking is 0.6 [G], the maximum value is 1.2 [G], and the fixed time is 5 [seconds].

[0046] First, when the determination unit 41 of the generating device 4 determines that the state information (1.1 [G], 1.0 [G], 0.9 [G], 0.8 [G], 0.6 [G]) stored in the field F12 of each of the records R11 to R15 for a certain time period (5 [seconds]) among the records R11 to R20 of the acquired information 200 is within the acceleration range (0.6 [G] to 1.2 [G]), the determination unit 41 identifies the state of the subject as "walking state." Next, when the determination unit 41 determines that the state information (2.9 [G]) stored in the field F12 of the record R18 among the state information stored in the field F12 of each of the records R16 to R20 for the next certain time period (5 [seconds]) among the records R11 to R20 of the acquired information 200 is outside the predetermined range (0.6 [G] to 1.2 [G]), the determination unit 41 determines that the state of the subject has changed from "walking state" to abnormal. That is, the determination unit 41 determines that a near miss occurred while the subject was walking. Note that the generation unit 42 may be configured to include the content determined by the determination unit 41 (that a near miss occurred while the subject was walking) in the near miss database.

[0047] Next, the generation unit 42 of the generation device 4 searches the imaging information 300 for record R28 corresponding to the imaging time information and imaging location information that match the status information acquisition time information and status information acquisition location information of record R18 in the acquired information 200. This makes it possible to extract the image (Image8) stored in field F21 of record R28 in the imaging information 300 as the image captured at or near the acquisition location of the status information used when determining that the subject's condition is abnormal. Note that the image captured at or near the acquisition location of the status information is, for example, an image captured by a camera attached to the subject. Alternatively, the image captured at or near the acquisition location of the status information is, for example, an image captured by a camera located within a predetermined shooting distance from the acquisition location of the status information. In another example, the image captured at or near the acquisition location of the status information is an image captured by a camera at the acquisition location of the status information.

[0048] The generation unit 42 then associates the image (Image8) stored in field F21 of record R28 of the imaging information 300 with record R18 of the acquired information 200, thereby generating a near-miss database 400 consisting of record R31. As a result, the subject or a manager managing the subject's activities can confirm the information stored in fields F31 to F34 of record R31 in the near-miss database 400 to determine when ("Latitude: 35 degrees 41 minutes 29 seconds, Longitude: 139 degrees 44 minutes 16 seconds"), where ("January 15, 2021, 9:30:35" to "January 15, 2021, 9:30:40"), and who ("ID1") occurred, and can also confirm what the subject was doing, why, and what happened (for example, that the subject tripped over materials scattered on the floor while walking) by checking the image stored in field F35 of record R31. The photographing device 3 may be set to record a record in the photographing information 300 only when a near miss occurs. By recording only when a near miss occurs, the capacity of the storage device can be reduced. Also, the amount of data to be transmitted to the generating device 4 can be reduced. The photographing device 3 may be set to transmit the photographing information 300 all at once at a set time.

[0049] The generation unit 42 may be configured to generate the near-miss database 400 using records R16 to R20 before and after record R18, including record R18 in the acquired information 200 when the subject's condition became abnormal, and the images (Image 6 to Image 10) of records R26 to R30 in the photographed information 300 that match the times and positions of records R16 to R20. The generation unit 42 may also be configured to generate near-miss databases for multiple subjects. The generation unit 42 may also be configured to analyze and statistically process the circumstances when the subject became abnormal based on the near-miss database, and to extract the cause of the subject's abnormality from the analysis and statistical processing. This allows the subject or manager to understand the circumstances before and after the subject's abnormality by checking each image in the near-miss database 400. Therefore, by checking the near miss database 400, the target person or manager can not only recognize when, where, and who became abnormal (a near miss occurred), but also analyze and statistically process the situation when the abnormality occurred and extract the cause of the abnormality.

[0050] In the embodiment, the generating unit 42 then registers the information of the near-miss database 400 generated as described above in the map information 500, for example.

[0051] FIG. 5 is a diagram illustrating map information 500 including information from the near-miss database 400 according to an embodiment. The map information 500 is, for example, a floor plan of a work site where workers and other personnel work, and drawing data such as BIM (Building Information Modeling) data. In the example of FIG. 5, coordinate positions 501 that associate positions on the map with coordinates in real space are registered in the map information 500. The coordinate positions 501 may include, for example, the installation positions of the camera device 3 and the beacon receiver. For example, by measuring and recording the installation positions of the camera device 3 and the beacon receiver in an image and their position coordinates in real space in advance, the installation positions in the image can be associated with their position coordinates in real space. For example, the position coordinates of the installation position of the camera device 3 can be acquired from the photography information 300. Using multiple coordinate positions 501 (for example, three or more points), it is possible to associate other positions in the image with their coordinates in real space.

[0052] 5, a near-miss occurrence position 502 is registered in the map information 500. The generation unit 42, for example, acquires information on the near-miss occurrence position from the state information acquisition position information of the near-miss database 400. Then, the generation unit 42 may register the near-miss occurrence position in the map information 500. For example, the generation unit 42 registers the near-miss occurrence position 502 at a position corresponding to the position coordinates of the near-miss occurrence position based on a coordinate position 501 included in the map information 500.

[0053] Therefore, according to the embodiment, map information 500 indicating the locations of near misses within a work site can be easily generated. Furthermore, map information 500 facilitates the sharing of information regarding areas within a work site that require attention. Map information 500 allows the locations of multiple near misses to be confirmed, which can be useful for understanding near miss trends and improving the work site environment. Note that map information 500 may also include other information related to near misses, such as the person involved, the time of occurrence, and the details of the near miss.

[0054] Furthermore, the map information 500 may be used, for example, to alert a person working on-site about a near miss. For example, when a person approaches a near miss occurrence position 502 registered on the map information 500, an alert may be issued by sound, vibration, email, or the like to alert the person. This can prevent the person from causing a near miss.

[0055] Next, a description will be given of a process for generating the near-miss map information 500 according to the embodiment. Fig. 6 is a diagram illustrating an example of an operation flow of the process for generating the near-miss map information 500 according to the embodiment. For example, the generating device 4 may start the operation flow of Fig. 6 when an instruction to execute the process for generating the map information 500 is input.

[0056] In S601, the determination unit 41 of the generation device 4 determines whether or not the subject has entered a predetermined location such as a work site or a care facility. If it is determined that the subject has not entered (No in S601), the flow repeats the processing of S601. On the other hand, if it is determined that the subject has entered (Yes in S601), the flow proceeds to S602.

[0057] In S602, the determination unit 41 of the generation device 4 transmits a status information acquisition start instruction to the acquisition device 2 and an image acquisition start instruction to the photographing device 3. For example, the generation device 4 determines that the subject has entered the work site or nursing home using a radio frequency identification (RFID) receiver, a magnetic reader, an infrared sensor, or facial recognition installed near the entrance of the work site or nursing home. Alternatively, the generation device 4 determines that the subject has entered the work site or nursing home by detecting that the subject has pressed a measurement start button installed near the entrance of the work site or nursing home or provided on a device worn by the subject. Note that, for example, upon receiving the status information acquisition start instruction, the acquisition device 2 starts collecting the subject's status information and registers a record in the acquired information 200. Furthermore, for example, upon receiving the image acquisition start instruction, the photographing device 3 starts capturing images and registers a record in the photographing information 300.

[0058] In S603, the determination unit 41 of the generation device 4 determines whether the subject has left a predetermined location such as a work site or a nursing home. For example, if the subject has not left a predetermined location such as a work site or a nursing home (No in S603), the flow repeats the process of S603. On the other hand, if it is determined that the subject has left (Yes in S603), the flow proceeds to S604. For example, the determination unit 41 determines that the subject has left the work site or nursing home using an RFID receiver, a magnetic reader, an infrared sensor, or facial recognition installed near the exit of the work site or nursing home. Alternatively, the determination unit 41 determines that the subject has left the work site or nursing home by detecting that the subject has pressed a measurement end button installed near the exit of the work site or nursing home or provided on a device worn by the subject.

[0059] In S604, the determination unit 41 transmits a state information acquisition end instruction to the acquisition device 2 and transmits an image acquisition end instruction to the photographing device 3. For example, when the acquisition device 2 receives the state information acquisition end instruction, it transmits the acquired information 200 in which the records of the collected state information are registered to the generation device 4. For example, when the photographing device 3 receives the image acquisition end instruction, it transmits the photographing information 300 including the records in which the photographed images are registered to the generation device 4.

[0060] In S605, the determination unit 41 determines whether or not information about the subject has been received. If information about the subject has not been received (No in S605), the flow repeats the process of S605. On the other hand, if information about the subject has been received (Yes in S605), the flow proceeds to S606. For example, when the determination unit 41 receives the acquired information 200 from the acquisition device 2 and the photographed information 300 from the photographing device 3, the determination unit 41 determines Yes in S605.

[0061] In S606, the determination unit 41 determines whether or not there is an abnormality in the subject's condition. For example, if the received information does not include status information that determines that the subject's condition is abnormal, the determination unit 41 determines No in S606, and this operation flow ends without creating a near-miss database. On the other hand, if the received information includes status information that determines that the subject's condition is abnormal, the determination unit 41 determines Yes in S606, and the flow proceeds to S607.

[0062] In S607, the generation unit 42 generates a near-miss database 400 using the status information determined to be abnormal, information related to the status information (identification information, status information acquisition time information, and status information acquisition location information), and images taken at or near the acquisition location of the status information, and stores the database in the memory unit 43.

[0063] In S608, the generation unit 42 generates map information 500 by registering information on the location where the near miss occurred (for example, the location indicated in the status information acquisition location information) in a map based on the information in the generated near miss database 400, and stores this information in the memory unit 43, and this operation flow ends.

[0064] As described above, the generation system 1 of the embodiment generates a near-miss database that includes not only the status information used when the subject's condition is determined to be abnormal, but also images captured at the location where the status information was acquired. This allows subjects and managers to automatically generate a near-miss database that allows them to understand the subject's situation at the time of a near-miss by checking the near-miss database. Furthermore, according to the embodiment, the near-miss database can be used to generate map information 500, in which the locations of near-misses are registered. This makes it easier for subjects and managers to develop measures to prevent near-misses. For example, the map information 500 facilitates the sharing of information about areas within a worksite that require attention. Furthermore, because the locations of multiple near-misses can be viewed on the map information 500, it can be useful for understanding near-miss trends and improving the worksite environment.

[0065] In addition, a near-miss database can be collected for multiple subjects. By collecting near-miss information for multiple subjects, a near-miss database can be created. Note that the embodiment can also be applied to multiple work sites.

[0066] The generation unit 42 may also classify the records registered in the near-miss database 400 based on predetermined conditions and generate map information 500 based on the classification results. For example, the generation unit 42 performs analysis and statistical processing on the records in the near-miss database 400, such as the location, situation, and time of occurrence, and classifies the near-miss events that have occurred into categories such as tripping and slipping. Then, in S607, the generation unit 42 may register the records in the near-miss database 400, including classification information including the classification results. In this case, in S608, the generation unit 42 generates map information 500 by, for example, displaying the records in different formats for each classification.

[0067] FIG. 7 is a diagram illustrating map information 500 in which the locations of near misses are registered in different display formats for each classification. In the example of FIG. 7, the locations of near misses are shown as occurrence locations 502 where tripping occurred, represented by an "x", and occurrence locations 502 where slipping occurred, represented by a "o". By displaying events by classification in this way, it becomes easier to understand the details of the near misses. Note that the display may be distinguished not only by shape, but also by other methods such as color or size.

[0068] The classification may also be based on other conditions, such as the time period in which the near miss occurred, the season, and other environmental information indicating the environment, such as the weather. For example, the generation unit 42 extracts records from the near miss database 400 for time periods such as 10:00 to 12:00, 1:00 to 15:00, and 15:00 to 17:00, based on the status information acquisition time information from the near miss database 400. The generation unit 42 may then generate map information 500 for each time period, including the locations 502 of near misses that occurred during that time period. This makes it easy to understand situations, such as the occurrence of many near misses during times when fatigue sets in, such as 15:00 to 17:00. Alternatively, by classifying and displaying near misses by season, it becomes easy to understand situations, such as the occurrence of many near misses during the hot summer months. Furthermore, by classifying and displaying near misses according to the weather, it is possible to display near misses that occur frequently on rainy days in the map information 500, for example, by including and providing near misses on rainy days in the map information 500 but not on sunny days. Therefore, according to the embodiment, near miss information can be registered and provided in the map information 500 at a time when near misses are likely to occur.

[0069] Weather information can be collected, for example, from a website provided by the Japan Meteorological Agency, etc. For example, when generating the near-miss database 400 in S607, the generation unit 42 may obtain the weather in the area of ​​the site corresponding to the map information 500 at the date and time corresponding to the status information acquisition time information of the record in the near-miss database 400 from a website provided by the Japan Meteorological Agency, and register the weather information in the near-miss database 400.

[0070] Furthermore, according to the embodiment, it is possible to alert a target person when the target person approaches the near miss occurrence position 502 recorded in the map information 500.

[0071] 8 is a diagram illustrating an example of an operational flow of the notification process according to the embodiment. For example, when an instruction to execute the near-miss notification process is input, the generation device 4 starts the operational flow of FIG.

[0072] In S801, the determination unit 41 of the generation device 4 determines whether or not the subject has entered a predetermined location such as a work site or a care facility. If it is determined that the subject has not entered (No in S801), the flow repeats the processing of S801. On the other hand, if it is determined that the subject has entered (Yes in S801), the flow proceeds to S802. Note that the processing of S801 may be executed in the same manner as S601, for example.

[0073] In S802, the determination unit 41 acquires the state information of the subject from the acquisition device 2. Note that the state information includes, for example, the position information of the subject acquired by GPS.

[0074] In S803, the determination unit 41 determines whether the subject is at a location where a near miss occurred. For example, the determination unit 41 determines that the subject's current location acquired in S802 is the location where a near miss occurred if the subject approaches the near miss occurrence location 502 in the near miss database 400 while satisfying a predetermined condition. The case where the subject approaches while satisfying the predetermined condition is, for example, when the subject enters a location within a predetermined distance from the near miss occurrence location 502. In another example, a beacon receiver may be installed at the near miss occurrence location 502, and the receiver notifies the generating device 4 when it receives a beacon from a beacon transmitter held by the subject with a predetermined intensity or higher. In this case, the determination unit 41 of the generating device 4 determines that the subject has approached the occurrence location 502 while satisfying a predetermined condition, for example, when it receives a notification indicating that a beacon has been received with a predetermined intensity or higher. This allows the determination unit 41 to determine that the subject is at a location where a near miss occurred.

[0075] If the subject is not at the location where the near miss occurred in S803 (NO in S803), the flow proceeds to S805. On the other hand, if the subject is at the location where the near miss occurred in S803 (YES in S803), the flow proceeds to S804.

[0076] In S804, the determination unit 41 issues a warning notification, and the flow proceeds to S805. For example, the determination unit 41 issues a warning notification to a terminal such as the acquisition device 2 carried by the subject. When the terminal carried by the subject receives the warning notification, the terminal outputs a notification by sound, vibration, or the like. This allows the subject to know that he or she is in a position where a near miss has occurred, and can take measures to prevent the near miss from occurring. Therefore, the occurrence of near misses can be suppressed.

[0077] In S805, the determination unit 41 determines whether the subject has left a predetermined location such as a work site or a nursing home. For example, if the subject has not left a predetermined location such as a work site or a nursing home (No in S805), the flow returns to S802. On the other hand, if it is determined that the subject has left (Yes in S805), this operation flow ends. For example, the determination unit 41 determines that the subject has left a work site or a nursing home using an RFID receiver, a magnetic reader, an infrared sensor, or facial recognition installed near the exit of the work site or the nursing home. Alternatively, the determination unit 41 determines that the subject has left a work site or a nursing home by detecting that the subject has pressed a measurement end button installed near the exit of the work site or the nursing home or provided on a device worn by the subject.

[0078] As described above, according to the embodiment, when a target person is in a location where a near miss has occurred, a warning can be issued based on the information in the near miss database 400 or the map information 500. Therefore, the occurrence of near misses can be reduced.

[0079] In the above embodiment, an example is described in which in S803, it is determined whether or not the target person is at the location where the near miss occurred using the distance, radio wave intensity, etc., but the embodiment is not limited to this. In another embodiment, the determination unit 41 may further determine whether or not the target person is at the location where the near miss occurred based on information from the map information 500.

[0080] For example, if the map information 500 is provided as BIM data, it can be used because it includes information on the structure of the building, etc. In this case, for example, the determination unit 41 may determine whether or not the target person is in an area corresponding to the location where the near miss occurred.

[0081] 9 is a diagram illustrating an example of map information 500 including information on an area 901 corresponding to the location where a near miss occurred. For example, the map information 500 in FIG. 9 includes area information 901 indicating an area within room C.

[0082] Here, for example, suppose a target person approaches within a predetermined distance from the occurrence position 502 in room C. In this case, the target person may be in room A or room C. On the other hand, since the near miss occurs in room C, even if the target person is close to the occurrence position 502 in room C, the possibility of the near miss occurring may be low if the target person is in room A. Therefore, in the embodiment, the determination unit 41 determines in S803 that the target person is in the location where the near miss occurred, for example, when the target person is within a predetermined distance from the occurrence position 502 of the near miss and is in an area corresponding to the occurrence position 502. For example, the determination unit 41 determines in S803 that the target person is in the location where the near miss occurred, when the target person is within a predetermined distance from the occurrence position 502 of the near miss and is in an area indicated by the area information 901 of room C to which the occurrence position 502 of the near miss belongs.

[0083] This allows the target person to be alerted to a near miss with higher accuracy. The determination of whether or not the target person is in the area corresponding to the occurrence position 502 may be made, for example, based on whether or not the target person is in the same room (indoors). Furthermore, the map information 500 may include area information indicating the areas of other rooms, similar to the area information 901 corresponding to room C, for example.

[0084] FIG. 10 is a diagram illustrating an example of a computer for realizing the generating device 4. As shown in FIG.

[0085] 10 includes a processor 1001, a memory 1002, a storage device 1003, a reading device 1004, a communication interface 1005, and an input / output interface 1006. The processor 1001, the memory 1002, the storage device 1003, the reading device 1004, the communication interface 1005, and the input / output interface 1006 are connected to one another via a bus 1007.

[0086] The processor 1001 is configured with a single processor, multiple processors, multiple cores, etc. The processor 1001 also reads a program stored in a storage device 1003 and uses a memory 1002 to execute a program that describes the procedures of the flowcharts shown in Figures 6 and 8, thereby providing some or all of the functions of the determination unit 41 and the generation unit 42.

[0087] The memory 1002 is a semiconductor memory or the like, and may include a RAM area and a ROM area.

[0088] The storage device 1003 is a semiconductor memory such as a hard disk or a flash memory, or an external storage device.

[0089] The reading device 1004 accesses the removable storage medium 1009 in accordance with instructions from the processor 1001. The removable storage medium 1009 is realized by a semiconductor device, a medium that inputs and outputs information by magnetic action, a medium that inputs and outputs information by optical action, or the like. The semiconductor device is a USB (Universal Serial Bus) memory or the like. The medium that inputs and outputs information by magnetic action is a magnetic disk or the like. The medium that inputs and outputs information by optical action is a CD (Compact Disc)-ROM, a DVD (Digital Versatile Disc), a Blu-ray Disc (Blu-ray is a registered trademark), or the like.

[0090] The storage unit 43 described above includes, for example, a memory 1002, a storage device 1003, and a removable storage medium 1009. For example, the storage device 1003 stores acquired information 200, photographed information 300, a near-miss database 400, and map information 500.

[0091] The communication interface 1005 communicates with other devices according to instructions from the processor 1001. For example, the generation device 4 collects information from the acquisition device 2 and the imaging device 3 via the communication interface 1005.

[0092] The input / output interface 1006 is, for example, an interface between an input device and an output device. The input device is a device such as a keyboard, mouse, or touch panel that receives instructions from a subject or an administrator. The output device is a display device such as a monitor, or an audio device such as a speaker.

[0093] Each program according to the embodiment is provided to the generating device 4 in the following form, for example. (1) It is pre-installed in the storage device 1003. (2) Provided by a removable storage medium 1009. (3) Provided from a server such as a program server.

[0094] 10 is an example, and the embodiment is not limited thereto. For example, part of the above-described configuration may be deleted, or new configuration may be added. Furthermore, in another embodiment, for example, part or all of the functions of the above-described generation device 4 may be implemented as hardware such as an FPGA, a system-on-a-chip (SoC), an application-specific integrated circuit (ASIC), or a PLD.

[0095] Several embodiments have been described above. However, the embodiments are not limited to the above embodiments and should be understood to include various modifications and alternative forms of the above embodiments. For example, it will be understood that the various embodiments can be realized by modifying the components without departing from the spirit and scope of the embodiments. It will also be understood that various embodiments can be implemented by appropriately combining multiple components disclosed in the above-described embodiments. Furthermore, it will be understood by those skilled in the art that various embodiments can be implemented by deleting some components from all the components shown in the embodiments or by adding some components to the components shown in the embodiments. [Explanation of symbols]

[0096] 1: Generation system 2: Acquisition device 3: Imaging device 4:Generation device 21: Status information acquisition unit 22: Time information acquisition unit 23: Location information acquisition section 24: Storage section 25: Control section 31: Photography Department 32: Time information acquisition unit 33: Location information acquisition section 34: Storage section 35: Control section 41: Judgment section 42 :Generation part 43: Storage section 200: Acquisition information 300: Image information 400: Near miss database 500: Map information 501: Coordinate position 502: Location of occurrence 900: Computer 901: Processor 902: Memory 903 :Storage device 904: Reading device 905: Communication interface 906: Input / output interface 907: Bus 909: Removable storage media

Claims

1. Identification information for identifying the subject; status information regarding the subject's status; status information acquisition time information indicating the time when the status information was acquired; status information acquisition location information indicating a location where the status information was acquired; an image capturing a position where the status information is acquired; Environmental information including at least the time period, season, and weather of the near miss occurrence; a generating unit that generates map information by registering the position indicated in the state information acquisition position information when the state of the subject is determined to be abnormal in a map of the location of the subject, based on a near-miss database including the above-mentioned in association with each other, The generation unit classifies records of the near-miss database according to predetermined conditions for the environmental information, and generates the map information by registering the position indicated in the state information acquisition position information in the map based on the result of the classification, and varies the generation mode of the map information depending on the environmental information. generator.

2. The environmental information includes first environmental information in which a first near miss is likely to occur and a second near miss is unlikely to occur, and second environmental information in which the second near miss is likely to occur and the first near miss is unlikely to occur, The generation unit, under the first environmental information, includes the first near-miss in the map information and does not include the second near-miss in the map information, and under the second environmental information, includes the second near-miss in the map information and does not include the first near-miss in the map information; The generating device of claim 1 .

3. The device further includes a determination unit that outputs a notification indicating a warning when the position of the subject notified from the acquisition device approaches the position indicated in the status information acquisition position information while satisfying a predetermined condition.

3. The generating device according to claim 1 or 2.

4. the determination unit outputs a notification indicating a warning when the position of the subject notified from the acquisition device is within a predetermined distance from the position indicated in the status information acquisition position information and the subject is in the same room on the map. The generating device of claim 3 .

5. A generating method executed by a generating device, the generating device comprising: Identification information for identifying the subject; status information regarding the subject's status; status information acquisition time information indicating the time when the status information was acquired; status information acquisition location information indicating a location where the status information was acquired; an image capturing a position where the status information is acquired; Environmental information including at least the time period, season, and weather of the near miss occurrence; Based on a near-miss database including the above-mentioned items in association with each other, the position indicated in the state information acquisition position information when it is determined that the state of the subject is abnormal is registered in a map of the location of the subject, thereby generating map information; Classifying the records of the near-miss database in accordance with predetermined conditions for the environmental information, and generating the map information by registering the positions indicated in the state information acquisition position information in the map based on the results of the classification, and varying the generation mode of the map information depending on the environmental information. Generation method.

Citation Information

Patent Citations

  • Danger place information display unit for

    JP2007051973A

  • Danger prediction supporting system and danger prediction supporting method

    JP2013080304A

  • Abnormal state detector for worker and abnormal state management method at work site

    JP2013080305A

  • Work information system for collecting data related to event occurring at work site and method therefor

    JP2018180852A

  • Safety management system

    JP2019125151A