Safety education system for workers
The worker safety education system uses MR and VR simulations based on BIM to educate workers about unsafe behaviors in construction sites, improving awareness and reducing accidents through interactive training and evaluation.
Patent Information
- Application Number
- JP2023071787
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-25
- Publication Date
- 2024-11-07
- Estimated Expiration
- 2043-04-25
AI Technical Summary
Existing safety training technologies for construction sites fail to effectively educate workers about unsafe behaviors and dangers specific to actual work environments, lacking the ability to simulate real-site conditions and assess worker understanding.
A worker safety education system that utilizes mixed reality (MR) and virtual reality (VR) images based on Building Information Modeling (BIM) to simulate work environments, allowing workers to input caution information and receive feedback on unsafe behaviors, with features for evaluation and training result storage.
Enhances worker awareness of unsafe behaviors by simulating real-site conditions, enabling effective safety education and objective evaluation of worker understanding, reducing the risk of accidents.
Smart Images

Figure 2024157424000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a safety training system for workers. [Background technology]
[0002] At construction sites, there are tasks and environments in which workers may be injured. For example, when performing unfamiliar tasks, workers may damage tools and materials, get in the way of themselves and other workers, or injure themselves by not moving appropriately or handling tools and materials appropriately. In addition, since various tools, tools, materials, etc. are placed on the floor at the work site, workers may come into contact with these tools and fall or get injured. Furthermore, at sites where floors and walls are unfinished, there may be holes and protrusions that do not exist on completed floors and walls, and workers may fall into holes or come into contact with protrusions and get injured. These injuries are often caused by the worker's level of proficiency in the work and the worker's attention, so there is a possibility that injuries and other accidents can be reduced by informing and making workers understand the causes of accidents such as injuries and what they should be careful of. For this reason, in construction work, advance safety training (off-site training) is conducted at the company or other organization before actual construction work begins at the construction site, and on-site training is conducted after construction work begins at the site.
[0003] Incidentally, as disclosed in Patent Document 1, a technique has been developed for constructing an educational facility where people can experience accidents and dangers that occur at construction sites and the like, and for experiencing accidents and dangers at the educational facility. However, the technology of Patent Document 1 requires the construction of an educational facility, and so while it is possible to experience common accidents and dangers at a model site, it is not possible to experience accidents and dangers that occur at an actual site.
[0004] On the other hand, Patent Document 2 discloses a technology for detecting dangers and providing training at the work site based on 3D data. In the technology of Patent Document 2, when a specific location is selected in the 3D data, danger information and defect images are displayed, and at that time, problems regarding items to be confirmed at the site are filed. However, while the technology of Patent Document 2 is capable of dealing with sites of various structures compared to the technology of Patent Document 1, the technology of Patent Document 2 does not provide information on dangers or problems at actual sites.
[0005] The technology in Patent Document 3 also involves the development of a technology that automatically detects unsafe areas from structures that are the same as those at an actual construction site, based on a three-dimensional model formed by BIM. However, the technology in Patent Document 3 only detects unsafe areas caused by structures, and cannot inform or educate workers about unsafe behavior caused by actual work. For example, it cannot inform or educate workers about dangerous acts during actual work or hazards caused by obstacles due to temporary placement of materials, tools, etc.
[0006] On the other hand, the technology of Patent Document 4 discloses a technology in which precautions related to work on site are included in the attribute information of the parts of the three-dimensional model registered in the BIM or stored separately in a precaution registration unit, and the work situation is judged based on the information acquired by the automatic patrol vehicle, and precautions according to the work situation are displayed on the three-dimensional model. It also discloses a technology to alert the worker by having the worker check the precautions displayed on the three-dimensional model before work. It also discloses a function to store newly discovered precautions in the precaution registration unit. Therefore, by using the technology of Patent Document 4, it may be possible to inform workers to a certain extent of unsafe actions and hazards that may occur during on-site work regarding the parts they are working on. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] JP 2019-219442 A [Patent Document 2] JP 2020-190644 A [Patent Document 3] JP 2020-95390 A [Patent Document 4] JP 2021-156015 A Summary of the Invention [Problem to be solved by the invention]
[0008] The technology in Patent Document 4 is desirable in that it allows workers to check precautions that correspond to the actual work site, but it merely displays the precautions on an image, and workers cannot fully understand the situations in which unsafe behavior may actually occur. Even if the worker checks the precautions, it is not possible to determine whether or not the worker understands the precautions, and this is not sufficient training for the worker.
[0009] In view of the above circumstances, an object of the present invention is to provide a safety education system for workers that can enable workers to understand unsafe behaviors corresponding to actual work sites. [Means for solving the problem]
[0010] The worker safety education system of the first invention is a system used for safety education of workers at a work site, and comprises an image display unit that displays a confirmation image including a work site image that is an image of the work site, a control unit that controls the confirmation image displayed on the image display unit, and an input unit into which an inputter who has confirmed the confirmation image inputs warning information, wherein the control unit has a memory function that associates the warning information input from the input unit, information about the inputter who input the warning information, and the confirmation image displayed on the image display unit when the warning information was input, and stores them in a memory unit as training result information, and a confirmation image display function that displays the warning information together with the confirmation image on the image display unit based on the training result information stored in the memory unit. The worker safety training system of the second invention is characterized in that, in the first invention, the input unit has a function that enables the inputter to input information of estimated hazard locations where unsafe behavior may occur in the confirmation image along with the warning information, the memory function of the control unit has a function to associate and store the information of the estimated hazard locations with the training result information, or to include the information of the estimated hazard locations in the training result information and store it, and the confirmation image display function of the control unit has a function to display the warning information at the estimated hazard location or in the vicinity of the estimated hazard location in the confirmation image when the warning information is displayed on the image display unit together with the confirmation image based on the training result information. The worker safety training system of the third invention is characterized in that, in the first invention, the input unit has a voice input function and a selection function for selecting the warning information displayed on the image display unit by the confirmation image display function of the control unit, and the control unit has a voice storage function for storing, when the warning information is selected by the selection function of the input unit, the voice input by the voice input function of the input unit in association with the selected warning information and information about the selector who selected the warning information. The worker safety training system of the fourth invention is characterized in that, in the first invention, the inputters are workers who perform work at the work site of the work site image and a work manager who manages the work in the work site image, and the confirmation image display function of the control unit has a function of displaying both the worker warning information and the work manager warning information on the image display unit simultaneously with the confirmation image to which they are associated when worker warning information, which is warning information input by the worker, and work manager warning information, which is warning information input by the work manager, are stored in association with the same confirmation image. The worker safety education system of the fifth invention is, in the first invention, characterized in that it comprises an image display device having a display unit that is worn by a worker and displays an image that the worker can see, and an experience facility simulating a work site where the worker wearing the image display device experiences work, wherein the image display device has an imaging function that images an area that can be seen by the worker, and the control unit has a detector that detects the movement of the worker wearing the image display device, and a training image control function that displays an MR image on the display unit of the image display device based on a signal from the detector, an image of the experience facility captured by the imaging function, and a BIM model which is an image of the work site that is the basis of the experience facility formed by a BIM system, and the confirmation image display function has a function of displaying the MR image on the image display unit as the confirmation image together with the warning information. The worker safety training system of the 6th invention is characterized in that, in the 5th invention, the experience equipment is equipped with work-related objects which are objects related to the work performed by workers at the work site which is the source of the experience equipment, and objects among the work-related objects which are fixed to the experience equipment are provided with alignment marks which are used to align the BIM model with the captured image. The seventh invention is a worker safety training system in accordance with the first invention, which has an image display device having a display unit that is worn by a worker and displays an image that the worker can see, and the control unit has a training image control function that causes a VR image to be displayed on the display unit of the image display device based on a BIM model of a work site where the worker will be experiencing work, which is formed by a BIM system, and the confirmation image display function has a function that causes the VR image to be displayed on the image display unit as the confirmation image together with the warning information. The worker safety training system of the 8th invention is, in the 1st, 2nd, 3rd or 4th invention, characterized in that the input unit has an unsafe behavior table displaying a plurality of unsafe behaviors anticipated in the confirmation image, the input unit has a selection input function for the inputter to select an unsafe behavior from the unsafe behavior table, and the control unit has an evaluation function for evaluating the inputter using information about the inputter, information about the unsafe behavior input by the inputter, and the confirmation image. Effect of the Invention
[0011] According to the first invention, when a worker receiving training inputs warning information as an inputter, a confirmation image is displayed together with the warning information, so that a work manager or the like can understand what situation the worker has judged to be unsafe behavior. According to the second aspect of the present invention, the work manager or the like can deepen his / her understanding of what situation caused the worker to judge the behavior to be unsafe. According to the third aspect of the present invention, a situation that a worker judges to be an unsafe behavior can be input by voice, which can deepen the work manager's understanding of the unsafe behavior of the worker. Also, if the comments of the work manager are input by voice, when the worker checks the confirmation image together with the warning information, it becomes easier for the worker to understand the thoughts of the work manager, which can deepen the worker's understanding of the unsafe behavior. According to the fourth invention, when a worker checks the confirmation image together with the warning information, the worker can easily recognize the similarities and differences between unsafe behaviors as perceived by the work manager etc. and unsafe behaviors as perceived by the worker himself / herself, thereby enabling the worker to further deepen his / her understanding of unsafe behaviors. According to the fifth to seventh inventions, a worker can have a simulated experience of working at an actual work site, and images from the simulated experience are used as confirmation images to input warning information, making it easier for workers to understand unsafe behavior at the work site. According to the eighth aspect of the present invention, an evaluation of each worker's awareness and understanding of unsafe behavior is presented, so that each worker's awareness of unsafe behavior can be objectively grasped, making it easier to provide on-site training tailored to each worker. [Brief description of the drawings]
[0012] [Figure 1] 1 is a schematic block diagram of a safety training system 1 for workers according to the present embodiment. [Diagram 2] 1A and 1B are diagrams showing an example of a BIM model, and 1C and 1D are diagrams showing an example of an experience facility 30. [Diagram 3] (A) to (C) are diagrams showing an example of the experience work situation, and (D) to (F) are diagrams showing an example of VR images. [Figure 4] 4 is a flowchart of an experience work performed by the safety training system 1 for workers according to the present embodiment. [Diagram 5] 13 is a flowchart for inputting caution information using the experience image display function 13. [Figure 6] 13 is a flowchart for confirming an experience image using confirmation image display function 14. [Figure 7] (A) is a diagram showing an example of a tag used as warning information, (B) is a diagram showing an example of an image in which a worker tag is superimposed on an experience image, and (C) is a diagram showing an example of an image in which a worker tag and a work manager tag are superimposed on an experience image. [Figure 8] 13 is a diagram showing an example of an evaluation graph created by the evaluation function 16. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] The worker safety education system of this embodiment is a system used to provide safety education to workers who perform work at work sites and the like, and is used to deepen the workers' awareness and understanding of unsafe behavior.
[0014] The timing and location of safety education by the worker safety education system of this embodiment are not particularly limited. For example, it can be used for education (so-called off-site education) to make workers understand the work to be done at the work site before starting work at the work site, and for education (so-called on-site education) to make workers understand the work to be done on the day after work starts at the actual work site. In addition to off-site education and on-site education, it can be used for safety education in regular in-house study meetings and training sessions held by construction industry associations, etc.
[0015] The work for which safety education is provided using the worker safety education system of this embodiment is not particularly limited, and the system can be adopted for safety education of various works performed at work sites, etc. For example, the worker safety education system of this embodiment can be used for safety education in various works such as work for installing plasterboard on the walls and ceilings of a work site (plasterboard installation work), high-altitude work such as ceiling construction, and material transportation and delivery work such as iron pipes and steel frames.
[0016] In the following description, as a representative example, a case will be described in which safety training for plasterboard installation work is carried out using the worker safety training system of this embodiment.
[0017] <Worker Safety Training System 1 of the Present Embodiment> 1, the safety education system 1 for workers of this embodiment includes an image display unit 2 that displays images to be checked by workers or work managers, an input unit 3 that inputs caution information and the like described below, an image display device 5 worn by a worker or the like experiencing the safety education, and a control unit 10 that controls the operation of the image display unit 2, the input unit 3, and the image display device 5. The safety education system 1 for workers of this embodiment also includes an experience facility 30 that is a facility where workers or the like experience the safety education.
[0018] <Control unit 10> 1, the control unit 10 is connected by wire or wirelessly to the image display unit 2, the input unit 3, and the image display device 5 so as to be able to transmit and receive signals therebetween. The control unit 10 has a training image control function 11 that controls images (such as a confirmation image or caution information) to be displayed on the image display unit 2 and images to be displayed on the display unit 5a of the image display device 5 during the experience work. For example, the control unit 10 has the training image control function 11 that controls which images are to be displayed on the image display unit 2 and the display unit 5a of the image display device 5 and at what timing.
[0019] The training image control function 11 of the control unit 10 has a function of generating an MR (Mixed Reality) image or a VR (Virtual Reality) image as an image to be displayed on the display unit 5a. Specifically, the control unit 10 has a function of generating a VR image or an MR image based on information of a 3D model (hereinafter referred to as a BIM model, see Figs. 2(A) and (B)) created by software (referred to as a BIM system in this specification) that realizes Building Information Modeling (BIM). For example, in the case of a VR image, a BIM model of a work site can be used as a VR image as it is, or a VR image can be created by adding modifications to the BIM model, such as information on the three-dimensional shape and structure of a target structure, such as holes and protrusions (shape information), and information on letters and numbers of members or parts (attribute information). In addition, in the case of an MR image, an MR image can be created by superimposing the BIM model and an image (captured image) captured by the capture function of the image display device 5 described below, or an MR image can be created by superimposing the BIM model and / or the captured image with modifications such as shape information and attribute information.
[0020] If the image (3D model) from which the training image control function 11 of the control unit 10 generates the VR image or MR image is an image created by a BIM system, the VR image or MR image viewed by the worker can reproduce a situation that is almost equivalent to the actual work site where the work experience is carried out. However, the image (3D model) from which the VR image or MR image is generated does not necessarily have to be an image created by a BIM system. It is sufficient that the image can reproduce a situation close to the actual work site when the training image control function 11 of the control unit 10 generates the VR image or MR image.
[0021] <Memory Function 15> In addition, the control unit 10 has a memory function 15 that associates the images displayed on the image display unit 2 and the images displayed on the display unit 5a of the image display device 5 with information input from the input unit 3 (warning information, information on estimated dangerous locations, etc.) and stores them in the memory unit 20.
[0022] For example, when an experiential work such as that described below is performed, the memory function 15 has a function of storing in the memory unit 20, in association with each other, the worker who performed the work experience, the date on which the work experience was performed (experience date), the image displayed on the image display unit 2 during the work experience, and the image displayed on the display unit 5a of the image display device 5.
[0023] In addition, when information is input from the input unit 3 while the experience image display function 13 of the display function 12 described later is displaying an image (experience image) of a worker performing a work experience on the image display unit 2, the memory function 15 has the function of associating the experience image with the information input from the input unit 3 and storing them in the memory unit 20.
[0024] The storage function 15 also has a function of providing stored information based on commands from other functions or devices. For example, when a command to specify an experience image and read out stored information is supplied to the storage function 15 from the experience image display function 13 or the confirmation image display function 14 of the display function 12, the storage function 15 has a function of providing the specified experience image and information stored in association with the experience image to the experience image display function 13 or the confirmation image display function 14 of the display function 12. Specifically, when information such as the name and ID of a worker and the date on which the experience task was performed is provided from the experience image display function 13 or the confirmation image display function 14 of the display function 12, the storage function 15 has a function of providing an image and information of the corresponding experience task to the experience image display function 13 or the confirmation image display function 14 of the display function 12.
[0025] <30 Experience Facilities> The experience facility 30 is a facility having a structure simulating a work site where a worker (hereinafter sometimes simply referred to as a worker) receiving safety training will be working or a work site where the worker is currently working. This experience facility 30 is a facility where a worker experiences work, and is a facility in which work-related objects, which are objects related to the work that the worker will perform at the work site, are arranged. For example, in the case of performing plasterboard installation work as shown in FIG. 3, a model of the base material of the wall on which the plasterboard is to be installed (see FIG. 2(C)), the plasterboard to be installed on the base material (see FIG. 2(D)), and tools such as an electric drill used to install the plasterboard on the base material are arranged as work-related objects in the experience facility 30.
[0026] Furthermore, the experience facility 30 is provided with a plurality of sensors 31 for detecting the position of the worker. The plurality of sensors 31 have a function of detecting the worker. When a signal from the sensor is transmitted to the training image control function 11 of the control unit 10, the training image control function 11 can analyze the signal from the sensor and grasp the current position of the worker in the experience facility 30, whether the worker has moved, the direction of the worker's movement, and the like (hereinafter, these may be collectively referred to as the "state of the worker"). Therefore, the training image control function 11 can create a VR image or an MR image that matches the state of the worker. As such a sensor, an infrared sensor, an ultrasonic sensor, a camera sensor, or the like can be adopted, but it is not particularly limited as long as it is a sensor that can achieve the above purpose.
[0027] In the case of the plasterboard installation work described above, the model of the base material is installed in a fixed state (so that it does not move even when the plasterboard installation work is performed) in the experience equipment 30. On the other hand, the plasterboard and tools are arranged in a state where the worker can pick them up and carry them, and fix the plasterboard to the model of the base material.
[0028] Furthermore, when the plasterboard installation work involves installing plasterboard at a high position or on the ceiling, standing horses, mobile scaffolding, and frame scaffolding on which workers stand to work are either fixed to the experience equipment 30 (so that they will not move even when the plasterboard installation work is being performed) or set up in a movable state (see Figures 3(A) to (C)).
[0029] In addition, the work-related items that are installed in a fixed state on the experience equipment 30 may be suitable for the work that the worker will experience, and the work-related items that are movably placed on the experience equipment 30 may be tools, etc. that are suitable for the work that the worker will experience.
[0030] <Image display device 5> The image display device 5 is worn by a worker when experiencing work in the experience facility 30. This image display device 5 has a display unit 5a that displays an image that allows the wearing worker to visually recognize the image. More specifically, the image display device 5 has the display unit 5a that is placed in front of the worker's eyes when the worker wears the image display device 5, and allows the worker to visually recognize the image (MR image or VR image) displayed on the display unit 5a. This image display device 5 has a function of detecting the face direction of the wearing worker, a function of detecting the line of sight, etc.
[0031] When the MR image is displayed on the display unit 5a, the image display device 5 has a photographing function for photographing an image (e.g., an image of the experience facility 30) required for the control unit 10 to form an MR image. More specifically, the image display device 5 has a photographing function for photographing an area visible to the worker when the worker is not wearing the image display device 5. For example, a general head-mounted display having a stereo camera that photographs the area in front of the image display device 5 can be used as the image display device 5.
[0032] The image display device 5 is not particularly limited as long as it can be worn by the worker and has the above-mentioned functions, and may be a head-mounted display as described above.
[0033] Furthermore, the image display device 5 may have a function to detect the movement, change in posture, and movement of the hand, etc., of the worker, in addition to the function to detect the direction of the worker's face and the line of sight, etc. In this case, it may not be necessary to provide the sensor 31 in the above-mentioned experience facility 30, and even if the sensor 31 is provided, the number of sensors may be reduced. When detecting the movement, change in posture, and movement of the hand, etc., of the worker, the image display device 5 may be provided with a sensor to detect these movements to detect the movement, etc., of the worker, or the control unit 10 may analyze the image of the hand, etc. in the image captured by the image display device 5 to detect these movements. Of course, the movement, etc. of the worker may be detected using both the sensor and image analysis.
[0034] Moreover, the image display device 5 does not necessarily have to have a function for detecting the face direction of the worker wearing the image display device 5 or a function for detecting the line of sight of the worker, and may be capable of allowing the worker to visually recognize the image (MR image or VR image described later) displayed on the display unit 5a. If the image display device 5 does not have a function for detecting the face direction of the worker wearing the image display device 5, a sensor or the like for detecting the face direction of the worker may be attached to the image display device 5 or the head of the worker to detect the face direction of the worker. Furthermore, although the function for detecting the line of sight of the worker is not necessarily provided, it is preferable that the image displayed on the display unit 5a be a more appropriate image, and the state of the worker, such as whether the worker is visually checking for safety, can be grasped more accurately, and the information can be used for appropriate guidance by the safety manager.
[0035] <Image display section 2> The image display unit 2 is a general display device and can display an image supplied from the control unit 10. The image display unit 2 may be any device capable of displaying an image supplied from the control unit 10. For example, if the control unit 10 has a display like a notebook computer, the display of the control unit 10 can be used as the image display unit 2. Even if the control unit 10 has a display, a display device (separate display device) provided separately from the display of the control unit 10 may be used as the image display unit 2. A plurality of image display units 2 may be provided. In this case, both the display of the control unit 10 and the separate display device may be used as the image display unit 2, or a plurality of separate display devices may be provided and only the separate display devices may be used as the image display unit 2.
[0036] <Input section 3> The input unit 3 has a function of inputting various information and a function of supplying the input information to the control unit 10. For example, the input unit 3 has a function of inputting information of a worker who is undergoing a work experience by the worker safety education system 1 of this embodiment and information of a person supervising the work experience of the worker (such as a work manager who monitors the status of the work experience) and supplies the input information to the control unit 10. The input unit 3 also has a function of inputting caution information and information of estimated dangerous places, which will be described later. As described above, the information input from the input unit 3 is transmitted to the control unit 10, and is stored in the storage unit 20 by the storage function of the control unit 10 in association with the image displayed on the image display unit 2 and the image displayed on the display unit 5a of the image display device 5.
[0037] The input unit 3 may be, for example, a keyboard, a mouse, a touch panel, etc., but is not particularly limited as long as it allows the worker or the work manager to input predetermined information. If voice input is performed as described below, the input unit 3 may be a device capable of voice input (for example, a microphone or a device with a built-in microphone) in addition to a keyboard, etc.
[0038] <Work experience using the safety education system 1 of this embodiment> Since the safety training system 1 for workers in this embodiment has the above-mentioned configuration, it is possible to allow workers to carry out work experience as follows (see FIG. 4). In the following, a case where an MR image is displayed on the display unit 5a of the image display device 5 will be described.
[0039] First, information about the worker who will be performing the work experience and information about the work manager of the worker who will be performing the work experience are input from the input unit 3. After input of the predetermined information is completed, the image display device 5 is attached to the worker who will be performing the work experience.
[0040] Next, the display position of the BIM model in the MR image is adjusted so that the captured image of the experience facility 30 captured by the imaging function of the image display device 5 matches the BIM model in the MR image. For example, if the experience facility 30 is a facility for experiencing the work of laying plasterboard on the base material of a wall, the display position of the BIM model in the MR image is adjusted so that the model of the base material of the experience facility 30 in the captured image matches the base material of the BIM model.
[0041] Incidentally, this adjustment of the display position may be performed automatically by the control unit 10 when the photographing function of the image display device 5 photographs a model of the base material of the experience facility 30, or may be adjusted by a person while checking the MR image.
[0042] Furthermore, if an alignment mark for alignment is provided on the model of the base material of the experience facility 30, the control unit 10 can easily and automatically adjust the position. For example, if a QR code (registered trademark) is used as the alignment mark and information such as coordinate values in the three-dimensional space represented in the BIM model (coordinate values in the three-dimensional space of the position where the QR code (registered trademark) is provided) is included in the QR code (registered trademark), the control unit 10 can adjust the position by simply photographing the QR code (registered trademark) using the photographing function of the image display device 5.
[0043] When the control unit 10 finishes adjusting the position, a command to start work is input from the input unit 3, and the storage unit 20 also starts storing the MR image displayed on the display unit 5a of the image display device 5. Then, the worker performs the plasterboard installation work based on the MR image displayed on the display unit 5a of the image display device 5 (see Figs. 3(A) to (C)). At this time, both or either one of the MR image displayed on the display unit 5a of the image display device 5 and the BIM model of the work site used to form the MR image (i.e., the BIM model of the work site including areas other than those visible by the worker) are displayed on the image display unit 2. Therefore, the work manager or the like can check the viewpoint of the worker experiencing the work and the overall situation of the work site.
[0044] When the series of tasks is completed, a command to end the tasks is input from the input unit 3, and the experience task ends. Then, the control unit 10 stops displaying the MR images on the display unit 5a of the image display device 5 and stops storing the MR images in the storage unit 20.
[0045] As described above, by using the worker safety education system 1 of this embodiment, the worker can carry out actual plasterboard installation work while viewing MR images that reproduce an actual work site, so that the worker can experience work similar to that performed at an actual work site. This can make the worker aware of things to be careful of at an actual work site and raise the worker's awareness of unsafe behavior.
[0046] For example, in an actual work site, there may be a through hole in the floor and the worker must move around while avoiding the through hole. When experiencing work at such a work site, the MR image reproduces a state almost identical to that of the actual work site, so even if the experience equipment 30 has a floor without a through hole, the through hole is displayed in the MR image (see h in FIG. 2(B)). Therefore, the worker can experience moving around the work site while recognizing the presence of the through hole. Moreover, since the worker can be made aware of the presence of the through hole in the actual work site, it is more effective in preventing accidents such as falling without noticing the through hole when working at the actual work site. In addition, if a warning sound or the like is issued when the foot is placed at the position of the through hole, the worker can be made more aware of the presence of the through hole, and the effect of preventing accidents can be further improved.
[0047] <When VR images are displayed on the display unit 5a of the image display device 5> In the above example, a case where an MR image is displayed on the display unit 5a of the image display device 5 has been described. However, when a VR image (see Figs. 3(D) to (F)) is displayed on the display unit 5a of the image display device 5, the experience facility 30 as described above does not need to be provided. On the other hand, in this case, the worker needs to grasp and operate the plasterboard, tools, etc. displayed as the VR image with the worker's hands displayed in the VR image. In this case, the positions of the worker's hands and the plasterboard, tools, etc. in the VR image need to be aligned and displayed in the VR image, so that a sensor (for example, a glove-shaped sensor, etc.) that detects the position and movement of the worker's hands needs to be worn in order to detect the worker's hands.
[0048] <Safety confirmation training by the worker safety training system 1 of this embodiment> As described above, by carrying out a work experience using the safety education system 1 for workers of this embodiment, it is possible to make the worker aware of the situation at the work site, dangerous actions, etc. In order to further strengthen the worker's awareness, that is, to enhance the effectiveness of safety education, it is desirable for the worker to check the situation of his / her own work experience after carrying out the work experience and to consider by himself / herself or together with the work manager whether or not there was any unsafe behavior in the work.
[0049] Therefore, the safety education system 1 for workers in this embodiment has a function of making the worker who has undergone work experience check the situation of the experience work and consider whether or not there was any unsafe behavior.
[0050] <Display function 12> As shown in FIG. 1, the control unit 10 of the worker safety training system 1 of this embodiment has a display function 12 that causes the image display unit 2 to display a confirmation image or the like for confirming the work status of a worker who has completed the work experience.
[0051] The display function 12 has an experience image display function 13 which causes the image display unit 2 to display VR images or MR images (hereinafter simply referred to as experience images) of the worker performing the work experience, which are stored in the memory unit 20, and a confirmation image display function 14 which causes the image display unit 2 to display the experience image and warning information, etc. input from the input unit 3 when the experience image is displayed by the experience image display function 13.
[0052] <Experience image display function 13> The experience image display function 13 has a display function 13a which selects an experience image to be displayed on the image display unit 2 based on information input from the input unit 3 and displays the experience image on the image display unit 2, and an information storage function 13b which, while the experience image is being displayed, associates the information input from the input unit 3 with the displayed experience image and stores them in the storage unit 20.
[0053] Display function 13a has a function of transmitting an image request command including selection information to storage function 15 based on experience work information (such as the worker's name and the date of the experience work, hereinafter sometimes simply referred to as selection information) input from input unit 3. Then, when an experience image or information stored in association with the experience image (hereinafter sometimes simply referred to as experience image information, including both) is provided from storage function 15 based on the image request command, display function 13a has a function of continuously displaying a plurality of images (frames) included in the experience image included in the provided experience image information on image display unit 2. The experience images are MR images or VR images that were displayed on display unit 5a of image display device 5 when the worker was performing the experience work (see Figs. 3(D) to (F)), and display function 13a causes image display unit 2 to continuously display the selected experience images.
[0054] In the following, successively displaying a plurality of images (frames) included in the experience image may simply be referred to as "successively displaying the experience images."
[0055] When warning information is input from input unit 3 while an experience image is being displayed by display function 13a, information storage function 13b has a function of adding the input warning information to experience image information and supplying it to storage function 15 as training result information. More specifically, information storage function 13b has a function of associating an image (frame) at the timing when the warning information is input from input unit 3, information about the person who input the warning information, and the input warning information in the experience image with each other, and adding the associated information to the experience image information and supplying it to storage function 15 as training result information.
[0056] The warning information is information that specifies the unsafe behavior recognized when the worker judges that the worker has performed an unsafe behavior or that an unsafe behavior may occur when the worker checks the experience image. The method of inputting the warning information and the format of inputting the warning information are not particularly limited. The warning information may be freely written in text format, or the inputter may select warning information corresponding to the unsafe behavior recognized by the inputter from predetermined words, symbols, marks, etc. (hereinafter, referred to as tags). For example, the input unit 3 may be provided with an unsafe behavior table having tags that display a plurality of unsafe behaviors assumed in the experience image (see FIG. 7(A)), and an appropriate tag may be selected from this unsafe behavior table and input as the warning information. In the case of FIG. 7(A), a drop tag, a toppling tag, and a collision tag are prepared as tags that display unsafe behaviors, so if the inputter selects and saves a tag corresponding to the unsafe behavior recognized by the inputter from these tags, the tag information is associated with the image (frame) in which the tag is saved and stored in the training result information.
[0057] The information storage function 13b also has a function of allowing the worker to input information on an estimated dangerous place where unsafe behavior may occur when inputting caution information. Specifically, after inputting caution information by the input unit 3 or before inputting caution information, the information storage function 13b has a function of selecting the estimated dangerous place or its vicinity in the experience image with a mouse or the like to specify the estimated dangerous place. The information storage function 13b has a function of adding the input information on the estimated dangerous place to the training result information and supplying it to the storage function 15. When the above-mentioned tag is prepared, the information storage function 13b may have a function of inputting information on the estimated dangerous place by arranging an image of the selected tag at the estimated dangerous place.
[0058] The information storage function 13b does not necessarily need to add the information on the estimated danger place to the training result information and supply it to the storage function 15. In this case, the information storage function 13b may supply the information on the estimated danger place to the storage function 15 in a state in which the information is associated with the corresponding caution information of the training result information (for example, information on the corresponding image (frame) of the experience image, etc.).
[0059] In addition, the information storage function 13b does not necessarily have to input information on the estimated dangerous places. However, if information on the estimated dangerous places is also input, the person who input the caution information can properly understand the behavior that he / she recognizes as unsafe behavior, and it becomes easier for the work manager to evaluate whether the person who input the caution information has properly understood the unsafe behavior.
[0060] <Confirmation image display function 14> Confirmation image display function 14 has a function of selecting training result information to be displayed on image display unit 2 based on information input from input unit 3, and displaying the experience image and warning information included in the training result information on image display unit 2. Specifically, confirmation image display function 14 has a function of successively displaying images (frames) of the experience image included in the training result information, and displaying the experience image and warning information simultaneously on image display unit 2 for an experience image for which warning information has been input.
[0061] In addition, when information on an estimated dangerous place is input in the training result information, it has a function of displaying caution information in the experience image at the position designated as the estimated dangerous place or in its vicinity, that is, displaying the experience image and caution information superimposed. For example, when tag information is included in the training result information as caution information, it has a function of displaying a tag in the vicinity of the position (estimated dangerous place) where an unsafe behavior occurred (or is estimated) in an image where the unsafe behavior occurred (or is estimated), as shown in Fig. 7(B).
[0062] <Example of safety confirmation training by the worker safety training system 1 of this embodiment> A method of safety confirmation training using the safety training system 1 for workers of this embodiment will be described.
[0063] First, the input of caution information in the safety confirmation training will be described (see FIG. 5).
[0064] The experience image display function 13 of the display function 12 of the control unit 10 is operated to select the work experience for which safety confirmation training is to be carried out. Specifically, selection information such as the name of the worker who carried out the experience work and the date the experience work was carried out is input from the input unit 13. Note that if the experience work is carried out multiple times by multiple workers and an ID is set for each experience work, the ID may be input from the input unit 13.
[0065] When the selection information is input, experience image display function 13 of display function 12 transmits an image request command based on the selection information to storage function 15. Then, storage function 15 reads out experience image information corresponding to the selection information from storage unit 20 and supplies the experience image information to experience image display function 13.
[0066] When the experience image information is supplied, display function 13a of experience image display function 13 causes the experience images to be continuously displayed on image display unit 2. The timing to start displaying the experience images may be determined by an inputter such as an operator who checks the experience images by operating input unit 13, or the display of the experience images may be automatically started after a certain period of time has elapsed since selection information was input.
[0067] When a worker checking the experience image displayed on the image display unit 2 judges that an unsafe behavior has occurred or that there is a possibility that an unsafe behavior may occur, the worker inputs caution information (worker caution information) from the input unit 3. At this time, the display of the experience image is temporarily stopped at the state of the image where it is judged that an unsafe behavior has occurred or that there is a possibility that an unsafe behavior may occur, and the caution information is input. For example, when an unsafe behavior table is provided, a tag corresponding to the unsafe behavior recognized by the worker is selected from the unsafe behavior table, and the tag is placed at an estimated hazard location where there is a possibility that an unsafe behavior may occur. Then, the information storage function 13b stores the experience image displayed in the temporarily stopped state in association with the caution information.
[0068] When the display of the experience image is finished, information storage function 13b supplies training result information in which the warning information has been added to the experience image information to storage function 15. Then, storage function 15 stores the training result information supplied from information storage function 13b in storage unit 20 in association with the experience image information that is the source of the training result information.
[0069] The work manager also checks the experience image of the same work experience in the same way. Then, the training result information of the same experience image also includes the worker manager caution information entered by the work manager.
[0070] Next, the confirmation of the experience work of the worker in the safety confirmation training will be explained (see FIG. 6).
[0071] When the training result information including the worker attention information is formed, the confirmation image display function 14 of the display function 12 is operated to select the training result information to be confirmed. The method of selecting the training result information can be the same as that of the experience image display function 13.
[0072] When the selection information is input, the confirmation image display function 14 of the display function 12 transmits an image request command based on the selection information to the storage function 15. The storage function 15 then reads out the training result information corresponding to the selection information from the storage unit 20 and supplies the training result information to the confirmation image display function 14.
[0073] When the training result information is supplied, the confirmation image display function 14 continuously displays the experience images included in the training result information on the image display unit 2. Note that, similar to the experience image display function 13, the timing to start displaying the experience images may be determined by an inputter such as an operator who confirms the experience images by operating the input unit 13, or the display of the experience images may be automatically started a certain time after the selection information is input.
[0074] The confirmation image display function 14 continuously displays experience images, but when it comes to an image for which either the worker caution information or the worker manager caution information has been input, it pauses on that experience image and displays the experience image and the caution information simultaneously on the image display unit 2. For example, when a tag selected from the unsafe action table is placed at an estimated hazard location and caution information is input, the selected tag is displayed superimposed on the location where the tag was placed in the experience image (see FIG. 7(B)). Note that when the tag placed by the worker and the tag placed by the worker manager are placed at the same location in the same experience image, or when placing the tag would hide important information in the experience image, the tag is placed near the estimated hazard location (see FIG. 7(C)).
[0075] Here, if the tags placed by the worker and the worker manager are placed in the same position in the same experience image (see Fig. 7(C)), it can be evaluated that the worker is able to properly recognize unsafe behavior. In other words, when the worker who performed the work experience checks this experience image, he or she can confirm that his or her recognition was correct, and when the work manager checks this image, it can be evaluated that the worker is able to properly recognize unsafe behavior.
[0076] On the other hand, if the worker does not place a tag on the experience image where the worker manager has placed the tag, or if the worker places a tag but the type of tag is different from that placed by the worker manager, or if the same tag is placed in the wrong position, it can be evaluated that the worker does not recognize the unsafe behavior. In other words, if the worker who performed the work experience checks this experience image, he or she can understand that he or she does not recognize the unsafe behavior, and if the work manager checks this image, it can be evaluated that the worker does not recognize the unsafe behavior. In addition, since the worker can check the experience image where the worker manager has placed the tag, the type of tag, the placement position of the tag, etc., he or she can deepen his or her awareness of the unsafe behavior. If the work manager checks this image, he or she can understand the worker's awareness of the unsafe behavior, and there is a possibility that he or she can discover the unsafe behavior that the worker manager himself or herself has not recognized.
[0077] As described above, by carrying out safety confirmation education using the worker safety education system 1 of this embodiment, the worker's understanding of unsafe behavior can be deepened, and the worker and the worker manager can appropriately evaluate the worker's unsafe behavior. In particular, the worker can use the image of the work site where he or she is about to perform to check the experience image of the experience work he or she performed himself or herself to understand the unsafe behavior, so that the effect of suppressing the occurrence of unsafe behavior at the work site, that is, the effect of safety education for the worker can be improved.
[0078] In particular, if the worker who performed the trial work and the manager who entered the worker manager warning information for the trial work review the trial images together, the worker can ask questions about the difference between the worker warning information and the worker manager warning information, and the worker manager can explain it, thereby deepening the worker's awareness of unsafe behavior.
[0079] <About confirmation image display function 14> In the above example, the confirmation image display function 14 has been described as pausing the display of an experience image in which caution information has been input, but the experience image may be continuously displayed even in cases where caution information has been input. However, it is preferable to display the experience image in which an unsafe behavior has occurred (or is estimated) as a still image, since this allows the state of the unsafe behavior and the caution information to be clearly recognized. Of course, when displaying experience images continuously even in cases where caution information has been input, the image can be made to be paused when a pause command is input from the input unit 3.
[0080] When the confirmation image display function 14 displays the experience image on the image display unit 2, the confirmation image display function 14 may always display the worker caution information and the worker manager caution information together with the experience image (see FIG. 7(C)). In addition, when a display command is received from the input unit 13, if caution information is input to the experience image to which the command is input, the caution information may be displayed together with the experience image, and if the caution information is not input, nothing may be displayed (the experience image may remain displayed), or a mark indicating an error may be displayed. In this way, when the experience image is confirmed, the effect of the worker considering the occurrence of an unsafe action each time and increasing awareness of the unsafe action can be obtained. For example, when the worker confirms the experience image displayed by the confirmation image display function 14 and recognizes the existence of an unsafe action, a display command may be input, and if the caution information is displayed, it can be confirmed that the awareness of the unsafe action is stable. In addition, if the caution information is not displayed, it can be confirmed that the awareness of the unsafe action is not stable. Furthermore, if the worker caution information is not displayed but the worker manager caution information is displayed, it can be confirmed that the awareness of the unsafe action of the worker has improved.
[0081] Furthermore, when estimated danger place information has been input, the warning information may be displayed superimposed on the experience image at or near the estimated danger place, or may be displayed in a separate window, etc. When estimated danger place information has not been input, the warning information may be displayed superimposed on the experience image at a predetermined position, or may be displayed in a separate window, etc.
[0082] <Add information function> The confirmation image display function 14 may have an information adding function for adding information to the already inputted caution information. If such a function is provided, awareness of unsafe behavior can be further improved. For example, if the worker notices something when checking the experience image and the like is added to the caution information and stored, the change in the worker's awareness can be confirmed. In addition, if the worker and the work manager input the work manager's comments when checking the experience image together, the worker can reconfirm the work manager's comments when checking the experience image alone. In this way, even if the work manager is not present, the same educational effect can be obtained as when the experience image is checked together with the work manager. For example, if the work manager's comments include why the behavior is unsafe (the reason why it is considered to be unsafe) and what should have been done or should be done to avoid the unsafe behavior (methods to avoid the unsafe behavior), the worker's understanding of the unsafe behavior can be deepened. In addition, if additional information such as comments from workers about why they acted in that way (causes of unsafe behavior) and answers to questions about what they could have or should have done to avoid the unsafe behavior (methods to avoid unsafe behavior) is included as additional information, workers' awareness of unsafe behavior can be improved.
[0083] In this case, the method of adding information to the warning information may be to add information as text using a keyboard or the like, or to add information as audio information. For example, the input unit 13 is provided with an audio input function, and the confirmation image display function 14 is provided with a selection function 14a for selecting warning information. When warning information is selected by the selection function 14a, an audio storage function 14b is provided for storing the audio input by the audio input function of the input unit 13 in association with the selected warning information and information about the selector (i.e., the inputter) who selected the warning information. In this way, conversations, etc. regarding the warning information between the work manager and the worker who are checking the experience video can be stored, so that by checking the conversations, etc. later, when the worker checks the experience image alone, the worker can reconfirm the points made by the work manager. In this way, even if the work manager is not present, it is possible to obtain the same educational effect as when the experience image is checked together with the work manager. The audio storage function 14b may store the audio information as it is as additional information, or may convert the audio information into character information and store it.
[0084] <Evaluation function 16> The control unit 10 may have an evaluation function 16 that evaluates the worker based on the warning information included in the experience image. The experience video and the warning information are stored in the storage unit 20 in association with information on the worker who performed the experience work in the experience video and the worker who inputted the warning information. Therefore, by using the warning information and the information on the worker from the information on the experience video stored in the storage unit 20, it is possible to objectively judge each worker's awareness of unsafe behavior. If such a judgment is obtained, it is possible to provide safety education suitable for each worker in order to solve problems specific to each worker.
[0085] For example, if a worker is able to adequately predict and avoid falls and trips, but is unable to predict and avoid collisions, it can be determined that the worker has low attention to other workers working at the same time (see Figure 8(A)). In addition, if a worker is able to adequately predict and avoid falls but is unable to adequately predict and avoid toppling, it can be determined that the worker is sufficiently attentive to large obstacles, but not to small obstacles (see Figure 8(A)). Furthermore, even in the case of plasterboard installation work, if a worker is able to adequately foresee and avoid unsafe behavior in wall installation work but is unable to adequately foresee and avoid unsafe behavior in ceiling installation work, it can be determined that the worker is not good at ceiling installation work (see Figure 8 (B)).
[0086] The method of presenting such an evaluation is not particularly limited, but for example, if it is displayed as a table such as a graph as shown in FIG. 8, workers and work managers can easily understand the characteristics of the worker and also easily compare them with other workers.
[0087] Furthermore, in the case where the warning information contains voice information as described above, it is also possible to analyze words contained in the voice information and evaluate the characteristics of each worker.
[0088] <Another Example of Safety Confirmation Training by the Worker Safety Training System 1 of the Present Embodiment> In the above example, the case where the safety confirmation training was conducted based on images obtained when the worker who will be conducting the safety confirmation training experienced work was described, but the images (corresponding to the confirmation images in the claims) used in the safety confirmation training by the worker safety training system 1 of this embodiment are not necessarily limited to images obtained when the worker experienced work. For example, the above-mentioned safety confirmation training may be conducted using only a BIM model prepared in advance by a BIM system or the like. In this case, the worker safety training system 1 may not have the image display device 5 or the experience facility 30, and the control unit 10 may not have the training image control function 11 or the function of storing each piece of information obtained in the experience work in the memory function 15. In other words, the system configured with the control unit 10 having the display function 12 using the prepared BIM model, the experience image display function 13, and the memory function 15 not having the function of storing each piece of information obtained in the experience work, the image display unit 2, and the input unit 3 may be used as the worker safety training system 1 of this embodiment. [Industrial Applicability]
[0089] The worker safety training system of the present invention is suitable for use as a system for pre-work training at a work site or for on-the-job training at a work site. [Explanation of symbols]
[0090] 1. Safety training system 2 Image display section 3. Input section 5 Image display device 5a Display section 10 Control section 11 Training image control function 12 Display functions 13 Experience image display function 13a Display Function 13b Information storage function 14 Confirmation image display function 14a Selection Function 14b Voice memory function 15 Memory Function 16 Evaluation Function 20 Memory section 30 Experience Facilities 31 Sensors
Claims
1. A system used for safety training of workers at a work site, an image display unit that displays a confirmation image including a work site image that is an image of the work site; A control unit that controls a confirmation image to be displayed on the image display unit; an input unit in which a person who has confirmed the confirmation image inputs warning information, The control unit is a storage function for storing the warning information input from the input unit, information about the inputter who input the warning information, and the confirmation image displayed on the image display unit when the warning information is input in a storage unit as training result information in association with each other; and and a confirmation image display function for displaying the warning information together with the confirmation image on the image display unit based on the training result information stored in the storage unit. A safety training system for workers, comprising:
2. The input unit includes: The device has a function that enables the input person to input information on an estimated dangerous location where an unsafe behavior may occur in the confirmation image together with the warning information, The memory function of the control unit is The method has a function of storing the information on the estimated dangerous place in association with the training result information, or storing the information on the estimated dangerous place in the training result information, The confirmation image display function of the control unit is When the warning information is displayed on the image display unit together with the confirmation image based on the training result information, the warning information is displayed at the estimated danger location or in the vicinity of the estimated danger location in the confirmation image.
2. The safety education system for workers according to claim 1.
3. The input unit includes: Voice input function, a selection function for selecting the warning information displayed on the image display unit by a confirmation image display function of the control unit, The control unit is The input unit has a voice storage function for storing, when the warning information is selected by the selection function of the input unit, a voice input by the voice input function of the input unit in association with the selected warning information and information on the selector who selected the warning information.
2. The safety education system for workers according to claim 1.
4. The input person: a worker who performs work at a work site in the work site image and a work manager who manages the work in the work site image, The confirmation image display function of the control unit is When the worker attention information input by the worker and the work manager attention information input by the work manager are stored in association with the same confirmation image, the image display unit has a function of displaying both the worker attention information and the work manager attention information on the image display unit at the same time as the confirmation image to which they are associated.
2. The safety education system for workers according to claim 1.
5. an image display device having a display unit that is worn by a worker and displays an image to be visually recognized by the worker; and an experience facility simulating a work site where a worker wearing the image display device experiences work, The image display device, The apparatus has a photographing function for photographing an area visible to the operator, The control unit is a detector for detecting a movement of a worker wearing the image display device; and a training image control function for displaying an MR image on the display unit of the image display device based on a signal from the detector, an image of the experience facility captured by the imaging function, and a BIM model which is an image of a work site that is the basis of the experience facility formed by a BIM system. The confirmation image display function is The MR image is displayed on the image display unit as the confirmation image together with the warning information.
2. The safety education system for workers according to claim 1.
6. The experience facilities include: a work-related object, which is an object related to a work to be performed by a worker in a work site that is the basis of the experience facility, is arranged; Among the work-related objects, the objects fixed to the experience facility include: Alignment marks are provided for use in aligning the BIM model with the captured image.
6. The safety education system for workers according to claim 5.
7. The image display device has a display unit that is worn by a worker and displays an image to be visually recognized by the worker, The control unit is The BIM system has a training image control function for displaying a VR image on a display unit of the image display device based on a BIM model of a work site where a worker experiences work, the BIM model being formed by the BIM system; The confirmation image display function is The VR image is displayed on the image display unit as the confirmation image together with the warning information.
2. The safety education system for workers according to claim 1.
8. The input unit is an unsafe behavior table that displays a plurality of unsafe behaviors assumed in the confirmation image; The input user has a selection input function of selecting an unsafe behavior from the unsafe behavior table, The control unit is The system has an evaluation function for evaluating the person who inputs information by using the information on the person who inputs information, information on unsafe behavior input by the person who inputs information, and the confirmation image.
5. The safety education system for workers according to claim 1, 2, 3 or 4.
Citation Information
Patent Citations
Safety work support system
JP2007058669A
Head mounting type display device, control method of head mounting type display device, and work supporting system
JP2017142790A
Education support system, education support method, and education support program
JP2018128510A
Information processing device, information processing system, information processing method, and information processing program, recording medium, and teaching method
JP2020091475A
Work support system, work support method, and program
JP2020149138A
