Work training system and computer-readable recording medium

The virtual training system addresses the challenge of preparing workers for workplace emergencies by using a network-based architecture with VR and AR to simulate complex tasks, enhancing worker preparedness and adaptability through personalized and immersive training, and improving work efficiency and safety.

WO2025023361A1PCT designated stage expired Publication Date: 2025-01-30YOUL SYST INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2023/012063
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-27
Filing Date
2023-08-16
Publication Date
2025-01-30

AI Technical Summary

Technical Problem

Existing education systems lack effective methods for preparing workers to handle accidents and emergencies in a virtual environment before they enter the actual workplace, particularly in complex settings like thermal power plants, where traditional training may not adequately simulate real-world conditions or adapt to individual worker skills.

Method used

A network-based virtual training system that includes a client device and server architecture for storing, outputting, and evaluating 3D educational content, allowing workers to practice tasks in a virtual environment with real-time feedback and personalized training based on their skills and physical conditions, using VR and AR technologies to simulate workplace scenarios and tools.

Benefits of technology

Enhances worker preparedness and adaptability by providing immersive, skill-specific training that improves work efficiency and safety through simulated practice, enabling simultaneous training of multiple workers across different locations and improving the effectiveness of education through AI-driven performance evaluation and guidance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2023012063_30012025_PF_FP_ABST
    Figure KR2023012063_30012025_PF_FP_ABST
Patent Text Reader

Abstract

The objective of the present invention is to pre-train a worker in a virtual space before being deployed to a work site and to improve the ability of the worker to deal with accidents that occur during work. More specifically, the present invention comprises, in a time-series manner: a storage step (S100) of storing work training materials (101) in a server (10); an output step (S200) of outputting the work training materials to a trainee (20) after the storage step; an input step (S300) of receiving, during the output step, training actions (201) of the trainee (20) from the server (10); and an evaluation step (S400) of evaluating work results (202) of the worker after the output step (S200) and the input step (S300).
Need to check novelty before this filing date? Find Prior Art

Description

Work training system and computer-readable recording medium

[0001] The present invention relates to a training system that provides preliminary training to workers in a virtual space before they are deployed to a work site and improves their ability to respond to accidents that occur during work.

[0002]

[0003] Patent inventions 001 to 002 are technically related to the present invention, and Patent invention 001 is an invention regarding an immersive network virtual training system that enables recognition of individual virtual training spaces of multiple trainees through multiple connections and collective and organized collaborative training in a shared virtual workspace, and Patent invention 002 is an invention regarding a network virtual training processing device constituting a client system. The present invention, Patent inventions 001 and 002, have technical relevance to task management in a virtual environment.

[0004] The present invention, patent inventions 001 and 002, has technical relevance to task management in a virtual environment.

[0005] (Patent Document 0001) KR 10-1839113 B1 (Registration Date: March 9, 2018)

[0006] (Patent Document 0002) KR 10-1671320 B1 (Registration Date: October 26, 2016)

[0007]

[0008] The purpose of this invention is to provide workers with preliminary training in a virtual space before they are deployed to a work site and to improve their ability to respond to accidents that occur during work.

[0009]

[0010] The present invention relates to a work training system, and specifically, it is composed of a storage step (S100) of storing work training material (101) in a server (10); an output step (S200) of outputting work training material to a trainee (20) after the storage step; an input step (S300) of inputting training actions (201) of the trainee to the server during the output step; an evaluation step (S400) of evaluating the worker's work results (202) after the output step and the input step; in a time-series manner.

[0011] The present invention relates to a work training system, and in the invention presented above, the work training material is formed as 3D data of power plant equipment (11) and is comprised of time-series steps. The present invention relates to a work training system, and in the invention presented above, the work training material is formed as 3D data of power plant equipment (11) and is comprised of time-series steps including an authentication step (S900) for authenticating a trainee to a server before the storage step.

[0012] The present invention relates to a work training system, and in the invention presented above, the work training material is composed of time-series steps including a first storage step (S110) of storing a plurality of work site data (401) as codes in the storage step; a second storage step (S120) of storing a plurality of event data (402) as codes after the first storage step; and a third storage step (S130) of storing guidance data (403) and / or warning data (404) as codes after the first storage step. The present invention relates to a work training system, and in the invention presented above, the output step is composed of time-series steps including an output step (S210) of outputting a screen (31).

[0013] The present invention relates to a work training system, and in the invention presented above, in the input step, the work action is composed of time-series steps including a first input step (S310) for receiving motion information (601); and a second input step (S320) for receiving the operation of an actuator (40). The present invention relates to a work training system, and in the invention presented above, the evaluation step is composed of time-series steps including a performance judgment step (S410) for evaluating the performance of the trainee; and a completion rate judgment step (S420) for evaluating the degree of completion of the work.

[0014] The present invention relates to a program for implementing a work training system, and is a recording medium recording a computer-readable program featuring the work training system presented above.

[0015]

[0016] The present invention relates to a training system for workers performing work such as power plant maintenance (repair, replacement), and has the effect of improving work efficiency by allowing workers to receive prior training through a virtual space.

[0017] The present invention has the effect of allowing multiple workers to perform simultaneous training in a single virtual space through their own simulators.

[0018] The present invention can improve the practical effect by allowing workers to learn work training through guidance and warnings during the training process.

[0019] The present invention improves work programs using artificial intelligence, and utilizes work results for multiple workers as big data.

[0020]

[0021] Figure 1 is a flow chart of the work training system of the present invention.

[0022] Figure 2 is a conceptual diagram of the work training of the present invention.

[0023]

[0024] Hereinafter, the most preferred embodiments of the present invention will be described in detail to enable those skilled in the art to easily practice the present invention. Reference numbers in the examples are not limited to the designated numbers and may be used in any number. The configurations presented in the examples can be expanded to achieve the same purpose and effect. Sub-concepts of the configurations presented in the examples can be considered inherent even if not explicitly described.

[0025]

[0026] [Example 1-1] The present invention relates to a work training system, and specifically, it is composed of time-series steps including a storage step (S100) of storing work training materials (101) in a server (10); an output step (S200) of outputting work training materials to a trainee (20) after the storage step; an input step (S300) of inputting the training actions (201) of the trainee to the server during the output step; and an evaluation step (S400) of evaluating the work results (202) of the worker after the output step and the input step.

[0027] [Example 1-2] The present invention is an invention for a work training system, and in Example 1-1, the output step and the input step are performed simultaneously for a plurality of trainees.

[0028] [Example 1-3] The present invention is an invention for a work training system, and in Example 1-1, the output step and the input step are performed simultaneously in real time.

[0029] The present invention [Examples 1-1 to 1-3] is an invention for a work training system.

[0030] The present invention is intended to provide training to workers (trainees) working at thermal power plants, etc., and to enable workers to acquire the work environment, work sequence, and work situation through preliminary training and virtual practice in a virtual space, and to improve their on-site adaptability to emergency situations that may arise during work in particular.

[0031] To implement this, the system consists of a storage stage, an output stage, an input stage, and an evaluation stage. The storage stage builds the work environment as 3D data on the server, and training materials are displayed on the VR device worn by the worker. The worker performs the task using work tools in the virtual space. The evaluation stage determines the completion rate and appropriateness of the work.

[0032] In another embodiment, multiple workers can perform training in a single workspace. Multiple workers can perform training remotely from different locations.

[0033] The present invention can be applied not only to thermal power plants but also to various educational environments. Specifically, it can be utilized in areas related to maintenance (replacement and repair) and construction education for power generation equipment, as well as in areas related to the operation and control of power generation equipment.

[0034] For example, a piping replacement project is scheduled for a power plant. The workers assigned to this project receive preliminary training in the same virtual environment. Some workers operate valves, others secure them, others cut the pipes by welding, and still others control the flow of fluid by operating the pipes. These tasks are performed in a set order.

[0035] That is, a large number of workers can accurately judge their tasks through preliminary simulation of the work environment, become familiar with the established sequence, and perform the work skillfully in actual situations.

[0036]

[0037] [Example 2-1] The present invention is an invention for a work training system, and in Example 1-1, the work training material is formed as 3D data of a power plant facility (11); and is composed of time-series steps.

[0038] [Example 2-2] The present invention is an invention for a work training system, and in Example 2-1, the 3D data includes data on the combination of components of a power generation facility.

[0039] [Example 2-3] The present invention is an invention for a work training system, and in Example 2-1, the 3D data includes piping fluid data of a power generation facility.

[0040] [Example 2-4] The present invention relates to a work training system, and in Example 2-1, the 3D data includes tool data of a power generation facility.

[0041] [Example 2-5] The present invention relates to a work training system, and in Example 2-1, the 3D data includes maintenance work data of a power generation facility.

[0042] The present invention (Examples 2-1 to 2-5) embodies the work training material of Example 1-1. The work training material relates to power generation equipment and is implemented as three-dimensional data.

[0043] The above power generation facility is implemented with various equipment, numerous pipes, valves and sensors connected to the pipes, etc. Furthermore, workers use various tools and equipment at the work site, and can implement operations using 3D data on these tools and equipment.

[0044] For example, a worker wearing VR can operate a crane identical to the one on site, and confirm in virtual space that the crane is operated by the worker's operations.

[0045] Afterwards, the worker can use the crane to join the equipment and perform the work of replacing the equipment by operating the crane.

[0046] To implement this, the power generation equipment must be implemented identically to the actual device, and in addition to the power generation equipment, equipment such as cranes and forklifts must be implemented identically, and welders, cutters, tools, materials, etc. must be presented as 3D data identical to the actual site.

[0047]

[0048] [Example 3-1] The present invention is an invention for a work training system, and is composed of time-series steps including, in Example 1-1, an authentication step (S900) for authenticating a trainee to a server before the storage step.

[0049]

[0050] [Example 3-2] The present invention is an invention for a work training system, and in Example 3-1, after the authentication step, includes a proposal step (S910) in which a server proposes optimal work training material.

[0051] [Example 3-3] The present invention is an invention for a work training system, and in Example 3-1, after the authentication step, includes a selection step (S920) in which a trainee selects work training materials.

[0052] [Example 3-4] The present invention is an invention for a work training system, and in Example 3-1, the authentication is formed by one selected from among number input, image recognition, and object recognition.

[0053] [Example 3-5] The present invention is an invention for a work training system, and in Example 3-1, after the authentication step, includes a personal information storage step (S930) in which the personal information (301) of the trainee is applied.

[0054] The present invention [Examples 3-1 to 3-5] relates to authentication of trainees (workers).

[0055] Before training, workers are required to authenticate themselves to the server. Before authentication, the worker's personal information is stored.

[0056] Workers may have varying levels of skill depending on their work experience and level of education. Therefore, rather than providing the same training to all workers, training should be tailored to each worker's specific needs.

[0057] For example, when providing guidance information during a training course, training information may be omitted for workers who are familiar with the content, and training information must be provided to unskilled workers before starting work.

[0058] Personal information includes physical characteristics. A worker's height and weight are used to assess the degree of external interference experienced when entering the work environment, and are particularly useful for identifying issues related to the worker's weight and position.

[0059] Prior to on-the-job training, a variety of training materials must be prepared. Workers should select the most appropriate training materials from a variety of materials. If necessary, the server can suggest the optimal training material based on prior information.

[0060] Work training materials can be selected directly by the worker, suggested to the worker at the request of the manager, or automatically suggested by the server.

[0061] During the personal information storage stage, the worker's physical condition (weight, height) and facial features can be entered. This is to ensure the familiarity of a real person when multiple workers work simultaneously in a single virtual space.

[0062]

[0063] [Example 4-1] The present invention relates to a work training system, and in Example 1-1, the work training material is composed of time-series steps including a first storage step (S110) of storing a plurality of work site data (401) as codes in the storage step; a second storage step (S120) of storing a plurality of event data (402) as codes after the first storage step; and a third storage step (S130) of storing guidance data (403) and / or warning data (404) as codes after the first storage step.

[0064] [Example 4-2] The present invention is an invention for a work training system, and in Example 4-1, the guidance material is formed as pre-work training material;

[0065] [Example 4-3] The present invention is an invention for a work training system, and in Example 4-1, the guidance material or warning material includes being formed as training material after work.

[0066] [Example 4-4] The present invention is an invention for a work training system, and in Example 4-1, the guidance material or warning material includes being formed as training material during work.

[0067] [Example 4-5] The present invention is an invention for a work training system, and in Example 4-1, the work site data and event data are formed as 3D data.

[0068] [Example 4-6] The present invention is an invention for a work training system, and in Example 4-1, the event data includes fire data, explosion data, gas leak data, and damage data.

[0069] The present invention (Examples 4-1 to 4-6) embodies the storage step of Example 1-1.

[0070] The above storage stages are divided into the first, second, and third storage stages. The first storage stage stores worksite data, the second storage stage stores event data, and the third storage stage stores guidance and warning data.

[0071] Multiple data sets should be formed into multiple sets for each situation, and these should be provided with predefined codes. This allows managers to configure the necessary training materials for workers by combining codes.

[0072] For example, implementing job training for a thermal power plant requires 3D CAD data for the entire plant. This data must be divided into multiple data sets, each with a code based on a designated sector. The workshop data must be implemented with identical data for the workshop's paint and lighting.

[0073] For event data, events such as fire, gas leak, equipment explosion, and equipment fall can be expected during the work process, and these events must be implemented in advance.

[0074] In the case of warning data, when cutting work is performed on a chamber or pipe where high pressure has formed, the guidance data generates a warning because internal pressure exists, and can instruct preliminary work such as valve and motor operation to resolve this.

[0075] Additionally, if the pipe is hot, it can be predicted and a warning can be given in advance, predicting that the worker's hands will come into contact with it. Guidance materials can be provided beforehand, during, and after the work.

[0076]

[0077] [Example 5-1] The present invention is an invention for a work training system, and in Example 1-1, the output step is composed of time-series steps including an output step (S210) for outputting a screen (31).

[0078] [Example 5-2] The present invention is an invention for a work training system, and in Example 5-1, the output step includes a sound output step (S220) for outputting sound (501) through a speaker (32).

[0079] [Example 5-3] The present invention is an invention for a work training system, and in Example 5-1, the output step includes a wind direction output step (S230) for outputting wind (502) through a blower (33).

[0080] [Example 5-4] The present invention is an invention for a work training system, and in Example 5-1, the output step includes a heat output step (S230) that outputs heat (503) through a cooling device (34).

[0081] [Example 5-5] The present invention is an invention for a work training system, and in Example 5-1, the output step includes a smell output step (S230) for outputting a smell (504) through a direction device (35).

[0082] [Example 5-6] The present invention is an invention for a work training system, and in Example 5-1, the output step includes a vibration output step (S230) of vibration (505) through a phage-type tool or glove.

[0083] [Example 5-7] The present invention is an invention for a work training system, and in Example 5-1, the output step includes being formed by VR (36), AR (37), and a 3D hologram (38).

[0084] The present invention (Examples 5-1 to 5-7) embodies the output step of Example 1-1.

[0085] The output stage of the present invention is not limited to VR, but also applies to the environment of a training simulator. Specifically, the server provides various output information, a three-dimensional space is displayed through VR, sound is output through speakers installed within the simulator, and wind, heat, and smells can be simulated identically to those found on a worksite through ventilation, heating, and cooling devices, and directional devices.

[0086] Additionally, the worker can sense pressure and vibration from his hands through the gripping tool and gloves, and the pressure and vibration must be implemented under the same conditions as the work site.

[0087] The output of the above screen can be achieved through VR and AR, and can be implemented by implementing a 3D holographic environment inside the simulator.

[0088]

[0089] [Example 6-1] The present invention relates to a work training system, and in Example 1-1, the input step is composed of time-series steps including a first input step (S310) in which the work action receives motion information (601); and a second input step (S320) in which the work action receives operation of an operating body (40).

[0090] [Example 6-2] The present invention is an invention for a work training system, and in Example 6-1, the motion information includes: judging the body movement of the trainee by a camera.

[0091] [Example 6-3] The present invention is an invention for a work training system, and in Example 6-2, the operating body includes a sensor formed of a gripping tool (41) or a glove (42).

[0092] [Example 6-4] The present invention is an invention for a work training system, and in Example 6-3, includes a correction step (S330) for performing correction of the motion information and the operating body before the input step.

[0093] The present invention (Examples 6-1 to 6-4) embodies the input step of Example 1-1.

[0094] The above input step can input the movements of the trainee (worker) that occur during work, or input the items that are operated on tools and gloves.

[0095] To capture the worker's movements, multiple cameras are positioned within the simulator, which inputs the worker's movements as 3D data to the server. In other words, actions like bending or raising a hand are fed as 3D data. Furthermore, in place of cameras, multiple markers are mounted on the body to detect the trainer's movements.

[0096] Workers can utilize work tools or work devices. In this case, tools identical to those present on the worksite are stored as 3D data, and the worker's actions of grasping and manipulating them can be input. Furthermore, gloves can be used to provide the server with the worker's hand movements and position.

[0097] For example, when a worker performs a welding task in a simulator, the glove must grip the welding holder, manipulate the fingers to join the welding rod, and operate the welding machine switch. These procedures and processes can be implemented in 3D space by transmitting the glove and body movements to a server in real time.

[0098] In another embodiment, the worker may utilize the provided multi-remote control to operate the work tools and operations on his behalf.

[0099]

[0100] [Example 7-1] The present invention relates to a work training system, and in Example 1-1, the evaluation step is composed of time-series steps including a performance judgment step (S410) for judging the performance of the trainee; and a completion rate judgment step (S420) for judging the degree of completion of the task.

[0101] [Example 7-2] The present invention is an invention for a work training system, and in Example 7-1, after the performance evaluation step and the completion rate evaluation step, includes a re-education evaluation step (S430) for determining the re-education target for each trainee.

[0102] [Example 7-3] The present invention is an invention for a work training system, and in Example 7-1, after the judgment step, includes a schedule setting step (S440) for determining the training order and repetition order of work training materials according to the level of the trainee based on a plurality of judgment results.

[0103] The present invention (Examples 7-1 to 7-3) embodies the evaluation step of Example 1-1.

[0104] The above evaluation stages are divided into performance evaluation and completion evaluation stages. In other words, they are evaluated from the trainee's perspective and from the task's perspective. Work-related training materials implement various stages, and the stage settings can be adjusted based on the worker's proficiency. Therefore, the optimal training stage should be determined based on the worker's training outcomes.

[0105] To achieve this, the experience and knowledge of multiple educators are assessed, their educational outcomes are compared, and learning outcomes are secured. Based on these assessments, the optimal educational stages and schedules are determined using AI. In other words, the schedule setting step is comprised of the previously proposed step of setting educational materials. Consequently, optimal educational settings based on deep learning can be implemented using AI. This is implemented as a program embedded in the server.

[0106]

[0107] [Example 8-1] The present invention relates to a computer-readable recording medium for implementing a work training system, and relates to a recording medium having recorded thereon a computer-readable program for implementing a work training system comprising any one selected from Examples 1-1 to 7-1.

[0108] 10: Server 11: Power plant equipment

[0109] 20: Learner 31: Screen

[0110] 32: Speaker 33: Blower

[0111] 34: Cooling device 35: Directional device

[0112] 36: VR 37: AR

[0113] 38: 3D hologram 40: Actuator

[0114] 41: Pliers 42: Gloves

[0115] 101: Work Education Materials 201: Educational Activities

[0116] 202: Work results 301: Personal information

[0117] 401: Workplace data 402: Event data

[0118] 403: Guidance material 404: Warning material

[0119] 501: Sound 502: Wind

[0120] 503: Heat 504: Smell

[0121] 505: Vibration 601: Motion information

Claims

1. In the work training system, A storage step (S100) for storing work training materials (101) in a server (10); After the above storage step, an output step (S200) for outputting work training materials to the trainee (20); Among the above output steps, the input step (S300) in which the server receives the trainee's educational behavior (201); After the above output step and input step, an evaluation step (S400) for evaluating the worker's work results (202); A job training system that includes:

2. In claim 1, The above work training material is formed as 3D data of power plant equipment (11); A job training system that includes:

3. In claim 1, Before the above storage step, an authentication step (S900) for authenticating the trainee to the server; A job training system that includes:

4. In claim 1, In the above storage step, the work training material is stored in a first storage step (S110) of storing multiple work site data (401) as code; After the first storage step, a second storage step (S120) of storing multiple event data (402) as code; After the first storage step, a third storage step (S130) of storing guidance material (403) and / or warning material (404) as code; A job training system that includes:

5. In claim 1, The above output step is an output step (S210) that outputs a screen (31); A job training system that includes:

6. In claim 1, In the above input step, the work action includes a first input step (S310) for receiving motion information (601); The above work action is a second input step (S320) that receives the operation of the operating body (40); A job training system that includes:

7. In claim 1, The above evaluation stage is the performance judgment stage (S410) that judges the performance of the trainee. Completion rate judgment step (S420) to determine the completion level of the work A job training system that includes:

8. A recording medium having recorded thereon a computer-readable program characterized by a work training system selected from claims 1 to 7.

Citation Information

Patent Citations

  • Light transporting media and solar power generation system adopting the media

    KR1020200083408A

  • Wall panel alignment assembly of prefabricated bathroom

    KR1020230003927A

  • Solid electrolyte and preparing method of the same

    KR1020240016788A

  • Method and apparatus for controlling situation based on keyword

    KR1020240178783A

  • Multi-color roller

    KR102596858B1