Evaluation method
The evaluation method in the work training system compares trainee and skilled operator work elements to assess proficiency, ensuring appropriate training needs are met, enhancing training efficiency.
Patent Information
- Application Number
- JP2024001320
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-09
- Publication Date
- 2025-07-22
- Estimated Expiration
- 2044-01-09
AI Technical Summary
Existing work training systems fail to efficiently evaluate the proficiency of trainees, leading to either prolonged training times if evaluations are too strict or inefficiencies if evaluations are too lenient.
An evaluation method that measures and compares the work elements of a highly skilled person and a trainee using a work training support system, focusing on gantry trigger timing, gun speed, angle, and nozzle pressing pressure, to determine the need for additional training.
Efficiently evaluates trainee proficiency, distinguishing between trained and untrained operators, thereby optimizing training efficiency.
Smart Images

Figure 2025107834000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an evaluation method.
Background Art
[0002] The inventors have developed a work training support system disclosed in Patent Document 1. In this work training support system, a transmissive display unit worn on the head of a trainee is provided. The display unit displays a first video representing the movement of a tool during a period when an instructor performs work using the tool in the trainee's field of vision. As a result, the trainee can perform the work while viewing the scene visible through the display unit and the first video displayed on the display unit.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] The inventors have discovered the following problems. It may be necessary to evaluate the work performed by a trainee using such a work training support system to determine whether the trainee should perform the actual work. However, the work performed by the trainee could not be appropriately evaluated. For example, if the evaluation is too strict, the trainee will need more training and it will take time until the trainee performs the actual work. Also, if the evaluation is too lenient, the trainee will perform the actual work without reaching a certain level of proficiency in the work, resulting in a loss of efficiency.
[0005] The present disclosure has been made in view of the above-described problems, and provides an evaluation method capable of efficiently evaluating the work performed by a trainee.
Means for Solving the Problems
[0006] The evaluation method according to the present disclosure is an evaluation method for evaluating the work performed by a trainee using a work training support system, measuring each element of the work performed by a highly skilled person, who is more proficient than the trainee, using a work training support system for the work performed by the trainee; measuring each element of the work performed by the trainee using a work training support system; and evaluating the measured work of the trainee by comparing the timing of the gantry trigger of the measured trainee with the timing of the gantry trigger of the measured highly skilled person.
[0007] Further, in the evaluation method described above, the work of the measured trainee may be evaluated by comparing the three directions of the gun speed, the three directions of the angle, and the nozzle pressing pressure of the measured trainee with the three directions of the gun speed, the three directions of the angle, and the nozzle pressing pressure of the measured highly skilled person, respectively.
[0008] Further, in the evaluation method described above, according to the evaluation of the work of the measured trainee, a step of determining whether the measured trainee should perform actual work may be further provided.
[0009] Further, in the step of evaluating the work of the measured trainee in the evaluation method described above, calculating the time when each element of the work of the measured trainee deviates from the range in which each element of the work of the measured highly skilled person is included, the work of the measured trainee may be evaluated based on the ratio of the time deviating from the range to the total work time.
Advantages of the Invention
[0010] According to the present disclosure, the work performed by a trainee can be efficiently evaluated.
Brief Description of the Drawings
[0011]
Figure 1
Figure 2
Figure 3
Modes for Carrying Out the Invention
[0012] Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings. However, the present invention is not limited to the following embodiments. Also, for clarity of explanation, the following description and drawings are simplified as appropriate.
[0013] <Embodiment 1> The evaluation method according to Embodiment 1 will be described with reference to FIGS. 1 and 2. FIG. 1 is a block diagram showing the configuration of a work training support system that can be used in the evaluation method according to Embodiment 1. FIG. 2 is a flowchart showing an example of the evaluation method according to Embodiment 1.
[0014] In the evaluation method according to Embodiment 1, the work training support system 10 shown in FIG. 1 can be used. The work training support system 10 is used for training in work using the tool TL. In the present embodiment, the tool TL is a seal gun that injects a sealant, and the work is a sealant application work in which an operator applies a sealant to a workpiece WK using the seal gun. In the following description, an operator who receives work training is called a trainer, and an operator who is proficient in work compared to the trainer is called a highly skilled worker. When the instructor and the trainer are not particularly distinguished, they are simply called workers.
[0015] The work training support system 10 includes a camera 100, a sensor 150, an information processing device 200, and a display device 300. The camera 100, the sensor 150, and the display device 300 are connected to the information processing device 200 by wired communication or wireless communication.
[0016] The camera 100 and the sensor 150 detect the movement of the tool TL during work. The camera 100 is fixed at a position where it can capture the state of the work. The camera 100 detects the position and orientation of the tool TL among the movements of the tool TL by motion capture technology. In this embodiment, the camera 100 detects the position and orientation of the tool TL by reading a marker MK fixed to the tool TL. The detected position and orientation of the tool TL include, for example, three-dimensional six degrees of freedom (X, Y, Z) and orientation (Roll, Pitch, Yaw). The sensor 150 is fixed to the tool TL. The sensor 150 detects a predetermined movement of the tool TL other than the position and orientation of the tool TL. In this embodiment, the sealing gun, which is the tool TL, includes a lever and a nozzle, and injects a sealing agent from the nozzle with an injection amount corresponding to the amount of gripping of the lever. The sensor 150 includes a position sensor for detecting the position of the lever, in other words, the amount of gripping of the lever, and a pressure sensor for detecting the nozzle pressing pressure applied to the nozzle when the nozzle is pressed against the workpiece WK. The detection results regarding the movement of the tool TL are transmitted from the camera 100 and the sensor 150 to the information processing device 200. Note that the camera 100 and the sensor 150 function as detection units.
[0017] The information processing apparatus 200 is a computer including a processor 201, a memory 202, and an input / output interface 203. The processor 201, the memory 202, and the input / output interface 203 are communicably connected bidirectionally via an internal bus (not shown). The memory 202 stores a work training support program PG and 3D CAD data DT of a tool TL. The memory 202 may further store highly skilled person data DH and trainee data DR. By executing the work training support program PG, the processor 201 functions as a detection control unit 210, a generation unit 220, a display control unit 230, an evaluation point calculation unit 240, and an evaluation point determination unit 250. The evaluation point calculation unit 240 calculates evaluation points for each element of the trainee's work using the highly skilled person data DH and the trainee data DR. The evaluation point determination unit 250 determines whether it is necessary for the trainee to perform training using the work training support system 10 using the evaluation points calculated by the evaluation point calculation unit 240. The detection control unit 210 acquires the detection result of the movement of the tool TL during work from the camera 100 and the sensor 150. The generation unit 220 uses the 3D CAD data DT and the detection result of the movement of the tool TL to generate a video reproducing the movement of the tool TL during work by computer graphics technology. The display control unit 230 causes the display device 300 to display the video generated by the generation unit 220.
[0018] The display device 300 is worn on the head of the operator. The display device 300 is a transmissive head-mounted display, and displays a virtual space video superimposed on the real space scene by augmented reality technology. Specifically, the display device 300 displays the video generated by the generation unit 220 within the trainee's field of view. In the present embodiment, the display device 300 includes a camera and various sensors, and performs alignment between the real space and the virtual space by detecting an object serving as a reference point from within the real space. Note that the display device 300 may be referred to as a display unit.
[0019] The evaluation method according to Embodiment 1 evaluates the work performed by the trainee using the work training support system 10.
[0020] First, each element of the work performed by a highly skilled worker using the work training support system 10 is measured (step ST1). The number of highly skilled workers to be measured is not particularly limited, but may be one or more. Each element of the work is, for example, in the present embodiment, the timing of the gun trigger of the seal gun which is the tool TL, the speed of the seal gun, the angle, the nozzle pressing pressure, etc. The timing of the gun trigger of the seal gun includes the time when the operator starts gripping the lever and the time when the operator finishes gripping the lever. The speed of the seal gun is, for example, the gun speed X in the X-axis direction, the gun speed Y in the Y-axis direction, and the gun speed X in the Z-axis direction in the three-dimensional coordinate XYZ space. The angle of the seal gun is, for example, the roll angle, the pitch angle, and the yaw angle. The measurement results of each element of the work may be stored in the memory 202 as highly skilled worker data DH.
[0021] Subsequently, each element of the work performed by the trainee using the work training support system 10 is measured (step ST2). Each element of the work in this step ST2 is preferably the same as each element of the work measured in step ST1. The measurement results of each element of the work may be stored in the memory 202 as trainee data DR.
[0022] Subsequently, the evaluation point calculation unit 240 evaluates the timing of the trainee's gun trigger (step ST3). Specifically, first, the evaluation point calculation unit 240 compares the timing of the trainee's gun trigger with the timing of the highly skilled worker's gun trigger. Further, the evaluation point calculation unit 240 calculates an evaluation point for evaluating the timing of the trainee's gun trigger according to the result of this comparison. In step ST3, the evaluation point calculation unit 240 may calculate the time when the timing of the trainee's gun trigger deviates from the range in which the timing of the highly skilled worker's gun trigger is included. Subsequently, the evaluation point calculation unit 240 may evaluate the timing of the trainee's gun trigger based on the ratio of the time deviating from the range to the total work time. As shown in FIG. 3, the total work time t cIn this case, the upper limit Wmax and the lower limit Wmin of the value W indicated by the element of the work of a highly skilled person, here the timing of the gantry trigger, are defined. The time t1 exceeding the upper limit Wmax of the value W and the time t2 falling below the lower limit Wmin can be obtained. The full score of the evaluation point Sc for evaluating the timing of the gantry trigger of the trainee's work is defined as Sf. The evaluation point Sc can be calculated using the following formula. Sc = (t1 + t2) / t c × Sf …(1)
[0023] Subsequently, the evaluation point determination unit 250 determines whether the evaluation point of the timing of the gantry trigger of the trainee's work is equal to or higher than a reference point (step ST4). The reference point may be determined based on the evaluation point of the timing of the gantry trigger of the work of a highly skilled person. The reference point is preferably a value lower than the full score Sf. For example, when the full score Sf is 12.5 points, the reference point may be 10 points.
[0024] When the evaluation point of the timing of the gantry trigger of the trainee's work is equal to or higher than the reference point (step ST4: YES), the evaluation point calculation unit 240 evaluates the work of the gun speed in three directions, the angle in three directions, and the nozzle pressing pressure of the trainee's work (step ST5). Specifically, the evaluation point calculation unit 240 compares the gun speed in three directions, the angle in three directions, and the nozzle pressing pressure of the trainee with those of a highly skilled person, respectively. The evaluation point calculation unit 240 evaluates the work of the trainee based on this comparison result. The evaluation point calculation unit 240 may calculate the time when each element of the trainee's work deviates from the range in which each element of the work of a highly skilled person is included. Further, the evaluation point calculation unit 240 may evaluate the work of the trainee based on the ratio of the time deviating from the range to the total work time. That is, in step ST5, similar to step ST3, the evaluation points for evaluating the gun speed in three directions, the angle in three directions, and the nozzle pressing pressure of the trainee can be calculated.
[0025] Subsequently, the evaluation point determination unit 250 determines whether all the evaluation points of the gun speed in three directions, the angle in three directions, and the nozzle pressing pressure of the trainee's work are equal to or higher than the reference point (step ST6).
[0026] When the evaluation points of the gun speed in three directions, the angle in three directions, and the nozzle pressing pressure of the trainer's work are equal to or higher than the reference point (step ST6: YES), the evaluation point determination unit 250 determines that it is not necessary for the trainer to perform training using the work training support system 10 (step ST7).
[0027] On the other hand, if the evaluation point of the timing of the gun trigger of the trainer's work is less than the reference point (step ST4: NO), the evaluation point determination unit 250 determines that it is necessary for the trainer to perform training using the work training support system 10 (step ST8). Similarly, if at least one of the evaluation points of the gun speed in three directions, the angle in three directions, and the nozzle pressing pressure of the trainer's work is less than the reference point (step ST6: NO), the evaluation point determination unit 250 determines that it is necessary for the trainer to perform training using the work training support system 10 (step ST8).
[0028] From the above, it is possible to determine whether it is necessary for the trainer to perform training using the work training support system 10.
[0029] The evaluation point of the timing of the gun trigger tends to be significantly different between the trainer and the highly skilled person compared to the evaluation points of the other elements of the work. In this evaluation method, since the evaluation point of the timing of the gun trigger is first used, it is possible to clearly distinguish between a trainer with insufficient training and a highly skilled person. That is, it is possible to efficiently determine whether training is necessary.
[0030] In addition, the evaluation points of the gun speed in three directions, the angle in three directions, and the nozzle pressing pressure tend to be significantly different between the trainer and the highly skilled person compared to the evaluation points of the other elements of the work excluding the evaluation point of the timing of the gun trigger. In this evaluation method, since the evaluation points of the gun speed in three directions, the angle in three directions, and the nozzle pressing pressure are then used, it is possible to distinguish between a trainer with insufficient training and a highly skilled person. It is possible to improve the efficiency of determining whether training is necessary.
[0031] In addition, part or all of the processing in the information processing apparatus 200 described above can be realized as a computer program. Such a program can be stored using various types of non-transitory computer-readable media and supplied to a computer. Non-transitory computer-readable media include various types of tangible recording media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, semiconductor memories (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). Also, the program may be supplied to the computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can supply the program to the computer via wired communication paths such as electric wires and optical fibers, or wireless communication paths.
[0032] Note that the present invention is not limited to the above-described embodiments and can be appropriately modified without departing from the spirit. Also, the present invention may be implemented by appropriately combining the above-described embodiments and examples thereof.
Explanation of Reference Numerals
[0033] 10 Work training support system 100 Camera 150 Sensor 200 Information processing apparatus 201 Processor 202 Memory 203 Input / output interface 210 Detection control unit 220 Generation unit 230 Display control unit 240 Evaluation point calculation unit 250 Evaluation point determination unit 300 Display device DH Skilled Worker Data DR Trainer Data DT 3D CAD Data MK Marker PG Work Training Support Program t1, t2 Time t c Total Working Time TL Tool WK Work W Value Wmax Upper Limit Wmin Lower Limit
Claims
1. An evaluation method for evaluating the work performed by a trainer using a work training support system, comprising: measuring each element of the work performed by a highly skilled person who is more proficient than the trainer in the work performed by the trainer, using the work training support system; measuring each element of the work performed by the trainer using the work training support system; evaluating the measured work of the trainer by comparing the timing of the trigger of the measured trainer with the timing of the trigger of the measured highly skilled person. Evaluation method.
2. evaluating the measured work of the trainer by comparing the three directions of the gun speed, the three directions of the angle, and the nozzle pressing pressure of the measured trainer with the three directions of the gun speed, the three directions of the angle, and the nozzle pressing pressure of the measured highly skilled person, respectively. The evaluation method according to Claim 1.
3. further comprising determining whether the measured trainer should perform the actual work according to the evaluation of the measured work of the trainer. The evaluation method according to Claim 1 or 2.
4. In the step of evaluating the measured work of the trainer, calculating the time when each element of the measured work of the trainer deviates from the range including each element of the measured work of the highly skilled person; evaluating the measured work of the trainer based on the ratio of the time deviating from the range to the total work time. The evaluation method according to Claim 1 or 2.
Citation Information
Patent Citations
Device of creating training work curriculum and training work system
JP2009109609A
Operation training system
JP2009300692A
Skill acquisition supporting system and skill acquisition support method
JP2013088730A
Wearable sensor and wearable sensor system
JP2023167572A
Expert navigation device based on actual welding data
US11783728B1