Work recording system and work recording method

Abstract

To acquire images to be used for quality determination along with recording of maintenance work.SOLUTION: A work recording system for recording work performed by a worker for a work area, comprises: an imaging unit for capturing an image of the work area to obtain a work image; and a control unit for executing quality processing for determining the quality of the work area based on the work image. The control unit assigns quality information to the work image obtained by the imaging unit, and records the work image with the quality information assigned thereto.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present disclosure relates to a work recording system and a work recording method.

Background Art

[0002] Conventionally, there is known a system that provides, by means of a wearable terminal worn on a worker's head, past work achievements regarding a current work item to the worker in the form of an image (see, for example, Patent Document 1). In this system, an imaging image captured by an imaging unit is acquired as a work result.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] As a work result, for example, there is the quality of a work location worked on by a worker. The quality of the work location is ensured by the worker checking or inspecting the work location, and quality control is performed by recording an image of the work location. By the way, it is conceivable to ensure the quality of the work location by determining an image of the work location. At this time, an image of a work location with guaranteed quality is required as teacher data for machine learning for image determination. In this case, images have to be acquired for machine learning, resulting in low learning efficiency.

[0005] Therefore, an object of the present disclosure is to provide a work recording system and a work recording method capable of acquiring an image used for pass / fail determination together with a record of maintenance work.

Means for Solving the Problems

[0006] The work recording system of the present disclosure is a work recording system that records the work of a worker at a work location. The work recording system includes an imaging unit that captures an image of the work location to obtain a work image, and a control unit that executes a pass / fail process for determining the pass / fail of the work location based on the work image. The control unit assigns pass / fail information to the work image acquired by the imaging unit and records the work image to which the pass / fail information has been assigned.

[0007] Further, the work recording method of the present disclosure is a work recording method executed by a work recording system that records the work of a worker at a work location. The work recording system includes an imaging unit that captures an image of the work location to obtain a work image, and a control unit that executes a pass / fail process for determining the pass / fail of the work location based on the work image. The control unit assigns pass / fail information to the work image acquired by the imaging unit and records the work image to which the pass / fail information has been assigned.

Effect of the Invention

[0008] According to the present disclosure, it is possible to obtain an image used for pass / fail determination while recording maintenance work.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Mode for Carrying Out the Invention

[0010] Hereinafter, embodiments according to the present disclosure will be described in detail with reference to the drawings. Note that the present disclosure is not limited by these embodiments. Also, the components in the following embodiments include those that can be replaced by those skilled in the art and are easy to replace, or those that are substantially the same. Furthermore, the components described below can be combined as appropriate, and when there are multiple embodiments, the embodiments can also be combined with each other.

[0011] [This embodiment] The work recording system 10 according to this embodiment is a system for recording the work content of aircraft maintenance work. The work recording system 10 records the work content at the work location by the worker. Note that the work recording system 10 may be used as a system for conducting education and training on maintenance work, or may be used as a system for supporting the implementation of maintenance work. With reference to FIG. 1, the work recording system 10 will be described.

[0012] (Work recording system) FIG. 1 is a diagram of the work recording system according to this embodiment. As shown in FIG. 1, the work recording system 10 includes a control unit 31, a storage unit 32, a display unit 33, an input unit 34, and an imaging unit 35. The work recording system 10 may be a wearable terminal or a stationary terminal, and is not particularly limited. Also, a worker terminal 39 is connected to the work recording system 10 via a communication network 37. Although not shown in the figure, the worker terminal 39 has a display unit and an input unit, similar to the work recording system 10, and is capable of inputting information for recording work.

[0013] The control unit 31 includes, for example, an integrated circuit such as a CPU (Central Processing Unit). The control unit 31 executes data processing for recording maintenance work. The storage unit 32 is an arbitrary storage device such as a semiconductor storage device and a magnetic storage device. In this storage unit 32, images captured by the imaging unit 35, information generated by various processes, and the like are stored. The display unit 33 is a display device such as a liquid crystal display, for example. The input unit 34 is an input device such as a keyboard and a mouse, for example. The imaging unit 35 is a camera, for example.

[0014] The work recording system 10 presents information on planned maintenance work to the worker via the display unit 33. Further, when information on the work record of the maintenance work is input by the worker, the work recording system 10 generates information on the progress of the maintenance work and information on the results of the maintenance work. Then, the work recording system 10 outputs the generated information on the results of the maintenance work to a work record database (not shown).

[0015] Next, with reference to FIG. 2, an outline of the functions of the work recording system 10 will be described. FIG. 2 is an explanatory diagram functionally showing the work recording system according to the present embodiment. As shown in FIG. 2, the work recording system 10 acquires work request data, which is data on maintenance work to be performed. The work request data is information for supporting maintenance work, and is resource information in which the work procedure of the maintenance work, the location required for the maintenance work, the equipment required for the maintenance work, the parts required for the maintenance work, the personnel for the maintenance work, and the work time required for the maintenance work are associated.

[0016] When the work recording system 10 acquires the work request data, it supports the maintenance work based on the work request data. The work recording system 10 presents the work procedure of the maintenance work to the worker via the display unit 33. Further, the work recording system 10 generates work record data based on the information input by the worker, and outputs the generated work record data to the work record database.

[0017] In addition, during the support of maintenance work, the work recording system 10 requests the operator to record an image of the work location of the maintenance work. The work recording system 10 executes a pass / fail process for determining the pass / fail of the work location with respect to the work image acquired by the imaging unit 35. Then, the work recording system 10 generates work recording data including the work image after the pass / fail determination. The work recording data is information on the resources of the results after the maintenance work and has the same data format as the work request data. Further, the work recording data also includes know-how information input by the operator.

[0018] (Work recording method) Next, with reference to FIG. 3, the work recording method according to the present embodiment will be described. FIG. 3 is a flowchart relating to the work recording method according to the present embodiment. The control unit 31 of the work recording system 10 executes a pass / fail process for determining the pass / fail of the work location during the support of the maintenance work.

[0019] As the pass / fail process, the control unit 31 of the work recording system 10 determines whether there is an accumulation of work images to which pass / fail information has been assigned (step S1). Specifically, in step S1, the control unit 31 determines whether the number of work images serving as determination materials for executing the automatic image determination process described later has been accumulated by the number of images for which image determination can be executed. If the control unit 31 determines that there is an accumulation of work images (step S1: Yes), it determines whether there is reliability in the image determination process (step S2). In step S2, the control unit 31 determines the reliability by determining whether the scoring points of the image determination described later are equal to or greater than a predetermined score. If the control unit 31 determines that there is reliability (step S2: Yes), it proceeds to the automatic image determination process (steps S13 to S32) for automatically determining the image. On the other hand, if the control unit 31 determines that there is no accumulation of work images (step S1: No) and also determines that there is no reliability (step S2: No), it proceeds to the manual image determination process (steps S3 to S8) in which the operator manually determines the image.

[0020] When the control unit 31 shifts to the manual image determination process, it requests the operator to acquire a work image of the work location (step S3). In step S3, the control unit 31 displays a work record screen 50 for acquiring a work image on the display unit 33.

[0021] Here, with reference to FIG. 4, the work record screen displayed on the display unit 33 will be described. FIG. 4 is a diagram of the work record screen. As shown in FIG. 4, the work record screen 50 displays an image captured by the imaging unit 35. Further, the work record screen 50 displays a pass determination button 51 for performing a pass determination on the work location and a fail determination button 52 for performing a fail determination on the work location. The pass determination button 51 and the fail determination button 52 are buttons for determining the pass / fail of the work location and also serve as buttons for capturing an image.

[0022] In step S3, when the control unit 31 displays the work record screen 50, it accepts a pass / fail determination input operation (step S4). Then, the control unit 31 determines whether the work location is good or not based on the operation of the pass determination button 51 or the fail determination button 52 input via the input unit 34 (step S5). In step S5, when the control unit 31 determines that the pass determination button 51 has been operated, it determines that the work location is good (step S5: Yes). On the other hand, when it determines that the fail determination button 52 has been operated, it determines that the work location is bad (step S5: No).

[0023] In step S5, when the control unit 31 determines that the work location is good, it acquires the work image at the time of the operation of the pass determination button 51, attaches pass information to the acquired work image, and records it in the storage unit 32 (step S6). On the other hand, in step S5, when the control unit 31 determines that the work location is bad, it acquires the work image at the time of the operation of the fail determination button 52, attaches fail information to the acquired work image, and records it in the storage unit 32 (step S7).

[0024] Then, after executing steps S6 and S7, the control unit 31 adds points to the scoring of the image determination so that the reliability in the automatic image determination increases (step S8). After executing step S8, the control unit 31 ends the manual image determination process.

[0025] On the other hand, when the control unit 31 transfers to the automatic image determination process after executing step S2, it requests the operator to acquire a work image of the work location (step S13). Triggered by the request in step S13, the control unit 31 causes the imaging unit 35 to image the work location and executes a shooting process using the spatial reference point to acquire a work image (step S14). In step S14, the control unit 31 uses the spatial reference point to image the work location so that the imaging range such as the angle of view with respect to the work location becomes a predetermined position. When the control unit 31 acquires a work image in step S14, it automatically determines the quality of the work location based on the acquired work image (step S15). In step S15, the control unit 31 executes the quality determination of the acquired work image based on the accumulated work images with quality information. For example, it uses a learning model obtained by performing machine learning using the work images with quality information as teacher data.

[0026] When the control unit 31 determines in step S15 that the work location is good (step S15: Yes), it requests the operator to confirm whether the quality determination is correct, that is, whether the work location is good (step S16). In step S16, the operator inputs from the input unit 34 whether the work location is good or not. Then, the control unit 31 determines whether the work location is good or not based on the input from the input unit 34. When the control unit 31 determines that the work location is good based on the confirmation from the operator (step S16: Yes), it assigns good information to the acquired work image and records it in the storage unit 32 (step S17).

[0027] After executing step S17, assuming that the result of the automatic image determination matches the confirmation result of the operator, the control unit 31 gives points as the scoring of the image determination so as to increase the reliability in the automatic image determination (step S18). After executing step S18, the control unit 31 ends the automatic image determination process.

[0028] On the other hand, in step S16, if the control unit 31 determines that the work location is not (step S16: No) based on the confirmation to the operator, it attaches no information to the acquired work image and records it in the storage unit 32 (step S21).

[0029] After executing step S21, assuming that the result of the automatic image determination is different from the confirmation result of the operator, the control unit 31 deducts points as the scoring of the image determination so as to decrease the reliability in the automatic image determination (step S22). After executing step S22, the control unit 31 ends the automatic image determination process.

[0030] Also, in step S15, if the control unit 31 determines that the work location is not (step S15: No), it presents to the operator that the work image has been classified and determined as abnormal (step S25). After executing step S25, the control unit 31 requests the operator to confirm whether the pass / fail determination is correct, that is, whether the work location is not (step S26). Based on the confirmation from the operator, if the control unit 31 determines that the work location is not (step S26: Yes), it attaches no information to the acquired work image and records it in the storage unit 32 (step S27).

[0031] After executing step S27, assuming that the result of the automatic image determination matches the confirmation result of the operator, the control unit 31 gives points as the scoring of the image determination so as to increase the reliability in the automatic image determination (step S28). After executing step S28, the control unit 31 ends the automatic image determination process.

[0032] On the other hand, in step S26, when the control unit 31 determines based on the confirmation from the operator that the working location is not "no", that is, it is "good" (step S26: No), it assigns good information to the acquired working image and records it in the storage unit 32 (step S31).

[0033] Then, after executing step S31, if the control unit 31 determines that the result of the automatic image determination is different from the confirmation result of the operator, it deducts points as the scoring of the image determination so that the reliability in the automatic image determination decreases (step S32). After executing step S32, the control unit 31 ends the automatic image determination process.

[0034] As described above, the work recording system 10 and the work recording method according to the present embodiment are understood as follows, for example.

[0035] The work recording system 10 according to the first aspect is a work recording system 10 that records the work on the working location by the worker, and includes an imaging unit 335 that captures the working location to acquire a working image, and a control unit 31 that executes a pass / fail process for determining the pass / fail of the working location based on the working image. The control unit 31 assigns pass / fail information to the working image acquired by the imaging unit 35 and records the working image to which the pass / fail information is assigned.

[0036] According to this configuration, since the working image to which the pass / fail information is assigned can be recorded, the working location of the maintenance work can be recorded. In addition, since the pass / fail information is assigned to the working image, it can be used as teacher data for image determination. Thereby, together with the recording of the maintenance work, an image used for pass / fail determination can be acquired.

[0037] As a second aspect, in the work recording system 10 according to the first aspect, when the control unit 31 determines that the accumulation of the recorded working images is not an accumulation that enables the execution of the pass / fail determination of the working location, it requests the worker to perform the pass / fail determination.

[0038] According to this configuration, it is possible to acquire a work image to which pass / fail information has been given by an operator while suppressing misjudgment in pass / fail determination.

[0039] As a third aspect, in the work recording system 10 according to the first or second aspect, when the control unit 31 determines that the accumulation of the recorded work images is an accumulation enabling execution of pass / fail determination for the work location, the control unit 31 executes pass / fail determination based on the accumulated work images.

[0040] According to this configuration, since work images to which pass / fail information has been given are sufficiently accumulated, pass / fail determination can be executed with high accuracy.

[0041] As a fourth aspect, in the work recording system 10 according to any one of the first to third aspects, the work recording system 10 further includes a display unit 33 that displays an image captured by the imaging unit 35, and an input unit 34 that inputs pass / fail determination for the work location. The input unit 34 includes a pass determination button 51 for performing pass determination for the work location and a fail determination button 52 for performing fail determination for the work location. When the control unit 31 inputs the pass determination button 51 or the fail determination button 52, the control unit 31 acquires the work image at that time and gives the pass / fail information to the work image.

[0042] According to this configuration, by operating the pass determination button 51 or the fail determination button 52, it is possible to easily acquire a work image to which pass / fail information has been given.

[0043] A work recording method according to a fifth aspect is a work recording method executed by a work recording system 10 that records work on a work location by an operator. The work recording system 10 includes an imaging unit 35 that images the work location and acquires a work image, and a control unit 31 that executes pass / fail processing for performing pass / fail determination for the work location based on the work image. The control unit 31 gives pass / fail information to the work image acquired by the imaging unit 35 and records the work image to which the pass / fail information has been given.

[0044] According to this configuration, since the work image with the pass / fail information can be recorded, the work location of the maintenance work can be recorded. Also, since the pass / fail information is attached to the work image, it can be used as teacher data for image determination. As a result, together with the record of the maintenance work, the image used for pass / fail determination can be obtained.

Explanation of Signs

[0045] 10 Work recording system 31 Control unit 32 Storage unit 33 Display unit 34 Input unit 35 Imaging unit 37 Communication network 39 Operator terminal

Claims

1. In a work recording system for recording work at a work location by an operator, an imaging unit that images the work location to obtain a work image; a control unit that executes a pass / fail process for performing a pass / fail determination of the work location based on the work image, and the control unit assigns pass / fail information to the work image acquired by the imaging unit, A work recording system that records the work image to which the pass / fail information is assigned.

2. The control unit If it is determined that the accumulation of the recorded work images is not an accumulation that enables the pass / fail determination of the work location, the work recording system according to claim 1, which requests the operator to perform a pass / fail determination.

3. The control unit If it is determined that the accumulation of the recorded work images is an accumulation that enables the pass / fail determination of the work location, the work recording system according to claim 1, which performs a pass / fail determination based on the accumulated work images.

4. A display unit that displays the image captured by the imaging unit; An input unit for inputting a pass / fail determination of the work location, and The input unit has a pass determination button for determining that the work location is acceptable and a fail determination button for determining that the work location is unacceptable, The control unit acquires the work image at the time of input of the pass determination button or the fail determination button, and assigns the pass / fail information to the work image. The work recording system according to claim 1.

5. In a work recording method executed by a work recording system for recording work at a work location by an operator, the work recording system has an imaging unit that images the work location to obtain a work image; a control unit that executes a pass / fail process for performing a pass / fail determination of the work location based on the work image, and the control unit assigns pass / fail information to the work image acquired by the imaging unit, A work recording method for recording the work image to which the pass / fail information is assigned.

Images