Work support device

Abstract

Explicitly transform tacit knowledge into explicit knowledge and share it with those giving work instructions. [Solution] A work support device that, based on video footage of an worker's work, displays on the screen a notification of a past malfunction case when the work shown in the video matches information related to past malfunction cases.

Description

Technical Field

[0001] The present invention relates to a work support device.

Background Art

[0002] In products with many work sites for manufacturing or maintenance, work instructions from upstream processes (such as design and production technology) after grasping the quality issues of on-site work are important. However, the tacit knowledge regarding the work order on-site is not shared with the work instructors, and there are cases that lead to a decrease in work efficiency and rework.

[0003] Regarding the prevention of work defects, there is Patent Document 1.

[0004] Patent Document 1 discloses a design support system that extracts information on past troubles according to a specified object during design work using a computer.

[0005] Regarding the improvement of work quality, there is Patent Document 2.

[0006] Patent Document 2 discloses a means for evaluating assembly work and disassembly work with high accuracy and improved reliability using evaluation indices according to each product.

[0007] As a technique for monitoring the quality of a work object, taking welding work as an example, there is Patent Document 3.

[0008] Patent Document 3 discloses a method capable of early and easily detecting a defective shape of a welding bead.

Prior Art Documents

Patent Documents

[0009]

Patent Document 1

Patent Document 2

Patent Document 3

[0010] In workplaces where complex phenomena occur, such as welding, it is difficult to share tacit knowledge regarding the sequence of tasks with those giving work instructions.

[0011] Patent Document 1 deals with linguistic data, requiring explicit knowledge. Furthermore, it does not disclose a means for extracting trouble information based on actual images or photographs.

[0012] Patent Document 2 uses simulation results, therefore, scenes where simulation cannot be performed (scenes without a simulator, scenes without a simulation model, etc.) are excluded. For example, a simulator for welding, which involves complex phenomena, requires a model for each scene, and creating a model that takes all scenes into account requires a great deal of effort.

[0013] Patent document 3 does not disclose the order of the multiple welding locations or the order of operations before and after welding.

[0014] None of the patent documents disclose methods for sharing tacit knowledge regarding the order of work on site with workers or work supervisors. In particular, no methods are disclosed for sharing tacit knowledge regarding the order of welding locations or the order of work before and after welding. Work supervisors include those who create drawings and documents, as well as site supervisors.

[0015] Therefore, the objective of the present invention is to provide a method for sharing tacit knowledge regarding the order of work at the worksite with workers or those giving work instructions. [Means for solving the problem]

[0016] A work support device that displays on the screen that there is a defect case when the work based on the operator's work video matches the information related to past defect cases based on the work video.

Effect of the Invention

[0017] According to the above means, tacit knowledge can be formalized and shared with operators and work instructors.

[0018] Further means and further effects of the present invention will become clear throughout the following full text of the specification.

Brief Explanation of Drawings

[0019] [Figure 1] It is a configuration diagram of an example of a work support system. [Figure 2] It is a processing flowchart of a work order extraction unit. [Figure 3] It is an example of screen display on a display unit. [Figure 4] It is a configuration diagram of another example of a work support system. [Figure 5] It is an example of screen display on a display unit. [Figure 6] It is an explanatory diagram of the hardware configuration of a work support system.

Mode for Carrying Out the Invention

[0020] Hereinafter, the mode for carrying out the present invention will be described in detail with reference to each drawing.

Example

[0021] FIG. 1 is a configuration diagram of a work support system 100.

[0022] The work support system 100 includes an input / output unit 101, a work history input unit 102, a CAD data input unit 103, a work order extraction unit 104, a work order database 105, a work order correction unit 106, a defect countermeasure information registration unit 107, a defect countermeasure information database 108, a defect countermeasure information extraction unit 109, and a display unit 110.

[0023] The input / output unit 101 is a part where the user inputs various information and the system displays the design rules it has identified. For example, it could be a terminal owned by the user.

[0024] The work history input unit 102 inputs data on the trajectories of people and tools extracted from video as a history of on-site work in manufacturing or maintenance. For example, in the case of welding work, it inputs data on the trajectory of the welding torch, the person's body / head / hands / feet, and the welding light during welding. In addition to these examples, data related to the history of on-site work may also be input.

[0025] To achieve this, cameras will be installed in manufacturing or maintenance sites, and the footage will be input either directly or after pre-processing.

[0026] The CAD data input unit 103 inputs 3D-CAD data or 2D-CAD data (drawings) of the object to be manufactured / maintained.

[0027] The work sequence extraction unit 104 extracts the work sequence from the field work history data and CAD data. Figure 2 shows a flowchart, designated as 200, for an example where welding is the work and 3D-CAD is the CAD data.

[0028] In S11, the extraction of the work order begins.

[0029] In S12, as STEP 1, the weld shape (line) obtained from the welding history is moved and rotated so that it matches the welding position pattern included in the 3D-CAD.

[0030] In S13, as STEP 2, the weld shape (line) obtained from the welding history is assigned between parts in 3D-CAD.

[0031] In S14, as STEP 3, assign the unassigned weld shapes (lines) between the 3D-CAD subassemblies.

[0032] In S15, as STEP 4, the welding sequence between parts and subassemblies in 3D-CAD is displayed.

[0033] In S16, as STEP 5, if the welding sequence matches a defect correction example, the defect correction information will be displayed along with the work instructions.

[0034] In S17, the extraction of the work sequence is completed.

[0035] Returning to Figure 1, we continue the explanation of the work support system 100.

[0036] The work order database 105 stores the work order extracted by the work order extraction unit 104.

[0037] The work order modification unit 106 can modify the work order registered in the work order database 105 as needed.

[0038] The defect countermeasure information registration unit 107 links the defect countermeasure information to the work order and registers it in the defect countermeasure information database 108.

[0039] The defect countermeasure information extraction unit 109 compares the work order registered in the defect countermeasure information database 108 with the work order registered in the work order database 105, and extracts the defect countermeasure information associated with the matching work order from the defect countermeasure information database 108.

[0040] The display unit 110 displays the extracted or corrected work sequence and the troubleshooting information associated with the work sequence.

[0041] Figure 3, item 150, shows an example of a screen display on the display unit 110. A warning 151 is displayed. It clearly states that there have been cases of malfunction and advises paying attention to the welding sequence (direction).

[0042] The upper part of screen display 300 shows an analysis of the actual work performed by a worker, for example, person A, based on camera footage. The results indicate that there have been instances of problems occurring in that welding operation in the past.

[0043] Furthermore, the lower part of screen display 300 presents examples of countermeasures in which both the order of welding operations (numbers in the diagram) and the direction of welding (direction of the arrows in the diagram) have been changed compared to the upper part of screen display 300.

[0044] As a result, a worker, for example, person A, will be able to understand the appropriate order and orientation for welding, and will be able to avoid problems occurring during the welding process.

[0045] In this way, this work support system makes it possible to share tacit knowledge among on-site workers.

[0046] Please note that the display example in Figure 3 is merely one example, and various displays may be used depending on the type of work or situation.

[0047] For spot welding, simply knowing the order of operations is sufficient.

[0048] For continuous welding or arc welding, it is desirable to include the direction, as shown in Figure 3.

[0049] For bolt fastening work, it is desirable to include the sequence of bolt fastening.

[0050] In the case of riveting work, it is desirable to include the sequence of riveting steps.

[0051] In bolt and rivet fastening operations, the correct fastening sequence ensures uniformity of the tightening force.

[0052] For grinding operations, it is desirable to include the work sequence and the required level of smoothness.

[0053] For painting work, it is desirable to include the direction of spraying and the spray sequence. This is from the perspective of improving the quality of the finished product.

[0054] For wiring work, it is desirable to include the location and routing of the wires. This is from the perspective of improving work efficiency.

[0055] Furthermore, from the perspective of work efficiency, the order and content of tasks may be predetermined with ease of work in mind, and the display may be intended to facilitate the implementation of that order and content.

[0056] Furthermore, regarding various aspects such as quality, safety, and efficiency, the applicable perspectives and the information to be displayed may be determined.

[0057] Furthermore, throughout this specification, the term "defect" includes both the meaning and notation of a problem. Therefore, descriptions of defect cases include defects or problems in operation, quality defects or problems, safety defects or problems, and defects or problems in work efficiency. In addition, the terminology does not have to be exactly the same; various modified expressions and terms that share the same technical concept are also considered equivalent in this specification. This also includes cases where the term is used as a general warning.

[0058] While the above explanations used welding as an example, the work is not limited to welding; it can also be applied to various assembly and manufacturing tasks, including bolt fastening and bonding. Furthermore, it becomes possible to share tacit knowledge among workers even in maintenance work.

[0059] Figure 6 is an explanatory diagram of the hardware configuration of the work support system. 50 represents an execution device such as a PC or server.

[0060] It has a CPU 51, ROM 52, RAM 53, and HDD 54. Note that components 52-54 may be implemented together using an SSD or the like, regardless of the embodiment. 55 is a network interface. 56 is an input / output interface, and 217 is an internal bus.

[0061] 60 is a camera, and video footage of the worker's work is input via the input / output interface 56, either directly or after data processing.

[0062] 101 is the input / output unit, and 110 is the display unit.

[0063] Furthermore, in configurations such as a notebook PC, components 101 and 110 may be built into the execution device 50.

[0064] Alternatively, the connection between the camera 60 and the execution device 50 may be made via the network interface 55.

[0065] The video footage of the worker's work captured by camera 60 is directly or indirectly input to the work history input unit 102 in Figure 1, or input after data extraction.

[0066] Furthermore, the hardware configuration of the work support system may be implemented not as a standalone execution device, but also using or combining cloud-based computing and storage functions. [Examples]

[0067] This embodiment adds work instructions as countermeasures against defects compared to Embodiment 1. It also includes instructions for efficiency and safety.

[0068] The display unit 110 displays work instructions as countermeasures for malfunctions.

[0069] Figure 4 shows the configuration diagram of the work support system in this embodiment, labeled as 400. The parts added to Figure 1 are described below.

[0070] The work instruction reflection unit 411 creates or converts the wording of the work instruction based on the details of the defect countermeasures.

[0071] The created or converted results are registered in the work instruction database 412.

[0072] The work instruction modification unit 413 can modify the expression to an appropriate one as needed.

[0073] Figure 5, part 150, shows an example of screen display on the display unit 110 in this embodiment.

[0074] In Figure 5, compared to Figure 3, the phrase "Please modify the work process by referring to the examples of troubleshooting methods" is displayed at 152 in the figure as an example of work instructions.

[0075] In other words, the on-screen display indicating the existence of a malfunction should include cautionary wording or corrective instructions.

[0076] This allows workers to more proactively identify and implement work modifications based on tacit knowledge.

[0077] The present invention is not limited to the embodiments described above, and various modifications are included.

[0078] For example, the embodiments described above are explained in detail to make the present invention easier to understand, and are not necessarily limited to those having all the configurations described.

[0079] It is possible to replace parts of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment.

[0080] Furthermore, it is possible to add, delete, or replace some of the components of each embodiment with other components.

[0081] As long as the ideas and concepts disclosed above are used, any modifications or similar examples thereof are also included within the scope of the present invention.

[0082] Furthermore, the programs that implement each of the above descriptions are also within the scope of the above disclosure. In this case, Figures 1, 2, and 4 can also be interpreted as conceptual diagrams of the work support program.

[0083] Furthermore, an example of the present invention described using the above embodiments can also be expressed as follows.

[0084] <Part 1> A work support device that, based on video footage of an worker's work, displays on the screen a notification of a past malfunction case when the work shown in the video matches information related to past malfunction cases. <Part 2> The aforementioned screen display includes the sequence and / or direction of the work performed by the worker, as described in <Part 1>, of the work support device. <Part 3> The aforementioned screen display is a work support device as described in <Part 2>, including a screen display related to examples of troubleshooting. <Part 4> The screen display regarding the aforementioned defect countermeasures example includes the appropriate work sequence, direction, or both, as described in <Part 3> of the work support device. <Part 5> The work support device described in <Part 4> displays on the screen that the aforementioned malfunction has occurred, and includes warning words or corrective instructions. <Part 6> A work support device comprising: a work history input unit that directly or indirectly inputs video of a worker's work; a CAD data input unit; a work sequence extraction unit that extracts the work sequence from the information from the work history input unit and the CAD data input unit; a work sequence database; a defect countermeasure information extraction unit that extracts defect countermeasure information using information from a defect countermeasure information database and information from the work history input unit; and a display unit that displays the worker's work information and defect countermeasure information. <Part 7> The work support device described in <6> displays the sequence and / or direction of work performed by the worker on the display unit. <Part 8> The aforementioned display unit displays information regarding examples of troubleshooting measures, as described in <Part 7>, for the work support device. <Part 9> The information regarding the aforementioned failure countermeasures includes the work support device described in <Part 8>, which includes the work sequence, direction, or both. <Part 10> The information regarding the aforementioned countermeasures for the malfunction includes warning wording or corrective instruction wording, as described in <9> of the work support device. <Part 11> A work support program comprising: a work history input unit that directly or indirectly inputs video of the worker's work; a CAD data input unit; a work sequence extraction unit that extracts the work sequence from the information from the work history input unit and the CAD data input unit; a work sequence database; and a defect countermeasure information extraction unit that extracts defect countermeasure information using information from the defect countermeasure information database and the information from the work history input unit, and outputs worker work information and defect countermeasure information. <Part 12> The output includes the sequence and / or direction of the work performed by the worker, as described in <Part 11>, of the work support program. <Part 13> The output includes the work support program described in <Part 12>, which contains information on examples of troubleshooting. <Part 14> The information regarding the aforementioned defect countermeasures is provided in the work support program described in <Part 13>, which includes the order of operations, the direction of operations, or both. <Part 15> The work support program according to claim 14, wherein the information for countermeasures against the aforementioned malfunction includes wording that serves as a warning or wording that serves as a corrective instruction. [Explanation of Symbols]

[0085] 50: Execution device 51:CPU 52:ROM 53: RAM 54: HDD 55:NW 56:IO 60: Camera 101: Input section 102: Work history input section 103: CAD Data Input Section 104: Work sequence extraction unit 105: Work Sequence Database 106: Work Order Correction Section 107: Bug Fix Information Registration Department 108: Bug Fix Information Database 109: Bug Countermeasure Information Extraction Unit 110: Display section 150: Example of screen display 217: Bus 411: Work instruction reflection section 412: Work Instruction Database 413: Work instruction modification department

Claims

1. A work support device that, based on video footage of an worker's work, displays on the screen a notification of a past malfunction case when the work shown in the video matches information related to past malfunction cases.

2. The work support device according to claim 1, wherein the screen display includes the sequence and / or direction of work performed by the worker.

3. The work support device according to claim 2, wherein the screen display includes a screen display relating to examples of troubleshooting measures.

4. The work support device according to claim 3, wherein the screen display regarding the aforementioned examples of troubleshooting includes the appropriate work sequence or direction, or both.

5. The work support device according to claim 4, wherein the screen display indicating the existence of the aforementioned malfunction includes warning words or corrective instruction words.

6. A work support device comprising: a work history input unit that directly or indirectly inputs video of a worker's work; a CAD data input unit; a work sequence extraction unit that extracts the work sequence from information from the work history input unit and the CAD data input unit; a work sequence database; a defect countermeasure information extraction unit that extracts defect countermeasure information using information from a defect countermeasure information database and information from the work history input unit; and a display unit that displays worker's work information and defect countermeasure information.

7. The work support device according to claim 6, wherein the display unit displays the order and / or direction of the work performed by the worker.

8. The work support device according to claim 7, wherein the display unit displays information regarding examples of countermeasures for malfunctions.

9. The work support device according to claim 8, wherein the information regarding the aforementioned examples of countermeasures for the malfunction includes an appropriate work sequence or direction, or both.

10. The work support device according to claim 9, wherein the information for countermeasures against the aforementioned malfunction includes wording that serves as a warning or wording that instructs corrective action.

11. A work support program comprising: a work history input unit that directly or indirectly inputs video of the worker's work; a CAD data input unit; a work sequence extraction unit that extracts the work sequence from the information from the work history input unit and the CAD data input unit; a work sequence database; and a defect countermeasure information extraction unit that extracts defect countermeasure information using information from the defect countermeasure information database and the information from the work history input unit, and outputs worker work information and defect countermeasure information.

12. The work support program according to claim 11, wherein the output includes the sequence and / or direction of work performed by the worker.

13. The work support program according to claim 12, wherein the output includes information regarding examples of troubleshooting.

14. The work support program according to claim 13 includes, in addition to the information regarding the aforementioned examples of countermeasures against the malfunction, an appropriate work sequence or direction, or both.

15. The work support program according to claim 14, wherein the information for countermeasures against the aforementioned malfunction includes wording that serves as a warning or wording that serves as a corrective instruction.

Images