Work support device, work support method, and work support program

Abstract

To improve efficiency of work when assembling a product from a plurality of components.SOLUTION: The work support device 14 acquires the first visual information V1 representing the still image or the moving image showing the part used for assembling the product and the second visual information V2 which is the still image or the moving image showing the assembling procedure of the product, and causes the display 16 to display the third visual information V1 which is the still image or the moving image in which the part shown in the first visual information V2 and the part shown in the second visual information V3 are associated with each other.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a work assistance device, a work assistance method, and a work assistance program. [Background technology]

[0002] Conventionally, there is known an electronic assembly procedure manual system that provides an assembly procedure manual that allows easy visual recognition and understanding of assembly procedures for parts that are difficult to understand from static drawings (see, for example, Patent Document 1). This electronic assembly procedure manual system includes a recording means for recording drawing data relating to a two-dimensional drawing showing a state in which a part or all of an article is assembled and animation data relating to an animation showing the process until a part or all of the article is assembled into the state shown in the two-dimensional drawing, a screen image that displays a predetermined two-dimensional drawing based on the drawing data and displays an animation icon that specifies the animation corresponding to the two-dimensional drawing at a predetermined position on the two-dimensional drawing, and a playback means that plays the animation based on the animation data when an operation such as clicking is performed on the displayed animation icon. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-223094 Summary of the Invention [Problem to be solved by the invention]

[0004] The electronic assembly procedure manual system disclosed in Patent Document 1 displays drawing data showing the state in which an article is partially or completely assembled, and also plays animation data showing the process of assembling the article to that state.

[0005] However, when assembling a product from multiple parts, a worker has a problem in that it takes time to determine which of the multiple parts that the worker actually has in his or her possession corresponds to which part in the various information media that describe the assembly procedure (for example, drawings shown in an assembly procedure manual or animations showing the assembly procedure.) In particular, when there are a large number of parts to assemble a product or when the parts are similar to each other, it is difficult for the worker to immediately determine which of the multiple parts in front of him or her corresponds to which of the parts shown in the various information media that describe the assembly procedure.

[0006] The present disclosure has been made in consideration of the above points, and aims to improve the efficiency of work when assembling a product from multiple parts. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, the work assistance device of the present disclosure is a work assistance device that includes an acquisition unit that acquires first visual information that represents a still image or a moving image showing parts used in assembling a product and second visual information that is a still image or a moving image showing the assembly procedure of the product, and a control unit that displays third visual information that is a still image or a moving image in which the parts shown in the first visual information and the parts shown in the second visual information are associated on a display unit.

[0008] The work assistance method of the present disclosure also includes acquiring first visual information representing a still image or a moving image showing parts used in assembling a product, and second visual information being a still image or a moving image showing an assembly procedure for the product, and acquiring third visual information being a still image or a moving image in which the parts shown in the first visual information and the parts shown in the second visual information are associated with each other. This is a work support method in which a computer executes processing to display the above on a display unit.

[0009] In addition, the work assistance program disclosed herein is a work assistance program for causing a computer to execute a process of acquiring first visual information representing a still image or video of parts used in assembling a product and second visual information being a still image or video representing the assembly procedure of the product, and displaying third visual information being a still image or video in which the parts depicted in the first visual information and the parts depicted in the second visual information are associated on a display unit. [Effects of the Invention]

[0010] According to the work assistance device, work assistance method, and work assistance program of the present disclosure, it is possible to improve the efficiency of work when assembling a product from a plurality of parts. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram for explaining a work support system according to an embodiment of the present invention. [Figure 2] 1 is a block diagram showing a schematic configuration of a work support system according to an embodiment of the present invention. [Figure 3] 1 is a block diagram showing a hardware configuration of a work assistance device according to an embodiment of the present invention. [Figure 4] 3A to 3C are diagrams illustrating an example of information stored in various storage units according to the present embodiment. [Figure 5] 10 is a flowchart showing the flow of a work support process in the present embodiment. [Figure 6] FIG. 3 is a diagram showing examples of various operation icons. [Figure 7] FIG. 10 is a diagram showing a modified example of the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] An example of an embodiment of the present disclosure will be described below with reference to the drawings. In this embodiment, a work assistance system equipped with a work assistance device according to the present disclosure will be described as an example. Note that the same reference numerals are used in the drawings to designate identical or equivalent components and parts. Furthermore, the dimensions and proportions of the drawings are exaggerated for the sake of explanation and may differ from the actual proportions.

[0013] Fig. 1 is a diagram for explaining this embodiment. As shown in Fig. 1, a work support system 10 of this embodiment includes a camera 12, a work support device 14 implemented by a personal computer or the like, and a display device 16 attached to the personal computer or the like. When a worker assembles a product, the work support system 10 of this embodiment associates each of a plurality of parts P1A, P1B, and P1C present in front of the worker with each of parts P2A, P2B, and P2C depicted in various information media showing the assembly procedure (for example, drawings shown in an assembly procedure manual or animations showing the assembly procedure), and displays these on the display device 16.

[0014] Specifically, the work support system 10 of this embodiment applies the same color to each of the multiple parts P1A, P1B, and P1C in front of the worker captured by the camera 12 and each of the parts P2A, P2B, and P2C captured on various information media showing assembly procedures. This associates each of the parts P1A, P1B, and P1C in real space with each of the parts P2A, P2B, and P2C in virtual space shown on various information media showing assembly procedures. This allows the worker to improve the efficiency of work when assembling a product from multiple parts. This will be explained in detail below.

[0015] (Work Support System 10) 2 is a block diagram showing a schematic configuration of the work support system 10 of this embodiment. As shown in FIG. 2, the work support system 10 includes a camera 12, a work support device 14, and a display device 16.

[0016] The camera 12 captures an image of a plurality of parts placed by a worker. The images of the plurality of parts captured by the camera 12 are output to the work support device 14 as still images or moving images. In this embodiment, a still image or moving image captured by the camera 12 and showing parts in real space used in assembling a product is referred to as first visual information. Therefore, the first visual information is at least one still image or moving image captured by the worker operating the camera 12.

[0017] Fig. 3 is a block diagram showing the hardware configuration of the work assistance device 14 according to this embodiment. As shown in Fig. 3, the work assistance device 14 has a CPU (Central Processing Unit) 42, memory 44, a storage device 46, an input / output I / F (Interface) 48, a storage medium reader 50, and a communication I / F 52. Each component is connected to each other via a bus 54 so as to be able to communicate with each other.

[0018] The storage device 46 stores task support programs for executing the various processes described below. The CPU 42 is a central processing unit that executes various programs and controls the various components. That is, the CPU 42 reads the programs from the storage device 46 and executes the programs using the memory 44 as a work area. The CPU 42 controls the various components and performs various arithmetic processes in accordance with the programs stored in the storage device 46.

[0019] The memory 44 is made up of RAM (Random Access Memory) and serves as a working area to temporarily store programs and data. The storage device 46 is made up of ROM (Read Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc., and stores various programs including the operating system and various data.

[0020] The input / output I / F 48 is an interface for inputting data from an external device and outputting data to an external device. It may also be connected to an input device, such as a keyboard or a mouse, for inputting various types of information, and an output device, such as a display or a printer, for outputting various types of information. A touch panel display may be used as the output device, allowing it to function as an input device. In this embodiment, the input / output I / F 48 is connected to the display device 16.

[0021] The storage medium reader 50 reads data stored in various storage media such as CD (Compact Disc)-ROM, DVD (Digital Versatile Disc)-ROM, Blu-ray Disc, and USB (Universal Serial Bus) memory, and writes data to the storage media.

[0022] The communication I / F 52 is an interface for communicating with other devices, and uses standards such as Ethernet (registered trademark), FDDI, and Wi-Fi (registered trademark).

[0023] Next, the functional configuration of the work support device 14 will be described. As shown in Fig. 2, the work support device 14 functionally includes an acquisition unit 18, an identification unit 20, and a control unit 22. A predetermined storage area of ​​the work support device 14 is provided with a process information storage unit 30, a part information storage unit 32, an association information storage unit 34, and a work instruction information storage unit 36. Each functional configuration is realized by the CPU 42 reading out each program stored in the storage device 46, expanding it in the memory 44, and executing it.

[0024] FIG. 4 is a diagram showing an example of information stored in the process information storage unit 30, the part information storage unit 32, the association information storage unit 34, and the work instruction information storage unit 36.

[0025] The process information storage unit 30 stores process information in which a process ID for identifying a product assembly process is associated with a part ID for identifying a part used in that process. FIG. 4(A) is a diagram showing an example of process information. As shown in FIG. 4(A), the process information is information that makes it possible to identify which part is used in which process. For example, as shown in FIG. 4(A), the process information indicates that parts corresponding to part IDs "P001," "P002," and "P003" are used in the process corresponding to process ID "W001."

[0026] For example, information for associating a part shown in the first visual information with a part ID is stored in the part information storage unit 32. Fig. 4(B) is a diagram showing an example of information for associating a part shown in the first visual information with a part ID.

[0027] In this embodiment, it is necessary to identify which part ID corresponds to which part in the image by analyzing the image of the part photographed by camera 12. For this reason, for example, by associating the part ID with feature information on the image of the part, it becomes possible to identify which part ID corresponds to which part photographed by camera 12.

[0028] For example, as shown in Fig. 4(B), if a part captured in the first visual information captured by camera 12 has feature information "F001", the part is identified as corresponding to part ID "P001". Note that the association between the part captured in the first visual information captured by camera 12 and the part ID is not limited to the technique using a table such as that shown in Fig. 4(B), and the part ID may be identified by, for example, a known image processing technique, a known artificial intelligence technique, or a known machine learning technique.

[0029] The association information storage unit 34 stores, for example, information for associating a part ID with color information to be added to the part. FIG. 4(C) is a diagram showing an example of information for associating a part ID with color information to be added to the part. For example, as shown in FIG. 4(C), it is indicated that red is to be added to the part corresponding to the part ID "P001."

[0030] The work instruction information storage unit 36 ​​stores, for example, information associating a process ID with various information media showing the assembly procedures corresponding to that process. FIG. 4(D) is a diagram showing an example of information associating a process ID with various information media showing the assembly procedures corresponding to that process. For example, as shown in FIG. 4(D), a still image or video "V2-1" is associated as a still image or video showing the assembly procedures for the process corresponding to process ID "W001." In this embodiment, a still image or video stored in the work instruction information storage unit 36 ​​and showing the assembly procedures for a product is referred to as second visual information.

[0031] The acquisition unit 18 acquires first visual information and second visual information. Specifically, the acquisition unit 18 acquires the first visual information showing a plurality of parts in real space output from the camera 12. The acquisition unit 18 also acquires the second visual information stored in the work instruction information storage unit 36.

[0032] The recognition unit 20 recognizes components captured in a still image or a moving image. Specifically, the recognition unit 20 recognizes a plurality of components captured in the first visual information and a plurality of components captured in the second visual information by using a known image processing technique, a known artificial intelligence technique, or a known machine learning technique.

[0033] The control unit 22 causes the display device 16 to display third visual information, which is a still image or a moving image in which the components shown in the first visual information and the components shown in the second visual information are associated with each other. Specifically, the control unit 22 generates third visual information by associating the identification result of the components shown in the first visual information obtained by the identification unit 20 with the identification result of the components shown in the second visual information obtained by the identification unit 20, and causes the display device 16 to display the third visual information. At this time, the third visual information is an image that includes both a still image or a moving image (an image corresponding to the second visual information) that represents the associated assembly procedure and an associated component image (an image corresponding to the first visual information).

[0034] More specifically, for example, as shown in FIG. 1, the control unit 22 associates each of the multiple parts appearing in the first visual information V1 with each of the multiple parts appearing in the second visual information V2 by adding the same color to parts identified as being identical between each of the multiple parts appearing in the first visual information V1 and each of the multiple parts appearing in the second visual information V2, thereby generating third visual information V3.

[0035] Next, the operation of the work support system 10 according to this embodiment will be described. In the following, an example will be described in which a worker takes a picture of a part required for each process of assembling a product.

[0036] First, when the work support device 14 receives a predetermined instruction signal, it executes a work support processing routine shown in FIG.

[0037] In step S100, the acquisition unit 18 initializes a target process ID representing the current process. For example, the acquisition unit 18 sets the target process ID to "W001."

[0038] The worker places multiple parts that are thought to be necessary for the first step in the product assembly work on a desk or the like, and takes an image of the multiple parts by operating camera 12. Camera 12 outputs first visual information showing the multiple parts to work support device 14.

[0039] In step S102, the acquisition unit 18 acquires the first visual information output from the camera 12.

[0040] In step S104, the acquisition unit 18 refers to the process information stored in the process information storage unit 30, and identifies the process ID corresponding to the target process ID set in step S100 or the target process ID updated in step S122 described below.

[0041] In step S106, the identification unit 20 refers to the information stored in the part information storage unit 32 and uses a known image processing technique, a known artificial intelligence technique, or a known machine learning technique to identify the multiple parts appearing in the first visual information acquired in step S102 and specify the part ID of each of the multiple parts.

[0042] In step S108, the control unit 22 determines whether all of the parts corresponding to the part IDs identified in step S106 are shown in the first visual information acquired in step S102. For example, as shown in Fig. 4(A), when the target process ID is "W001" and the part IDs associated with the process ID "W001" are "P001," "P002," and "P003," the control unit 22 determines whether all of the parts corresponding to "P001," "P002," and "P003" are shown in the first visual information.

[0043] In step S110, if the control unit 22 determines that all of the components corresponding to the component IDs identified in step S106 are shown in the first visual information acquired in step S102, the process proceeds to step S114. On the other hand, if the control unit 22 determines that at least one of the components corresponding to the component IDs identified in step S106 is not shown in the first visual information, the process proceeds to step S112.

[0044] In step S112, the control unit 22 causes the display device 16 to display information prompting the user to reacquire the first visual information. For example, the display device 16 displays information such as "One of the components required for this process could not be recognized. Please take another photograph of the component." In addition, in step S112, the control unit 22 may also cause the display device 16 to display information prompting the user to rearrange the components. In this case, for example, the display device 16 displays information such as "One of the components required for this process could not be recognized. Please rearrange the component and then take another photograph of the component."

[0045] In step S114, the control unit 22 refers to the information stored in the work instruction information storage unit 36 ​​and identifies the second visual information corresponding to the process ID identified in step S104.

[0046] In step S115, the recognition unit 20 recognizes the plurality of parts appearing in the second visual information identified in step S114.

[0047] In step S116, the control unit 22 associates each of the multiple components depicted in the first visual information V1 with each of the multiple components depicted in the second visual information V2 by applying the same color to each of the multiple components depicted in the first visual information V1 and each of the multiple components depicted in the second visual information V2 that are identified as being identical based on the identification results obtained in steps S106 and S115. Specifically, the control unit 22 refers to the information stored in the association information storage unit 34 to identify which color information is to be applied to which component, and applies the same color to each of the multiple components depicted in the first visual information V1 and each of the multiple components depicted in the second visual information V2 that are identified as being identical. Then, in step S116, the control unit 22 generates third visual information in which the multiple components depicted in the first visual information V1 and the multiple components depicted in the second visual information are associated with each other.

[0048] In step S118, the control unit 22 causes the display device 16 to display the third visual information generated in step S116.

[0049] While viewing the third visual information displayed on the display device 16, the worker may change the display mode of the third visual information by operating various operation icons (T1 to T12) shown in Fig. 6. The changes realized by the operation icons (T1 to T12) in Fig. 6 are as follows. Note that the modes of these operation icons are merely examples, and the display modes and functions may be changed as needed.

[0050] Operation icon T1: Play and pause Operation icon T2: Move to next chapter Operation icon T3: Volume adjustment Operation icon T4: Playback time Operation icon T5: Rewind and fast forward Operation icon T6: Move the center of the video Operation icon T7: Auto repeat Operation icon T8: Display subtitles Operation icon T9: Video speed Operation icon T10: Zoom in and out Operation icon T11: Full screen switching display (or switching between moving images and still images) Operation icon T12: Display current chapter

[0051] In step S120, the control unit 22 determines whether the presentation of the third visual information corresponding to all processes has been completed by determining whether the target process ID set in step S100 or the target process ID updated in step S122, which will be described later, is the last process in the product assembly process. If the presentation of the third visual information corresponding to all processes has been completed, the processing ends. If the presentation of the third visual information corresponding to all processes has not been completed, the control unit 22 updates the target process ID in step S122 (for example, changing the target process ID "W001" to "W002") and then returns to step S102.

[0052] As described above, the task assistance device according to this embodiment acquires first visual information that represents still images or video images of parts used in assembling a product, and second visual information that is still images or video images that represent the assembly procedure for the product, and displays third visual information that is still images or video images in which the parts depicted in the first visual information and the parts depicted in the second visual information are associated on a display device that is an example of a display unit. This makes it possible to improve the efficiency of tasks when assembling a product from multiple parts.

[0053] Specifically, in the past, a worker had to understand and identify which of the virtual-space parts displayed in the information representing the product's assembly procedure corresponded to the real-world parts required for product assembly work. This resulted in a problem: when there were a large number of parts or when the parts were similar to each other, it took a long time to identify the parts during assembly. In contrast, the work assistance device according to this embodiment automatically recognizes parts captured in images acquired from a camera, which is an arbitrary imaging device, and simultaneously displays the corresponding parts in assembly information (e.g., assembly video). This allows the worker to associate and present the parts and assembly procedures they should use in the following steps, enabling efficient assembly. The work assistance device can be used not only for assembling plastic models and hobby craft kits using multiple parts, but also for assembling industrial products in the manufacturing industry. The assembly work in this case may involve the use of tools such as jigs.

[0054] This allows workers to intuitively understand the correspondence between the virtual space parts displayed in the information representing the product assembly procedure and the parts that exist in the real space, thereby improving product assembly ease and reducing the occurrence of incorrect product assembly.

[0055] Furthermore, the work assistance device according to this embodiment displays, on the display device, information prompting the user to reacquire the first visual information when at least one of the components corresponding to the component ID is not shown in the first visual information. Furthermore, the work assistance device according to this embodiment displays, on the display device, information prompting the user to rearrange the components and information prompting the user to reacquire the first visual information when at least one of the components corresponding to the component ID is not shown in the first visual information. This improves the accuracy of component recognition and enables proper component assembly.

[0056] The technology of the present disclosure is not limited to the above-described embodiment, and various modifications and applications are possible within the scope of the gist of this disclosure.

[0057] [Variation 1] The control unit 22 may associate each of the multiple components appearing in the first visual information with each of the multiple components appearing in the second visual information by adding a line connecting the components identified as identical between each of the multiple components appearing in the first visual information and each of the multiple components appearing in the second visual information, and generate third visual information. Figure 7 is a diagram showing an example of Modification 1. As shown in Figure 7, the control unit 22 may associate each of the multiple components appearing in the first visual information with each of the multiple components appearing in the second visual information by adding a line connecting the components identified as identical between each of the multiple components appearing in the first visual information and each of the multiple components appearing in the second visual information.

[0058] [Variation 2] The control unit 22 may associate each of the multiple components shown in the first visual information with each of the multiple components shown in the second visual information by adding the same identification information to each of the multiple components identified as being the same between each of the multiple components shown in the first visual information and each of the multiple components shown in the second visual information, and generate the third visual information. Examples of the same identification information include the same mark, a frame formed in the same color, various types of information flashing at the same timing, or diagonal lines of the same width.

[0059] [Variation 3] The control unit 22 may generate a video showing the action of superimposing one of the multiple parts identified as identical on another of the multiple parts shown in the first visual information and the multiple parts shown in the second visual information, thereby associating each of the multiple parts shown in the first visual information with each of the multiple parts shown in the second visual information, and generating third visual information.

[0060] [Variation 4] When the first visual information is a moving image, the control unit 22 may perform control so that, when a component shown in the first visual information moves, the identification information assigned to the component shown in the first visual information also moves in accordance with the movement of the component. For example, when the identification information assigned to the component shown in the first visual information is color information, the color information assigned to the component shown in the first visual information also moves in accordance with the movement of the component.

[0061] [Variation 5] The control unit 22 may also make a determination regarding a semi-finished product (so-called sub-assembly). In this case, the control unit 22 acquires process information from the process information storage unit 30, which stores process information in which a process ID for identifying a product assembly process is associated with a component ID for identifying a component used in the process. This process information includes a component ID corresponding to a semi-finished product generated during product assembly. In this case, the control unit 22 acquires a target process ID representing the current process and determines whether all components corresponding to the component ID associated with the process ID corresponding to the target process ID are shown in the first visual information. If the semi-finished product corresponding to the component ID is not shown in the first visual information, the control unit 22 displays information on the display device 16 indicating that the assembly procedure up to that point may be incorrect. This enables early detection of assembly errors and smooth assembly.

[0062] [Variation 6] In the above embodiment, an example has been described in which parts are photographed by the camera 12 for each process of assembling a product, but the present invention is not limited to this. For example, all parts required for assembling a product may be photographed at once to be used as the first visual information. In this case, after first visual information showing the photographed parts is acquired, it is identified which of the multiple processes included in the process information uses the parts.

[0063] [Variation 7] In the above embodiment, the case where the identification unit 20 dynamically identifies multiple parts shown in the second visual information (step S115) has been described as an example, but the present invention is not limited to this. The control unit 22 may generate the third visual information by associating the identification result of the parts shown in the first visual information obtained by the identification unit 20 with identification information previously added to the parts shown in the second visual information.

[0064] [Variation 8] In the above embodiment, the control unit 22 dynamically colors the multiple components shown in the second visual information (step S116), but the present invention is not limited to this. For example, if component A shown in the second visual information is originally colored red, only component A shown in the first visual information may be colored red, thereby associating the components shown in the first visual information with the components shown in the second visual information.

[0065] [Variation 9] In the above embodiment, the work assistance device 14 is a personal computer or the like, but is not limited to this. For example, the work assistance device 14 may be a mobile terminal such as a smartphone. In this case, a camera built into the mobile terminal captures an image of a part in real space, and the first visual information is generated.

[0066] [Variation 10] The work support device 14 is provided with a dimmable light source, and when the camera 12 photographs a part, the part may be photographed by emitting light from the light source.

[0067] Furthermore, the processes executed by the CPU after reading the software (program) in the above-described embodiments may be executed by various processors other than the CPU. Examples of such processors include programmable logic devices (PLDs) whose circuit configuration can be changed after fabrication, such as field-programmable gate arrays (FPGAs), and dedicated electrical circuits, such as application-specific integrated circuits (ASICs), which are processors with circuit configurations specifically designed to execute specific processes. Each process may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0068] In the above embodiment, the programs are pre-stored (installed) in a storage device, but the present invention is not limited to this. The programs may be provided in a form stored on a storage medium such as a CD-ROM, DVD-ROM, Blu-ray disc, or USB memory. The programs may also be downloaded from an external device via a network.

[0069] (Addendum) The following additional notes are provided regarding aspects of the present disclosure.

[0070] (Appendix 1) an acquisition unit that acquires first visual information representing still images or moving images of parts used in assembling a product, and second visual information representing still images or moving images representing an assembly procedure for the product; a control unit that causes a display unit to display third visual information, which is a still image or a moving image in which the component shown in the first visual information and the component shown in the second visual information are associated with each other; A work support device comprising: (Appendix 2) The image processing device further includes an identification unit that identifies a component that appears in a still image or a moving image, the control unit generates the third visual information by associating the identification result of the component shown in the first visual information obtained by the identification unit with the identification result of the component shown in the second visual information obtained by the identification unit or with identification information previously added to the component shown in the second visual information, and causes the display unit to display the third visual information. 10. The work support device according to claim 1. (Appendix 3) The control unit adding the same color to parts identified as being identical between each of the plurality of parts shown in the first visual information and each of the plurality of parts shown in the second visual information, thereby associating each of the plurality of parts shown in the first visual information with each of the plurality of parts shown in the second visual information, and generating the third visual information. 10. The work support device according to claim 1 or 2. (Appendix 4) The control unit adding a line connecting each of the plurality of components shown in the first visual information and each of the plurality of components shown in the second visual information that is identified as being identical, thereby associating each of the plurality of components shown in the first visual information with each of the plurality of components shown in the second visual information, and generating the third visual information. 10. The work support device according to claim 1 or 2. (Appendix 5) The control unit adding the same identification information to parts that are identified as being identical between each of the plurality of parts shown in the first visual information and each of the plurality of parts shown in the second visual information, thereby associating each of the plurality of parts shown in the first visual information with each of the plurality of parts shown in the second visual information, and generating the third visual information. 10. The work support device according to claim 1 or 2. (Appendix 6) The control unit generating a video showing an action of superimposing one of the plurality of parts identified as being identical on another of the plurality of parts shown in the first visual information and the plurality of parts shown in the second visual information, thereby associating each of the plurality of parts shown in the first visual information with each of the plurality of parts shown in the second visual information, and generating the third visual information; 10. The work support device according to claim 1 or 2. (Appendix 7) the first visual information is a moving image, the control unit controls, when the component shown in the first visual information moves, the identification information assigned to the component shown in the first visual information to also move in accordance with the movement of the component. 3. The work support device according to claim 2. (Appendix 8) The first visual information is at least one still image or video image captured by a worker operating a camera. 8. A work support device according to any one of Supplementary notes 1 to 7. (Appendix 9) The control unit Get the target process ID that represents the current process, acquiring the process information from a process information storage unit that stores process information in which a process ID for identifying an assembly process of the product and a part ID for identifying a part used in the process are associated with each other; determining whether or not all of the components corresponding to the component IDs associated with the process ID corresponding to the target process ID are shown in the first visual information; When at least one of the components corresponding to the component ID is not shown in the first visual information, displaying information on the display unit that prompts the user to acquire the first visual information again. A work support device according to any one of Supplementary notes 1 to 8. (Appendix 10) The control unit When at least one of the components corresponding to the component ID is not shown in the first visual information, displaying information on the display unit to prompt the user to rearrange the components and to reacquire the first visual information. 10. The work support device according to claim 9. (Appendix 11) The control unit Get the target process ID that represents the current process, acquiring the process information from a process information storage unit that stores process information in which a process ID for identifying an assembly process of the product and a part ID for identifying a part used in the process are associated with each other; The process information includes a part ID corresponding to a semi-finished product generated during assembly of the product, determining whether a semi-finished product corresponding to the part ID associated with the process ID corresponding to the target process ID is shown in the first visual information; When the semi-finished product corresponding to the part ID is not shown in the first visual information, information indicating that the assembly procedure up to now may be incorrect is displayed on the display unit. The work support device according to any one of Supplementary notes 1 to 10. (Appendix 12) acquiring first visual information representing still images or moving images of parts used in assembling a product, and second visual information representing still images or moving images representing an assembly procedure for the product; displaying, on a display unit, third visual information which is a still image or a moving image in which the component shown in the first visual information and the component shown in the second visual information are associated with each other; A work support method in which processing is performed by a computer. (Appendix 13) acquiring first visual information representing still images or moving images of parts used in assembling a product, and second visual information representing still images or moving images representing an assembly procedure for the product; displaying, on a display unit, third visual information which is a still image or a moving image in which the component shown in the first visual information and the component shown in the second visual information are associated with each other; A work support program that causes a computer to execute a process. [Explanation of symbols]

[0071] 10 Work support system 12 Camera 14 Work support devices 16 Display device 18 Acquisition Department 20 Identification unit 22 Control Unit 30 Process information storage section 32 Part information storage unit 34 Information storage section 36 Work instruction information storage unit

Claims

1. an acquisition unit that acquires first visual information representing still images or moving images of parts used in assembling a product, and second visual information representing still images or moving images representing an assembly procedure of the product; a control unit that causes a display unit to display third visual information, which is a still image or a moving image in which the component shown in the first visual information and the component shown in the second visual information are associated with each other; A work support device comprising:

2. The image processing device further includes an identification unit that identifies a component that appears in a still image or a moving image, the control unit generates the third visual information by associating the identification result of the component shown in the first visual information obtained by the identification unit with the identification result of the component shown in the second visual information obtained by the identification unit or with identification information previously added to the component shown in the second visual information, and causes the display unit to display the third visual information. The work support device according to claim 1 .

3. The control unit and generating the third visual information by associating each of the plurality of parts shown in the first visual information with each of the plurality of parts shown in the second visual information by adding the same color to parts that are identified as being the same between each of the plurality of parts shown in the first visual information and each of the plurality of parts shown in the second visual information. The work support device according to claim 1 or 2.

4. The control unit adding a line connecting each of the plurality of components shown in the first visual information and each of the plurality of components shown in the second visual information that is identified as being identical, thereby associating each of the plurality of components shown in the first visual information with each of the plurality of components shown in the second visual information, and generating the third visual information. The work support device according to claim 1 or 2.

5. The control unit adding the same identification information to parts that are identified as being identical between each of the plurality of parts shown in the first visual information and each of the plurality of parts shown in the second visual information, thereby associating each of the plurality of parts shown in the first visual information with each of the plurality of parts shown in the second visual information, and generating the third visual information. The work support device according to claim 1 or 2.

6. The control unit generating a video showing an action of superimposing one of the plurality of parts identified as being identical between each of the plurality of parts shown in the first visual information and each of the plurality of parts shown in the second visual information onto the other of the plurality of parts identified as being identical, thereby associating each of the plurality of parts shown in the first visual information with each of the plurality of parts shown in the second visual information, and generating the third visual information; The work support device according to claim 1 or 2.

7. the first visual information is a moving image, The control unit controls the identification information assigned to the part shown in the first visual information to move in accordance with the movement of the part when the part shown in the first visual information moves. The work support device according to claim 2 .

8. The first visual information is at least one still image or moving image captured by a worker operating a camera. The work support device according to claim 1 or 2.

9. The control unit Obtain a target process ID that represents the current process, acquiring the process information from a process information storage unit that stores process information in which a process ID for identifying an assembly process of the product and a part ID for identifying a part used in the process are associated with each other; determining whether all of the components corresponding to the component IDs associated with the process ID corresponding to the target process ID are shown in the first visual information; When at least one of the components corresponding to the component ID is not shown in the first visual information, displaying information on the display unit that prompts the user to acquire the first visual information again. The work support device according to claim 1 or 2.

10. The control unit When at least one of the components corresponding to the component ID is not shown in the first visual information, displaying information on the display unit that prompts the user to rearrange the components and information that prompts the user to acquire the first visual information again. The work support device according to claim 9.

11. The control unit Obtain a target process ID that represents the current process, acquiring the process information from a process information storage unit that stores process information in which a process ID for identifying an assembly process of the product and a part ID for identifying a part used in the process are associated with each other; The process information includes a part ID corresponding to a semi-finished product generated during assembly of the product, determining whether a semi-finished product corresponding to the part ID associated with the process ID corresponding to the target process ID is shown in the first visual information; When the semi-finished product corresponding to the part ID is not shown in the first visual information, information indicating that the assembly procedure up to now may be incorrect is displayed on the display unit. The work support device according to claim 1 or 2.

12. acquiring first visual information representing still images or moving images of parts used in assembling a product, and second visual information representing still images or moving images representing an assembly procedure for the product; displaying, on a display unit, third visual information which is a still image or a moving image in which the component shown in the first visual information and the component shown in the second visual information are associated with each other; A work support method in which processing is performed by a computer.

13. acquiring first visual information representing still images or moving images of parts used in assembling a product, and second visual information representing still images or moving images representing an assembly procedure for the product; displaying, on a display unit, third visual information which is a still image or a moving image in which the component shown in the first visual information and the component shown in the second visual information are associated with each other; A work support program that causes a computer to execute a process.

Images