Work Support System

Abstract

To provide a work assistance system with which it is possible to carry out work while receiving work assistance without a worker changing the line of sight from a work position.SOLUTION: A work assistance system 10 comprises: an information projection device 20 for projecting information onto a workpiece; a storage unit 42 for storing area division information in which the workpiece is divided into a plurality of areas on the basis of the content of work carried out upon the workpiece and work content information associated to each area; and a projection information control unit 48 for controlling the information projection device on the basis of the information stored in the storage unit so as to project the work content information and the area division display body associated with each of the divided areas.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a work support system, and more particularly to a work support system that supports work by projecting work content information onto a workpiece using an information projection device. [Background technology]

[0002] 2. Description of the Related Art In a product production line, various measures are taken to prevent the occurrence of operational mistakes when workers assemble products.

[0003] As one such measure, a system is known that supports workers in assembling product components by displaying the tools and work procedures to be used for the assembly work on a display installed at the work site.

[0004] For example, Patent Document 1 discloses a work support system that displays work content on the display of a personal computer installed at a work site. This work support system includes a first database storing information on the model and type of product and components, a second database storing information on work procedures and tools used in the work when manufacturing each product, a third database storing image diagram data of the tools, a fourth database storing image diagram data of the entire product, a work instruction information generating unit, an input device, and a display. In this system, when a worker inputs information specifying a product using the input device, the work instruction information generating unit generates work instruction information indicating the work procedures of the product from the data stored in each database based on the input information. The generated information is displayed on a display installed at the work site.

[0005] In the work support system described in Patent Document 1, a worker uses the tools shown on the display and performs work according to the displayed work procedures, thereby reducing the occurrence of work errors caused by the worker using the wrong tools or following the wrong procedures. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 9-262745 Summary of the Invention [Problem to be solved by the invention]

[0007] However, when the information on the work content is displayed on the display, the worker's line of sight moves between the workpiece and the display during the work, and while looking at the display, the worker's line of sight moves away from the work position. When the worker's line of sight moves in this way, there is a problem that the worker cannot concentrate on the work. In particular, when there are multiple work positions dispersed for one workpiece, it takes time to understand where the work position displayed on the display is on the workpiece, and further, when different work is performed for each work position, it is difficult to understand the new work content while moving the line of sight.

[0008] Therefore, when an inexperienced worker looks at the display, he or she is unable to concentrate on the task at hand and is more likely to make mistakes, and when the gaze is focused on the work position, the information on the display is overlooked. Also, experienced workers tend to perform the work by following the procedures they have memorized without looking at the display, which raises concerns that mistakes may occur due to assumptions.

[0009] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a work assistance system that allows a worker to perform work while receiving work assistance without having to move his or her eyes from the work position. [Means for solving the problem]

[0010] In order to achieve the above object, a work support system according to one embodiment of the present invention includes an information projection device that projects information onto a workpiece, a memory unit that stores area division information in which the workpiece is divided into a plurality of areas based on work content to be performed on the workpiece and work content information associated with each area, and a projection information control unit that controls the information projection device to project, for each divided area, the work content information and an area division display associated with that area based on the information stored in the memory unit; an imaging device that images the workpiece and a worker; and an area selection unit that selects one area from the plurality of areas based on a pointing action of the worker at the workpiece included in the imaging data acquired by the imaging device, wherein the projection information control unit controls the information projection device to project the work content information onto each of the areas in a preset order, and when an area is selected by the area selection unit, to project the work content information associated with the selected area regardless of the preset order. It is characterized by:

[0011] According to this configuration, the information projection device can project information on the work content to be performed in one of the areas into which the work object is divided and an area division display body, so that the worker can easily recognize that the area on the work object where the work content information is projected is the work position, and can perform the work while visually checking the work content projected in this area. As a result, even if there are multiple work positions within the work object, the worker can receive work support without taking his / her eyes off the work position, and the occurrence of work errors can be effectively prevented. Furthermore, with this configuration, the worker can specify the area on the workpiece where work will be performed and have information about the work to be performed projected onto that area, and after the work is completed, the work content information can be reprojected onto the area specified by the worker to check the work content, thereby more effectively preventing work errors. Furthermore, with this configuration, the worker can specify an area on the workpiece with a simple action of pointing.

[0012] In addition, one embodiment of the present invention is characterized in that in the work support system, the area division information divides the workpiece into multiple areas where work actions by workers are common, or in the order in which the work is performed.

[0013] With this configuration, when the information projection device projects work content information onto an area on the workpiece, the worker can instantly identify areas where work actions are common or areas where work is performed in a specified order.

[0014] In addition, in one embodiment of the present invention, in the work support system, the area division information divides the workpiece into a plurality of areas in which a work operation is common, and further divides the area into each of the areas when a predetermined work operation is repeated in different parts of the area, The projection information control unit projects the work content information for each of the body parts in the order in which the work is performed in an area where the predetermined work operation is repeated.

[0015] According to this configuration, when a worker repeatedly performs a given work action on different parts in a common area, the work content information is projected for each part in the order in which the work is performed, so that the worker can be assisted in performing the work in the correct order. This allows the worker to be guided to assemble the parts in the correct order, for example, in cases where a machining error occurs due to assembling parts in the wrong order.

[0020] Moreover, one embodiment of the present invention is characterized in that, in the work support system, an imaging device that images the work piece and a worker, and a judgment unit that, when the work content information is projected by the information projection device, judges whether or not the area onto which the work content information is projected matches the area where the worker is performing work, based on data acquired by the imaging device, and the projection information control unit projects information on the work piece to notify of the mismatch when the judgment unit determines that there is a mismatch when the work content information is projected onto each area in a predetermined order.

[0021] According to this configuration, in a situation where work content information is projected onto each area in a predetermined order, if the area onto which the work content information is projected does not match the area in which the worker is performing the work, the worker can be notified of this and urged to perform the work in the area onto which the information is projected.

[0022] Moreover, one embodiment of the present invention is characterized in that, in the work support system, the projection information control unit changes the color display projected by the information projection device when the handled parts and / or work actions included in the work content information are different.

[0023] According to this configuration, the worker can easily recognize that the parts being handled or the work actions have changed during work by changing the color display projected by the information projection device, so that work errors can be more effectively prevented. Effect of the Invention

[0024] According to the work support system of the present invention, information about the work to be performed in one of the multiple areas into which the workpiece is divided and an area division display are projected onto that area, allowing the worker to perform the work while receiving work support without moving his or her eyes from the work position. [Brief description of the drawings]

[0025] [Figure 1] 1 is a schematic explanatory diagram of a work support system according to an embodiment of the present invention; [Diagram 2] FIG. 1 is a block diagram showing a configuration of a work support system. [Diagram 3] 1 is a diagram illustrating an example in which a plurality of connecting rods, which are engine components, are divided into a plurality of portions. FIG. [Figure 4] 4 is a flowchart illustrating a control process executed by a control device in the work assistance system. [Diagram 5] FIG. 13 is a block diagram showing a configuration of a work support system according to another embodiment. [Figure 6] FIG. 2 is a schematic explanatory diagram similar to FIG. 1, showing a modified example of the work support system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] Fig. 1 is a schematic explanatory diagram of a work support system 10 according to an embodiment of the present invention, and Fig. 2 is a block diagram showing the configuration of the work support system 10. The work support system 10 is a system that supports a worker 12 in work by projecting information about work content onto a workpiece using an information projection device 20. In the example shown in Fig. 1, an engine component 14 that constitutes an engine to be mounted on a vehicle is described as an example of the workpiece.

[0027] The work support system 10 of this embodiment includes an information projection device 20 capable of projecting information onto the engine component 14, an imaging device 30 capable of imaging the worker 12 and the engine component 14 placed on the workbench 13, and a control device 40 electrically connected to these devices.

[0028] The information projection device 20 has a function of projecting electronic information (such as character information and image information) transmitted from the control device 40 as an image on an object. As the information projection device 20, for example, a projector such as a DLP (Digital Light Processing) projector or a liquid crystal projector can be used. The work assistance system 10 uses the information projection device 20 and the control device 50 to project an image not only on a flat screen but also on a curved surface or the surface of a three-dimensional object, that is, a so-called projection mapping technology, to project work content information such as tools used when assembling the engine and the procedure of the assembly work on the surface of the engine component 14, which is a three-dimensional object.

[0029] 1, one projector is used as the information projection device 20, but the number of projectors may be two or more. In FIG. 1, an information projection area 22 onto which information is projected by the information projection device 20 is indicated by a two-dot chain line. The information projected by the information projection device 20 is controlled by a projection information control unit 48 of the control device 40.

[0030] The imaging device 30 is capable of capturing images, and for example, a camera capable of capturing video images can be used. In this embodiment, a stereo camera that simultaneously captures images of the area to be captured from two different directions is used as the imaging device 30, and the stereo camera makes it possible to measure the distance to the object. The imaging device 30 is installed at a position in the work site where it can capture images of the engine component 14, which is the object to be processed, and the worker 12 performing work on the engine component 14.

[0031] The imaging device 30 may be installed at a position where it can image at least the hand movements of the worker 12 performing the work together with the engine components 14, but it is preferable that it is installed at a position where it can image the engine components 14 and the surrounding work area so that it can image the posture of the worker 12 during work. In this embodiment, as shown in Fig. 1, the imaging device 30 is installed so that the information projection area 22 by the information projection device 20 and the surrounding area are included within the imaging range of the imaging device 30.

[0032] The control device 40 is a calculator including a microcomputer, and is configured to have an information processing unit such as a central processing unit (CPU) or an application specific integrated circuit (ASIC), a storage unit such as a RAM or a ROM, etc. The control device 40 functions as various function realization units (e.g., a control unit, a calculation unit, a processing unit, etc.) by the central processing unit reading and executing a program recorded in the storage unit. As shown in FIG. 2, the control device 40 of this embodiment includes an information input unit 41, a storage unit 42, an area selection unit 46, an operation completion determination unit 47, and a projection information control unit 48.

[0033] The information input unit 41 of the control device 40 is, for example, a keyboard, a mouse, a touch panel, an input connection unit with other devices, etc., which allows information to be input to the control device 40. The information input via the input unit 41 can be stored in the storage unit 42 or processed by a data processing unit.

[0034] The storage unit 42 of the control device 40 stores programs for executing various processes, and also stores data related to the information projected by the information projection device 20. In this embodiment, the storage unit 42 includes a divided area storage unit 42A and a task content storage unit 42B. Each piece of information in the divided area storage unit 42A and the task content storage unit 42B can be set via the information input unit 41.

[0035] The divided area storage unit 42A stores area division information in which the engine component 14 is divided into a plurality of areas based on the work content performed on the engine component 14. In the area division information, the work content that serves as a criterion for dividing the area may be, for example, dividing into a plurality of areas based on the work actions performed by workers, dividing into a plurality of areas based on the order in which the work is performed, or dividing into a plurality of areas based on the use of common tools.

[0036] In this embodiment, the engine component 14 is divided into a plurality of areas where work actions are common. As an example of an area where work actions are common included in the area division information, in Fig. 1, an oil wiping area 24 where oil wiping work is performed is dotted in the engine component 14. Furthermore, in this embodiment, the area division information includes divided part information that divides the area into parts where the predetermined work actions are performed when a predetermined work action is repeated in different parts within the area where the work actions are common.

[0037] FIG. 3 shows a plurality of connecting rods 16, which are engine components 14, as an example of a case in which a predetermined work operation is repeated at different locations in a common work area. A plurality of connecting rods 16-1, 16-2, 16-3, and 16-4 are arranged side by side on a pallet 15. The worker 12 attaches a corresponding semicircular connecting rod metal (not shown) to a semicircular surface 16a of each connecting rod 16. Note that in FIG. 2, dots are added to the surface 16a of the first connecting rod 16 for ease of understanding. In this way, when the attachment work is repeatedly performed at different locations in one area, the divided area storage unit 42A stores each connecting rod 16 as divided location information.

[0038] The work content storage unit 42B stores information on the work content to be performed in each area divided by the divided area storage unit 42A as work content information in association with each area. The work content information stored in the work content storage unit 42B includes data such as the order of work in each area, parts and tools used in each area, and the work content and work procedures of each area performed during engine assembly work.

[0039] The projection information control unit 48 controls the information projection device 20 to project work content information associated with each divided area onto the engine component 14 based on the information stored in the storage unit 42. The projection information control unit 48 allows the information projection device 20 to project a frame (area division display body) dividing the area together with the work content information onto the engine component 14.

[0040] Furthermore, when divided part information is set in the divided area storage unit 42A in an area defined by the area division information, the projection information control unit 48 projects work content information for each divided part in the order in which the work is performed in the area. For example, in the example shown in Fig. 3, the information projection device 20 is controlled so that work content information is projected in the order of the first connecting rod 16-1, the second connecting rod 16-2, the third connecting rod 16-3, and the fourth connecting rod 16-4 from the right side to the left side in Fig. 3.

[0041] Furthermore, the projection information control unit 48 of this embodiment controls the information projection device 20 to change the projected color display when the handled parts and / or work actions included in the work content information are different. For example, when several types of bolts are used in a specific work area, the color indicating the bolts can be changed every time the type of bolt is changed. Also, the color display indicating the work content can be changed between the work of installing parts on the engine component 14 and the work of wiping off oil.

[0042] The area selection unit 46 selects one area from the multiple areas defined by the area division information, based on a predetermined movement or a predetermined posture of the worker 12 with respect to the engine component 14 included in the imaging data acquired by the imaging device 30. The area selection unit 46 can select one area from the multiple areas by, for example, selecting the area at the point of the worker 12's pointing motion, selecting an area based on the orientation of the worker 12's body and the direction of his / her line of sight, or selecting an area based on the position of the worker 12's hand with respect to the engine component 14.

[0043] The area selecting unit 46 in this embodiment selects an area based on a pointing gesture by the worker 12. In the following description, the pointing gesture by the worker 12 that allows the area selecting unit 46 to select an area is referred to as a predetermined area selecting gesture.

[0044] When one area is selected by the area selection unit 46, the projection information control unit 48 causes the information projection device 20 to project the task content information associated with the area selected by the area selection unit 46.

[0045] The work completion determination unit 47 determines that the work is completed when a predetermined condition is satisfied. In this embodiment, the work completion is determined when the projection of the work content information is completed for all divided areas.

[0046] Next, the process executed by the control device 40 in the work support system 10 of this embodiment will be described with reference to FIG.

[0047] When the work support system 10 is started, the control device 40 acquires imaging data from the imaging device 30 (step S11). Next, the area selection unit 46 selects one area from the multiple areas stored in the divided area storage unit 42A based on a predetermined area selection action of the worker 12 included in the imaging data (step S12). The projection information control unit 48 causes the information projection device 20 to project work content information associated with the selected area (step S13).

[0048] When the information projection for the selected area is completed, the work completion determination unit 47 determines whether the work completion condition is met (step S14), and if the condition is met and it is determined that the work is completed (step S14: Yes), the process ends. If the work completion condition is not met (step S14: No), that is, if there is an area for which the projection of work content information has not been completed, information instructing area selection is displayed on the engine component 14 (step S15). Then, the process proceeds to step S12 and continues thereafter.

[0049] In the work assistance system 10 of this embodiment, the engine component 14 is divided into a plurality of areas, and the information on the work content to be performed in that area can be projected onto one of the areas, so that the worker 12 can easily recognize the area onto which the work content information is projected as the work position relative to the engine component 14. In addition, the worker 12 can perform work while visually checking the work content projected onto this area. This allows the worker 12 to receive work assistance at each work position without taking his or her eyes off the work position, effectively preventing the occurrence of work errors.

[0050] In addition, in this work support system 10, the engine component 14 is divided into multiple areas where the work actions of the worker 12 are common, so the worker 12 can instantly identify the area where the work actions are common when work content information is projected onto one area on the engine component 14. This also makes it easy to understand the work area and its action content.

[0051] In addition, in this work assistance system 10, when a worker repeatedly performs a given work action on different parts in an area where the work actions are common, work content information is projected for each part in the order in which the work is performed, so that work assistance can be provided so that the work is performed in the correct order. For example, when the same parts are to be attached to multiple different parts, getting the parts attached in the wrong order can lead to large processing errors and defective products, but by projecting work content information on each part in the order in which the parts are attached correctly, the worker 12 can be guided to attach the parts in the correct order.

[0052] Furthermore, in the work support system 10 of this embodiment, the work content information is projected onto the area selected by the area selection unit 46, so that the worker 12 can specify the area where the work will be performed by pointing, and the work content information to be performed can be projected onto the specified area. Furthermore, after the work is completed, the work content information can be reprojected onto the area specified by the worker 12 to check the work content. In this way, projecting information onto the area specified by the worker 12 can more effectively prevent work errors. Furthermore, in this embodiment, the area can be specified by the simple action of the worker 12 pointing.

[0053] Furthermore, the projection information control unit 48 changes the color display projected by the information projection device 20 when the parts being handled and / or work actions included in the work content information are different. Therefore, the worker 12 can easily recognize that the parts being handled or work actions have changed during work by seeing the change in the projected color display.

[0054] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the invention.

[0055] For example, the work support system 10 according to the present invention may be configured such that the projection information control unit 48 projects the work content information onto each area in a preset order. In such a case, the system may be configured not to include the area selection unit 46. In the case where the area selection unit 46 is included, in a situation where the work content information is projected onto each area according to a preset order, if an area is selected by the area selection unit 46, the work content information can be projected onto the selected area regardless of the preset order. After the work content information has been projected onto the selected area, the system returns to the preset order and projectes the work content information onto areas in order starting from areas where the projection of the work content information has not been completed.

[0056] Furthermore, the work support system 10 according to the present invention may further be configured such that the control device 40 includes a determination unit 44 that determines whether or not the area onto which the work content information is projected coincides with the area in which the worker 12 is performing the work, as in another embodiment shown in FIG.

[0057] In a situation where the work content information is projected onto each area in a preset order by the projection information control unit 48 (i.e., in a situation where no area selection is performed by the area selection unit 46), the determination unit 44 identifies an area where the worker 12 is performing work from among the multiple areas based on the imaging data acquired by the imaging device 30, and determines whether or not the identified work area matches the area onto which the work content information is projected by the information projection device 20. The determination unit 44 can identify one work area from the multiple areas by, for example, identifying the work area from the orientation of the body and the direction of the line of sight of the worker 12, identifying the work area from the position of the hands of the worker 12 relative to the engine component 14, etc.

[0058] When the determination unit 44 determines that the areas are inconsistent, the projection information control unit 48 causes the information projection device 20 to project information notifying the inconsistency onto the engine component 14. The information notifying the inconsistency can be, for example, a blinking display of the entire engine component 14, or a warning display in the identified work area.

[0059] In a work support system 10 equipped with a judgment unit 44, in a situation where work content information is projected onto each area in a preset order, if the area onto which the work content information is projected does not match the area in which the worker 12 is performing the work, the worker 12 is notified of this and is prompted to perform the work in the area onto which the information is projected.

[0060] Furthermore, the work support system 10 according to the present invention can be configured to display frames dividing areas on the engine component 14 by the information projection device 20. Fig. 6 shows an example in which a lattice-shaped frame 26 dividing the engine component 14 into a plurality of areas is projected onto the engine component 14. The information projection device 20 can project work content information for each area divided by the frame 26. In the example shown in Fig. 6, work content information is projected onto an area 27 designated by the worker 12 through a pointing motion.

[0061] In the work support system 10 according to the present invention, the information projection device 20 is not limited to a projector, and may be any device capable of visually projecting information onto the workpiece. For example, the information projection device 20 may be a transmissive display device that projects information such as an image onto a transparent or semi-transparent transmissive display installed between the worker 12 and the workpiece. The transmissive display device may be, for example, a glasses-type wearable terminal such as smart glasses for augmented reality. When smart glasses are used as the information projection device, the worker can view the workpiece through glasses-type lenses (i.e., a transmissive display) while wearing the smart glasses, and further, the work content information can be displayed on the lens in AR (Augmented Reality) so as to be superimposed on the workpiece. [Explanation of symbols]

[0062] 10 Work Support System 12 Workers 14 Engine components (objects to be processed) 20 Information projection device 30 Imaging device 40 Control device 42 Storage section 44 Judgment section 46 Area Selection Section 48 Projection information control unit

Claims

1. an information projection device that projects information onto the object to be processed; a storage unit that stores area division information obtained by dividing the object into a plurality of areas based on work content to be performed on the object, and work content information associated with each area; a projection information control unit that controls the information projection device to project, for each of the divided areas, the task content information and an area division display body associated with the area based on the information stored in the storage unit; an imaging device for imaging the object to be processed and a worker; an area selection unit that selects one area from the plurality of areas based on a pointing gesture by the worker with respect to the workpiece included in the imaging data acquired by the imaging device, a projection information control unit that controls the information projection device to project the work content information onto each of the areas in a predetermined order, and when an area is selected by the area selection unit, to project the work content information associated with the selected area onto the selected area regardless of the predetermined order.

2. The work support system according to claim 1, characterized in that the area division information divides the workpiece into a plurality of areas in which work actions are common to the workers or in the order in which the work is performed.

3. The area division information divides the workpiece into a plurality of areas in which a work operation is common, and further divides the area into each of the areas when a predetermined work operation is repeated in different parts of the area; The work support system according to claim 2 , wherein the projection information control unit projects the work content information for each part in the order in which the work is performed in an area where the specified work operation is repeated.

4. A determination unit that, when the work content information is projected by the information projection device, determines whether or not an area onto which the work content information is projected coincides with an area where the worker is performing work, based on data acquired by the imaging device; The work support system according to any one of claims 1 to 3, characterized in that, when the work content information is projected onto each area in a preset order and the determination unit determines that there is a mismatch, the projection information control unit projects information notifying the mismatch onto the work piece.

5. The work support system according to any one of claims 1 to 4, characterized in that the projection information control unit changes the color display projected by the information projection device when the handling parts and / or work actions included in the work content information are different.

Images