Workpiece management apparatus and workpiece management method

Abstract

To provide a technique effective in simple acquisition of management information of a plurality of kinds of workpieces without omission.SOLUTION: A workpiece management apparatus 101 includes: a camera 21 for imaging; a monitor 22 which can display a three-dimensional real image Mb captured by the camera 21; a control unit 40; and a memory 50 storing three-dimensional master images of a plurality of kinds of workpieces W and a plurality of pieces of management information associated with the plurality of kinds of workpieces, respectively. The control unit 40 includes: an image processing unit which performs shape fitting processing of superimposing a master image read from the memory 50 on a real image Mb to be managed in a state where an arbitrary management target is displayed on the monitor 22; and a management information output unit which reads, from the memory 50, management information according to a selection operation on the monitor 22 of plurality of pieces of management information associated with the management target displayed on the monitor 22, and outputs it to the monitor 22.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a work management device and a work management method for managing works. [Background technology]

[0002] Conventionally, automobile manufacturers may assign personnel to each type of product and each phase, such as the design stage, production preparation stage, and mass production stage. For example, if different personnel are assigned to the production preparation stage and mass production stage of a certain product, the management information for each process must be handed over between the personnel. The management information includes not only information about the product itself, but also information about various production tools used to produce the product, as well as various other information such as standards and regulations.

[0003] The management information is stored in advance in a data server. For example, according to the mold electronic chart system described in the following Patent Document 1, management information such as defects during mold manufacturing is recorded using the photo function, video recording function, and audio recording function of an electronic device such as a smartphone or tablet, and transmitted to the data server. Therefore, the person in charge can read and view the management information from the database stored in the data server. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-179348 A Summary of the Invention [Problem to be solved by the invention]

[0005] If management information is read and viewed from a database stored in a data server, as in the mold electronic chart system of Patent Document 1, there is a concern that there will be omissions and other imperfections in the information that should be handed over between personnel. In addition, when a person in charge changes, it is expected that the successor will not be able to find the desired information, such as past knowledge, from the vast amount of data stored in the data server. In this case, it will be difficult for the person in charge to easily obtain the desired information without omissions and use it in the work of each phase.

[0006] The present invention has been made in consideration of the above problems, and aims to provide an effective technique for easily acquiring management information for multiple types of work without any omissions. [Means for solving the problem]

[0007] One aspect of the present invention is A work management device for managing a plurality of types of work, A camera for taking pictures, A monitor capable of displaying a three-dimensional actual image captured by the camera; A control unit that controls the camera and the monitor; A storage unit that stores three-dimensional master images of the plurality of types of workpieces and a plurality of pieces of management information associated with the plurality of types of workpieces, The control unit is an image processing unit that performs a shape fitting process of superimposing the master image read from the storage unit onto the actual image of any one of the plurality of types of workpieces that is to be managed while the workpiece is being displayed on the monitor; a management information output unit that reads out from the storage unit management information corresponding to a selection operation on the monitor from among the plurality of pieces of management information associated with the managed object displayed on the monitor, and outputs the management information to the monitor; A work management device having is located.

[0008] Another aspect of the present invention is A work management method using the work management device of the above aspect, an imaging step of imaging the management object with the camera; an image processing step of performing a shape fitting process of superimposing the master image read from the storage unit onto the actual image of the managed object while the managed object is displayed on the monitor in the photographing step; a management information output step of reading out from the storage unit management information corresponding to a selection operation on the monitor from among the plurality of pieces of management information associated with the managed object displayed on the monitor, and outputting the management information to the monitor; A work management method comprising: is located. Effect of the Invention

[0009] According to each of the above-mentioned aspects, a shape fitting process is performed in which a master image is superimposed on an actual image of an arbitrary managed object among a plurality of types of workpieces while the managed object is displayed on a monitor. After that, desired management information according to a selection operation on the monitor by a user is output to the monitor. Therefore, the user can easily visualize the desired management information by accurately displaying it on the monitor by simply taking a picture of the managed object using the camera of the mobile terminal and then selecting the managed object on the monitor.

[0010] As described above, according to the above-mentioned aspect, it is possible to provide a technique that is effective for easily acquiring management information for multiple types of work without any omissions. [Brief description of the drawings]

[0011] [Figure 1] 4A and 4B are diagrams illustrating a state in which a management target is photographed using a mobile terminal of the work management apparatus according to the first embodiment. [Diagram 2] FIG. 2 is a system configuration diagram of the mobile terminal in FIG. [Diagram 3] FIG. 3 is a system configuration diagram of a control unit of the mobile terminal of FIG. 2. [Figure 4] 3 is a flowchart of a work management method according to the first embodiment. [Diagram 5] FIG. 13 is a diagram showing an example of a database of managed object names and master images. [Figure 6] FIG. 5 is a diagram for explaining the shape fitting process in FIG. 4 . [Figure 7] FIG. 4 is a diagram showing an example of management information output to a monitor of a mobile terminal in the first embodiment. [Figure 8] FIG. 11 is a diagram showing a state in which a management target is photographed using a mobile terminal of the work management device of the second embodiment. [Figure 9] 10 is a flowchart of a work management method according to a second embodiment. [Figure 10] FIG. 11 is a diagram showing an example of management information output to a monitor of a mobile terminal in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Preferred embodiments of the above aspects are described below.

[0013] In the work management device of the above aspect, it is preferable that individual identification information is attached to the work, and the image processing unit refers to the individual identification information included in the actual image when the camera captures the managed object in the shape fitting process. According to this work management device, the shape fitting process is performed using the individual identification information attached to the work. Therefore, it is possible to improve the accuracy of identifying a master image that matches the actual image during the shape fitting process.

[0014] In the workpiece management device of the above aspect, the workpiece is preferably at least one of a product and a production jig used in the production process of the product. With this workpiece management device, when managing multiple types of products or multiple types of production jigs, it is possible to easily obtain management information of the managed objects without any omissions.

[0015] In the work management device of the above aspect, it is preferable that the camera, the monitor, and the control unit are incorporated in one mobile terminal. With this work management device, by using a mobile terminal that is easy to carry and has excellent operability, it is possible to easily and quickly visualize the work management information.

[0016] In the above-described workpiece management method, it is preferable that individual identification information is attached to the workpiece, and the individual identification information included in the actual image when the managed object is photographed by the camera is referenced in the shape fitting process. According to this workpiece management method, the shape fitting process is performed using the individual identification information attached to the workpiece. Therefore, it is possible to improve the accuracy of identifying a master image that matches the actual image during the shape fitting process.

[0017] Hereinafter, an embodiment for realizing a management technique for managing a plurality of types of work will be described with reference to the drawings.

[0018] In the drawings for explaining the embodiments, unless otherwise specified, a first direction which is the horizontal direction is indicated by an arrow X, a second direction which is the horizontal direction and perpendicular to the first direction is indicated by an arrow Y, and a third direction which is the vertical direction is indicated by an arrow Z.

[0019] (Embodiment 1) 1. Structure of the work management device 101 In the first embodiment, a work management device (hereinafter, for convenience, simply referred to as a "management device") 101 shown in Fig. 1 is used. This management device 101 is a device for managing a plurality of types of work W, and is configured by one mobile terminal 20. That is, in this embodiment, the mobile terminal 20 substantially corresponds to the management device 101.

[0020] In this embodiment, the workpiece W is an automobile body 1. With respect to this vehicle body 1, the vehicle width direction corresponds to a first direction X, the vehicle length direction corresponds to a second direction Y, and the vehicle height direction corresponds to a third direction Z.

[0021] 1, the mobile terminal 20 is a thin and lightweight information device, and is also called a mobile terminal or a tablet terminal. The mobile terminal 20 is integrally equipped with a camera 21 for photographing, a monitor 22 capable of displaying a three-dimensional actual image Mb photographed by the camera 21, a control unit 40 for controlling the camera 21 and the monitor 22, and a memory 50 serving as a storage unit. The camera 21 is exposed on one surface of the mobile terminal 20 in the thickness direction, and the monitor 22 is exposed on the other surface of the mobile terminal 20 in the thickness direction.

[0022] The camera 21 has a built-in imaging element (not shown) that receives light reflected from the surface of the workpiece W. Typically, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor is used as the imaging element.

[0023] The mobile terminal 20 preferably has a lighting function or a flash function to be used together with the camera 21. This makes it possible to prevent the effects of backlighting and the like from occurring when the camera 21 is in use.

[0024] 2, the mobile terminal 20 incorporates a camera 21, a monitor 22, an image capture board 30, a control unit 40, a memory 50, a graphic memory 51, and a communication unit 52. The mobile terminal 20 is provided with a user interface (e.g., a mouse, a keyboard, a touch panel, a touch pad, etc.) that is operated by a user. An input operation through the user interface is converted into an electrical signal and input to the control unit 40.

[0025] The image capture board 30 has a function of outputting image information transmitted from the camera 21 to the control unit 40. The image capture board 30 is provided with an input unit 31 and a frame buffer 32. The input unit 31 acquires image information transmitted from the camera 21 and outputs it to the frame buffer 32. The frame buffer 32 converts the image information output from the input unit 31 into a data format that allows the control unit 40 to execute various processes. The frame buffer 32 stores the image information after the data format is converted and outputs it to the control unit 40. Note that, although the present embodiment illustrates a case in which the image capture board 30 is built into the mobile terminal 20, the image capture board 30 may be separate from the mobile terminal 20 as long as it is capable of communicating with the control unit 40.

[0026] The control unit 40 is a processor configured using, for example, a CPU (Central Processing Unit), a DSP (Digital Signal Processor) or an FPGA (Field-Programmable Gate Array), and has a function of controlling the operation of each part of the mobile terminal 20. The control unit 40 performs various processes and controls in cooperation with the memory 50. Specifically, the control unit 40 refers to the programs and data stored in the memory 50 and executes the programs to realize the functions of each part. The control unit 40 is capable of transmitting and receiving data to and from an external database 60 via the communication unit 52.

[0027] The memory 50 as an example of a storage unit includes, for example, a random access memory (RAM) used when executing each process of the control unit 40, and a read only memory (ROM) that stores a program and data that defines the operation of the control unit 40. The RAM temporarily stores data or information generated or acquired by the control unit 40. The ROM has a program that defines the operation of the control unit 40 written therein. The memory 50 stores three-dimensional master images Ma of the multiple types of workpieces W, and multiple pieces of management information R linked to the multiple types of workpieces W. The memory 50 may also store AI software that includes a trained model (not shown) that is used to compare the actual image Mb with the master image Ma.

[0028] The graphic memory 51 is, for example, a VRAM (Video Random Access Memory) and functions as a memory used when executing display processing of an image (screen). The graphic memory 51 executes display processing of an image generated and output by the control unit 40, and displays it on the monitor 22.

[0029] The monitor 22 is configured using a display such as an LCD (Liquid Crystal Display) or an organic EL (electro-luminescence) display. The monitor 22 displays images and the like output from the graphic memory 51. The monitor 22 in this embodiment is configured as a touch panel display that allows a user to perform touch operations.

[0030] 3, the control unit 40 includes an image acquisition unit 41, a master image acquisition unit 42, an image processing unit 43, and a management information output unit 44. The image acquisition unit 41 has a function of acquiring image information (i.e., the actual image Mb captured by the camera 21) from the frame buffer 32. The master image acquisition unit 42 has a function of acquiring a master image Ma read out from the memory 50. The image processing unit 43 has a function of performing a shape fitting process of superimposing the master image Ma acquired by the master image acquisition unit 42 on the actual image Mb acquired by the image acquisition unit 41. The image processing unit 43 also has a function of storing result information of the shape fitting process in the memory 50.

[0031] The management information output unit 44 has a function of outputting a superimposed image in which the master image Ma is superimposed on the actual image Mb to the monitor 22. The management information output unit 44 also has a function of reading out the management information R from the memory 50 in response to a selection operation on the monitor 22 from among the multiple pieces of management information R associated with the managed object displayed on the monitor 22, and outputting the management information R to the monitor 22 via the graphic memory 51.

[0032] 2. Work management method A work management method (hereinafter, for convenience, simply referred to as a "management method") according to the first embodiment will be described with reference to Fig. 4 to Fig. 7. This management method is for managing a management object that is an arbitrary work W among a plurality of types of work W, and the processes from step S101 to step S105 in Fig. 4 are executed in sequence. In this management method, the management device 101 having the above-mentioned configuration is used.

[0033] In the management method of the first embodiment, first, step S101 is executed. Step S101 is a preparatory step for storing three-dimensional master images Ma of multiple types of workpieces W (multiple types of vehicle bodies 1 in this embodiment) in the memory 50. The master images Ma are stored in the memory 50 from an external database 60 via the communication unit 52 and the control unit 40 (see FIG. 2). The master images Ma are model images (reference images) of the workpieces W.

[0034] The management information R for each of the multiple types of workpieces W is stored in the memory 50 at a different time from the master image Ma. For example, after an inspection or testing operation is performed on each workpiece W, the management information R for that workpiece W is input and stored in a database in the memory 50. In addition, result information when a shape fitting process described below is performed is stored in a database in the memory 50 as management information R.

[0035] The management information R includes accuracy information related to "accuracy", defect information related to "defect", adjustment history information related to "adjustment history", and other information related to "other". In a case where the work W is an automobile body 1 as in this embodiment, examples of the accuracy information include the dimensional accuracy of the body 1 and its components, and the installation accuracy of the body 1. Examples of defect information include problems that have occurred in the past with the body 1 and its components at each process. Examples of adjustment history include the adjustment timing and adjustment contents when the body 1 and its components were adjusted in the past at each process. Examples of other information include quality standards used in each process.

[0036] As can be seen from the database of FIG. 5, according to the preparation step S101, the memory 50 stores, for example, a master image Ma_1 of the managed object T-1, a master image Ma_2 of the managed object T-2, a master image Ma_3 of the managed object T-3, and a master image Ma_4 of the managed object T-4.

[0037] Step S102 is a photographing step in which the user photographs the vehicle body 1, which is an arbitrary management target, with the camera 21 of the mobile terminal 20. According to this step S102, the management target is photographed with the mobile terminal 20, for example, in a landscape orientation, as shown in Fig. 1. The user adjusts the orientation of the camera 21 to a desired orientation while checking in real time the actual image Mb displayed on the monitor 22 of the mobile terminal 20. At this time, in order to improve the photographing accuracy of the management target, it is preferable to use a lighting function or a flash function when photographing with the camera 21.

[0038] According to this step S102, an actual image Mb taken when the managed object is photographed by the camera 21 is displayed on the monitor 22 (see FIG. 1). Also, a selection section 23 is displayed on the monitor 22 of the mobile terminal 20 (see FIG. 1). In this embodiment, the selection section 23 includes four selection items 23a, 23b, 23c, and 23d. The first selection item 23a is "Accuracy", the second selection item 23b is "Defect", the third selection item 23c is "Adjustment History", and the fourth selection item 23d is "Other". The types and numbers of these selection items are not particularly limited and can be set as appropriate.

[0039] Step S103 is an image processing step in which a shape fitting process is performed with the managed object displayed on the monitor 22 in step S102. The shape fitting process at this time is a process of superimposing a master image Ma read from the memory 50 on a real image Mb of the managed object while the real image Mb is displayed on the monitor 22 (see FIG. 6). In this embodiment, when the managed object is displayed on the monitor 22, a master image Ma that matches the real image Mb of the managed object is specified and automatically read and displayed on the monitor 22 so as to be superimposed on the real image Mb. This shape fitting process is performed using a known program for AR (augmented reality) stored in the memory 50. Result information of the shape fitting process at this time (for example, positional deviation of components of the vehicle body 1, abnormalities in the external appearance of the vehicle body 1, the presence or absence and positional deviation of attached parts on the vehicle body 1, etc.) is stored in the memory 50.

[0040] Step S104 is a determination step for determining whether or not the user has performed a selection operation (for example, a touch operation of touching the selection unit 23) on the monitor 22 of the mobile terminal 20. In this step S104, if this selection operation has been performed, the process proceeds to step S105.

[0041] 4 is a management information output step of reading out from the memory 50 the management information R corresponding to a selection operation on the monitor 22 from among the multiple pieces of management information R associated with the managed object displayed on the monitor 22, and outputting it to the monitor 22. According to this step S105, the management information R desired by the user is displayed on the monitor 22.

[0042] For a specific example of step S104 and step S105, see Fig. 7. As shown in Fig. 7, when the user selects, for example, selection item 23b (item "Defect") from among four selection items 23a to 23d in selection section 23 displayed on monitor 22, information "Lower back panel misalignment" is output to monitor 22 as management information R of vehicle body 1. This management information R is displayed in a pop-up manner so as to jump out to the foreground of monitor 22.

[0043] If it is found as a result of the shape fitting process in step S103 described above that the actual image Mb of the lower back panel 1a, which is one of the components of the vehicle body 1, is misaligned with respect to the master image Ma, management information R indicating this is temporarily stored in the memory 50. Therefore, on condition that the user selects the selection item 23b of the selection unit 23 on the monitor 22, the management information R is read out from the memory 50 and output to the monitor 22.

[0044] The number of pieces of management information R output to the monitor 22 is not limited, and one or more pieces of management information R can be output to the monitor 22.

[0045] 3. Effects Next, the effects of the above-mentioned embodiment 1 will be described.

[0046] In the first embodiment, a shape fitting process is performed in which a master image Ma is superimposed on an actual image Mb of an arbitrary managed object among a plurality of types of workpieces W, with the arbitrary managed object being displayed on the monitor 22 of the mobile terminal 20. Thereafter, desired management information R according to a selection operation on the monitor 22 by the user is output to the monitor 22. Therefore, the user can easily visualize the desired management information R by accurately displaying it on the monitor 22, simply by photographing the managed object using the camera 21 of the mobile terminal 20 and then performing a selection operation on the managed object on the monitor 22.

[0047] That is, by visually managing the management information R, the user can easily find and intuitively obtain the information he or she wants and the information associated with it. Also, by visually managing the management information R, even a first-time user who is not familiar with information such as the history and cautions of each work W can intuitively know the information, and the management information R can be smoothly handed over to another user without any omissions.

[0048] Since all management information R, such as the production preparation stage and mass production stage of the work W, is operated in a database state, the information the user wants can be output in a simple and visually easy-to-understand format. For example, the user can easily understand the history of a defect that occurred in the production preparation stage or mass production stage of the work W. This allows information such as waiting for adjustment for a defect to be understood in real time, making it possible to prevent overlapping adjustment instructions. In addition, the user can check secondary defects that occurred in response to adjustments made in the past and past adjustment methods, enabling the user to quickly deal with any defects that occur.

[0049] As described above, according to the first embodiment, the management information R of multiple types of workpieces W (multiple types of vehicle bodies 1) can be easily acquired without any omissions.

[0050] Moreover, according to the first embodiment, by using the portable terminal 20 that is easy to carry and has excellent operability, it is possible to easily and quickly visualize the management information of the work W. As long as the portable terminal 20 is prepared, the work W can be managed anywhere, and there is an advantage that no special skills are required.

[0051] In the first embodiment, it is preferable to input a plurality of pieces of management information R about the workpieces W using the camera 21 of the mobile terminal 20 and store them in the memory 50. This allows both input and output of the management information R to be completed by one mobile terminal 20, enabling information sharing. As a result, it is possible to prevent the use of devices other than the mobile terminal 20 and the occurrence of extra work in managing a plurality of types of workpieces W. Alternatively or in addition to this, the plurality of pieces of management information R about the workpieces W may be input into the memory 50 from an external database 60 via the communication unit 52 and the control unit 40.

[0052] Hereinafter, other embodiments related to the above-mentioned embodiment 1 will be described with reference to the drawings. In the other embodiments, the same elements as those in embodiment 1 are given the same reference numerals, and the description of the same elements will be omitted.

[0053] (Embodiment 2) In the second embodiment, a management device 102 shown in Fig. 8 is used. The management device 102 is configured with a mobile terminal 20 similar to the management device 101 of the first embodiment. The specific structure of the mobile terminal 20 is similar to that of the first embodiment (see Figs. 2 and 3).

[0054] In this embodiment, the workpiece W is a production jig 2 used for producing automobile components. With respect to this production jig 2, the short side direction of the main body frame 2c corresponds to the first direction X, the long side direction of the main body frame 2c corresponds to the second direction Y, and the height direction of the main body frame 2c corresponds to the third direction Z.

[0055] In a case where the workpiece W is a production jig 2 as in this embodiment, the accuracy information may include, for example, the dimensional accuracy of the components of the production jig 2. The defect information may include, for example, problems that have occurred in the past with the components of the production jig 2. The adjustment history may include, for example, the timing and content of adjustments when the components of the production jig 2 were adjusted in the past. Other information may include, for example, a construction method manual, an operation standard manual, a spare parts list, etc.

[0056] 8, the production jig 2 is provided with a plurality of pin members 2a for positioning components and a plurality of receiving members 2b for receiving the components. Also, individual identification information 3 is attached to the side of the main body frame 2c of the production jig 2. As the individual identification information 3, for example, an identification code formed by combining a plurality of letters and numbers, or an identification code such as a QR code (registered trademark) can be used.

[0057] In the management method of the second embodiment, the processes from step S201 to step S205 in FIG. 9 are executed in sequence.

[0058] Step S201 is a preparation step for storing in the memory 50 three-dimensional master images Ma of multiple types of workpieces W (multiple types of production jigs 2 in this embodiment), similar to step S101 in the first embodiment.

[0059] Step S202 is an image capturing step in which the user captures an image of a production jig 2, which is an arbitrary management target, with the camera 21 of the mobile terminal 20, as in step S102 in the first embodiment. According to this step S202, as shown in Fig. 8, the management target is captured with the mobile terminal 20 held, for example, in portrait orientation.

[0060] Like step S103 in the first embodiment, step S203 is an image processing step in which, with the managed object displayed on the monitor 22 in step S202, a shape fitting process similar to that in the first embodiment is performed. This step S203 differs from step S103 in the first embodiment in that the individual identification information 3 included in the actual image Mb when the managed object is photographed by the camera 21 of the mobile terminal 20 is referenced in the shape fitting process. By referring to the individual identification information 3, it is possible to improve the accuracy in identifying the master image Ma that matches the actual image Mb in the shape fitting process.

[0061] Step S204 is a determination step for determining whether or not the user has performed a selection operation (for example, a touch operation of touching the selection unit 23) on the monitor 22 of the mobile terminal 20, similar to step S104 in the first embodiment. In this step S104, the process proceeds to step S205 on the condition that the selection operation has been performed.

[0062] Step S205, like step S105 in embodiment 1, is a management information output step in which management information R corresponding to a selection operation on monitor 22 from among multiple management information R linked to the managed object displayed on monitor 22 is read from memory 50 and output to monitor 22.

[0063] For specific examples of steps S204 and S205, see Fig. 10. As shown in Fig. 10, when the user selects, for example, selection item 23a (item "Accuracy") from four selection items 23a to 23d in selection section 23 displayed on monitor 22, three pieces of management information R about the production jig 2 are displayed in a pop-up manner on the front side of monitor 22.

[0064] The first management information R is information about the accuracy of the pin member 2a to which the management number "P01" is assigned. The information "L +3" indicates that the position of the pin member 2a in the third direction Z (see FIG. 8) is shifted, for example, 3 mm upward from the management value. The information "W -10" indicates that the position of the pin member 2a in the first direction X (see FIG. 8) is shifted, for example, 10 mm rightward from the management value. When the positional deviation of the pin member 2a is relatively large, it is preferable to paint and display the entire management information R in an identification color (e.g., red or orange) that is effective in indicating this. This allows the user to easily visually recognize on the monitor 22 that the positional deviation of the pin member 2a is relatively large.

[0065] The second management information R is information about the accuracy of the receiving member 2b to which the management number "U01" is assigned. The information "H -5" indicates that the position of the receiving member 2b in the third direction Z (see FIG. 8) is shifted, for example, 5 mm upward from the management value. If the amount of positional deviation of this receiving member 2b is relatively large, it is preferable to display the entire management information R in a color that is effective in indicating this, as with the first management information R (e.g., blue-red or orange). This allows the user to easily visually recognize on the monitor 22 that the amount of positional deviation of the receiving member 2b is relatively large.

[0066] The third management information R is information about the accuracy of the receiving member 2b to which the management number "U02" is assigned. The information "H+2" indicates that the position of the receiving member 2b in the third direction Z (see FIG. 8) is shifted, for example, 2 mm upward from the management value. If the amount of positional deviation of the receiving member 2b is relatively small, it is preferable to display the entire management information R in a distinguishing color (e.g., blue or yellow) that is effective in indicating this. This allows the user to easily visually recognize on the monitor 22 that the amount of positional deviation of the receiving member 2b is relatively small.

[0067] If it is found as a result of the shape fitting process in step S203 described above that the actual images Mb of the pin members 2a and the receiving members 2b, which are components of the production jig 2, are misaligned with respect to the master image Ma, three pieces of management information R indicating this are temporarily stored in the memory 50. Therefore, on condition that the user selects the selection item 23a of the selection unit 23 on the monitor 22, the management information R is read out from the memory 50 and output to the monitor 22.

[0068] In addition, in this embodiment, when the user touches the management information R displayed in a pop-up on the front of the monitor 22, various related information such as accuracy tables, history sheets, and reports related to the management information R can be opened. This allows the user to visually check the related information associated with the management information R by displaying it one after the other on the monitor 22 as necessary.

[0069] The other configurations and methods are the same as those of the first embodiment.

[0070] According to the second embodiment, for example, it becomes possible to easily grasp the accuracy of the production jig 2, the past maintenance history, the number of years of use based on the update history, etc. Therefore, the user can check the presence or absence of periodic replacement, deterioration, past defects, etc. of the production jig 2 on the monitor 22 while referring to the actual image Mb, which is the actual object. This has the advantage that the user does not need to search for past information on paper forms or 3D CAD (three-dimensional computer-aided design) software.

[0071] Therefore, according to the second embodiment, the management information R of multiple types of workpieces W (multiple types of production jigs 2) can be easily acquired without any omissions.

[0072] In addition, the same effects as those of the first embodiment are achieved.

[0073] The present invention is not limited to the above-described embodiment, and various applications and modifications are possible without departing from the object of the present invention. For example, the following embodiments can be implemented.

[0074] In the above embodiment, an example is given of using a mobile terminal 20 incorporating at least a camera 21 and a monitor 22, but if necessary, a device having the functions of camera 21 and a device having the functions of monitor 22 may be used separately. [Explanation of symbols]

[0075] 1... vehicle body (product, work), 2... jig (production jig, work), 3... individual identification information, 20... mobile terminal, 21... camera, 22... monitor, 40... control section, 43... image processing section, 44... management information output section, 50... memory (storage section), 101, 102... work management device (management device), Ma... master image, Mb... actual image, R... management information, S101 to S105, S201 to S205... work management method (management method), S102, S202... photographing step, S103, S203... image processing step, S104, S204... selection step, S105, S205... management information output step, W... work

Claims

1. A work management device for managing a plurality of types of work, A camera for taking pictures, A monitor capable of displaying a three-dimensional actual image captured by the camera; A control unit that controls the camera and the monitor; A storage unit that stores three-dimensional master images of the plurality of types of workpieces and a plurality of pieces of management information associated with each of the plurality of types of workpieces; The control unit is an image processing unit that performs a shape fitting process of superimposing the master image read from the storage unit onto the actual image of any one of the plurality of types of workpieces to be managed while the object is being displayed on the monitor; a management information output unit that reads out from the storage unit management information corresponding to a selection operation on the monitor from among the plurality of pieces of management information associated with the managed object displayed on the monitor, and outputs the management information to the monitor; A work management device having the above configuration.

2. The workpiece is provided with individual identification information, The work management device according to claim 1 , wherein the image processing unit refers to the individual identification information included in the actual image when the managed object is photographed by the camera in the shape fitting process.

3. 3. The work management device according to claim 1, wherein the work is at least one of a product and a production jig used in a production process of the product.

4. The work management device according to claim 1 , wherein the camera, the monitor, and the control unit are incorporated in a single mobile terminal.

5. A work management method using the work management device according to claim 1 or 2, an imaging step of imaging the management object with the camera; an image processing step of performing a shape fitting process of superimposing the master image read from the storage unit onto the actual image of the managed object while the managed object is displayed on the monitor in the photographing step; a management information output step of reading out from the storage unit management information corresponding to a selection operation on the monitor from among the plurality of pieces of management information associated with the managed object displayed on the monitor, and outputting the management information to the monitor; The work management method includes:

6. The workpiece is provided with individual identification information, The workpiece management method according to claim 5 , wherein the individual identification information included in the actual image when the managed object is photographed by the camera is referenced in the shape fitting process.

Images