Work assisting system, and work assisting method

Abstract

To provide a work assisting system and a work assisting method capable of guiding an operator's hand to a work target in an electronic apparatus.SOLUTION: A work assisting system 100 includes: a head-mounted display device 2 having a camera and a display part for displaying an image captured by the camera; an output processing part which outputs guidance information guiding a work content for a part of an image processing system 1; and a display control part which causes a work target corresponding to the guidance information included in the captured image displayed on the display part to be displayed in a distinguishable manner when the guidance information is output by the output processing part.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a work assistance system and a work assistance method. [Background technology]

[0002] In electronic devices such as multifunction peripherals, if an abnormality such as a paper jam occurs while the electronic device is operating, multiple guide screens corresponding to multiple tasks to resolve the abnormality may be displayed sequentially (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-186850 Summary of the Invention [Problem to be solved by the invention]

[0004] However, a worker who is unfamiliar with using the electronic device may not be able to identify which part of the electronic device is the target of the work even when looking at the guidance screen. However, there has not been a conventional configuration that allows the worker's hand to be guided to the target of the work on the electronic device.

[0005] An object of the present invention is to provide a work assistance system and a work assistance method that can guide a worker's hand to a work target in an electronic device. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided a work assistance system including a display device, an output processing unit, and a display control unit. The display device is a head-mounted type and includes a camera and a display unit that displays an image captured by the camera. The output processing unit outputs guidance information that provides guidance on work content for a part of an electronic device. When the guidance information is output by the output processing unit, the display control unit causes a work object corresponding to the guidance information included in the captured image displayed on the display unit to be identifiable.

[0007] A work assistance method according to another aspect of the present invention is executed by a work assistance system including a camera and a head-mounted display device having a display unit that displays an image captured by the camera, and includes an output step and a display control step. In the output step, guidance information that guides users through work content for a part of an electronic device is output. In the display control step, when the guidance information is output by the output step, a work object corresponding to the guidance information included in the captured image displayed on the display unit is displayed in an identifiable manner. [Effects of the Invention]

[0008] According to the present invention, it is possible to guide the worker's hand to a work target in an electronic device. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing the configuration of a work assistance system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the configuration of an image processing device of the work assistance system according to the embodiment of the present invention. [Figure 3] FIG. 3 is a perspective view showing the external configuration of the image processing device of the work assistance system according to the embodiment of the present invention. [Figure 4] FIG. 4 is a block diagram showing the configuration of the display device of the work assistance system according to the embodiment of the present invention. [Figure 5]FIG. 5 is a diagram showing an example of a captured image displayed on the display device of the work assistance system according to the embodiment of the present invention. [Figure 6] FIG. 6 is a flowchart showing an example of work assistance processing executed by the work assistance system according to the embodiment of the present invention. [Figure 7] FIG. 7 is a flowchart showing an example of a reach assistance process executed by the work assistance system according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. Note that the following embodiment is an example of a specific embodiment of the present invention and does not limit the technical scope of the present invention.

[0011] [Configuration of work assistance system 100] First, with reference to FIG. 1, the configuration of a work assistance system 100 according to an embodiment of the present invention will be described.

[0012] 1, the work assistance system 100 includes an image processing device 1 and a display device 2. In the work assistance system 100, the image processing device 1 and the display device 2 are connected to each other so as to be able to communicate with each other via a communication network 3. For example, the communication network 3 is the Internet or a LAN (local area network).

[0013] [Configuration of image processing device 1] Next, the configuration of the image processing device 1 will be described with reference to FIGS.

[0014] For ease of explanation, the vertical direction in the installation state where the image processing device 1 is usable (the state shown in FIG. 3) is defined as the up-down direction D1. Also, the front-to-back direction D2 is defined with the face on the left front side of the paper of the image processing device 1 shown in FIG. 3 as the front (front face). Also, the left-to-right direction D3 is defined with the front face of the image processing device 1 in the installation state as the reference point.

[0015] The image processing device 1 is a multifunction device that has multiple functions, such as a scanning function for reading an image from a document, a printing function for forming an image on a sheet based on image data, a fax function, and a copy function. The image processing device 1 is an example of an electronic device of the present invention. The electronic device of the present invention may also be a printer, a copy machine, a washing machine, a refrigerator, a vending machine, an ATM (automated teller machine), or the like.

[0016] As shown in FIG. 2, the image processing device 1 includes a control unit 11, an ADF (automatic document feeder) 12, an image reading unit 13, an image forming unit 14, a paper feeding unit 15, an operation display unit 16, a communication unit 17, and a memory unit 18.

[0017] The control unit 11 comprehensively controls the image processing device 1. As shown in FIG. 2, the control unit 11 includes a CPU 21, a ROM 22, and a RAM 23. The CPU 21 is a processor that executes various types of arithmetic processing. The ROM 22 is a non-volatile storage device that stores in advance information such as control programs for causing the CPU 21 to execute various types of processing. The RAM 23 is a volatile or non-volatile storage device that is used as a temporary storage memory (work area) for the various types of processing executed by the CPU 21. The CPU 21 executes the various control programs pre-stored in the ROM 22. In this way, the CPU 21 comprehensively controls the image processing device 1.

[0018] The ADF 12 transports a document whose image is to be read by the image reading unit 13. The ADF 12 includes a document setting unit, a plurality of transport rollers, a document holder, and a paper discharge unit.

[0019] The image reading unit 13 realizes the scanning function and includes a document table, a light source, a plurality of mirrors, an optical lens, and a CCD.

[0020] The image forming unit 14 realizes the printing function. For example, the image forming unit 14 forms a color or monochrome image by electrophotography on a sheet supplied by the paper feed unit 15. For example, the image forming unit 14 includes a plurality of image forming units, an optical scanning device, an intermediate transfer device, a fixing device, and a plurality of toner containers.

[0021] The image forming unit 14 also includes a front cover 31 and a right side cover 32 shown in FIG.

[0022] The front cover 31 is provided so as to be able to open and close a first opening 31A (see FIG. 3) formed in the front of the housing of the image processing device 1. The components of the image forming unit 14 are housed behind the first opening 31A in the housing of the image processing device 1. When the front cover 31 is opened, the components of the image forming unit 14 housed in the housing of the image processing device 1 are exposed to the outside through the first opening 31A. For example, the front cover 31 is opened and closed when the toner container is replaced.

[0023] The right side cover 32 is provided so as to be able to open and close a second opening 32A (see FIG. 3) formed on the right side of the housing of the image processing device 1. A first transport guide is disposed at the back of the second opening 32A in the housing of the image processing device 1, guiding the transport of a sheet on which an image is formed by the image forming unit 14. When the right side cover 32 is disposed in a closed position that closes the second opening 32A, a sheet transport path is formed between the right side cover 32 and the first transport guide. In other words, the right side cover 32 functions as a second transport guide that guides the transport of a sheet. When the right side cover 32 is opened, the first transport guide disposed inside the housing of the image processing device 1 is exposed to the outside through the second opening 32A. The right side cover 32 is opened and closed when a sheet jammed inside the housing of the image processing device 1 is to be removed.

[0024] The paper feed unit 15 supplies sheets to the image forming unit 14. The paper feed unit 15 includes a paper feed cassette 33 shown in Fig. 3. The paper feed unit 15 also includes a plurality of transport rollers used to transport the sheets.

[0025] 3, the paper feed cassette 33 is provided at the bottom of the housing of the image processing device 1. The paper feed cassette 33 is provided so as to be removable in the front-rear direction D2 relative to the housing of the image processing device 1. The paper feed cassette 33 stores sheets on which images are to be formed by the image forming unit 14.

[0026] The operation display unit 16 is a user interface of the image processing device 1. The operation display unit 16 includes a display unit and an operation unit. The display unit displays various information in response to control instructions from the control unit 11. For example, the display unit is a flat panel display such as a liquid crystal display. The operation unit inputs various information to the control unit 11 in response to user operations. For example, the operation unit includes operation keys and a touch panel.

[0027] The communication unit 17 is a communication interface that executes wired or wireless data communication via the communication network 3 with an external communication device such as the display device 2.

[0028] The storage unit 18 is a nonvolatile storage device, such as a nonvolatile memory such as a flash memory, a solid state drive (SSD), or a hard disk drive (HDD).

[0029] [Configuration of display device 2] Next, the configuration of the display device 2 will be described.

[0030] The display device 2 is a head-mounted device with an AR (augmented reality) function. For example, the display device 2 is a smart glass with an AR function, and includes a glass-shaped main body and a lens unit. The display device 2 may also be a head-mounted display with an AR function.

[0031] As shown in FIG. 4, the display device 2 includes a control unit 41, a camera 42, a display unit 43, a communication unit 44, a storage unit 45, and an audio input / output unit 46.

[0032] The control unit 41 comprehensively controls the display device 2. As shown in Fig. 4, the control unit 41 includes a CPU 51, a ROM 52, and a RAM 53. The CPU 51, the ROM 52, and the RAM 53 have the same functions as the CPU 21, the ROM 22, and the RAM 23 of the image processing device 1.

[0033] The camera 42 captures an image of a subject present in front of the person wearing the display device 2. The camera 42 captures an image of the subject at predetermined imaging intervals, and sequentially outputs each captured image.

[0034] The display unit 43 displays on the lens unit the image captured by the camera 42. Specifically, the display unit 43 displays on the lens unit the image captured by the camera 42 in real time.

[0035] The communication unit 44 is a communication interface that performs wireless data communication via the communication network 3 with external communication devices such as the image processing device 1.

[0036] The storage unit 45 is a non-volatile storage device.

[0037] The audio input / output unit 46 includes a microphone used to input audio to the display device 2 and a speaker used to output audio from the display device 2.

[0038] [Configuration of control unit 11] Next, the configuration of the control unit 11 will be described with reference to FIG.

[0039] As shown in FIG. 2, the control unit 11 includes a detection processing unit 61, an output processing unit 62, a display control unit 63, a recording processing unit 64, and an evaluation processing unit 65.

[0040] Specifically, a work assistance program for causing the control unit 11 to function as each of the above-mentioned functional units is pre-stored in the storage unit 18 of the image processing device 1. The CPU 21 of the control unit 11 executes the work assistance program to function as each of the above-mentioned functional units.

[0041] Note that some or all of the functional units included in the control unit 11 may be configured with electronic circuits. Also, the work assistance program may be a program for causing a plurality of processors to function as the functional units shown in FIG.

[0042] The detection processing unit 61 detects abnormalities in the image processing device 1.

[0043] For example, the abnormalities include a toner shortage in which the amount of toner contained in any of the toner containers falls below a predetermined reference value, a paper jam in which a sheet gets stuck in the sheet transport path, and a sheet shortage in which there are no sheets contained in the paper feed cassette 33.

[0044] The detection processing unit 61 may detect the out-of-toner condition, the paper jam condition, and the out-of-sheet condition using a conventionally known method.

[0045] The output processing unit 62 outputs guidance information that provides guidance on the work content for a part of the image processing device 1. The guidance information is information that includes a message indicating the work content for a part (work target) of the image processing device 1, such as "Please open the front cover 31."

[0046] For example, in the image processing device 1, work procedure data corresponding to each of the abnormalities is stored in advance in the storage unit 18. The work procedure data includes one or more pieces of the guidance information. Each piece of the guidance information included in the work procedure data is assigned a sequence number indicating the work sequence.

[0047] When the abnormality is detected by the detection processing unit 61, the output processing unit 62 sequentially outputs one or more pieces of guidance information included in the work procedure data corresponding to the abnormality. Specifically, when the abnormality is detected by the detection processing unit 61, the output processing unit 62 reads out the work procedure data corresponding to the detected abnormality from the storage unit 18. Then, the output processing unit 62 sequentially outputs each piece of guidance information included in the read work procedure data in accordance with the sequence number assigned to the guidance information.

[0048] For example, after outputting the first guidance information, the output processing unit 62 outputs the next guidance information in response to receiving a predetermined specific operation by voice. For example, the specific operation is an operation of inputting a voice including a predetermined word to the voice input / output unit 46 of the display device 2.

[0049] For example, the output processing unit 62 uses the audio input / output unit 46 of the display device 2 to output the guidance information by audio.

[0050] The output processing unit 62 may display the guidance information on the display unit 43 of the display device 2. For example, the output processing unit 62 may display a guidance screen including the guidance information on the display unit 43 of the display device 2. The guidance screen may include an image indicating the position of the work target in the image processing device 1. The guidance screen may also include a video playback field in which a video showing the work content is played.

[0051] Furthermore, the output processing unit 62 may output the guidance information by voice using the audio input / output unit 46 of the display device 2, and may also display the guidance screen on the operation display unit 16 of the image processing device 1. In this case, the output processing unit 62 may output the next piece of guidance information in response to a predetermined operation on the operation display unit 16.

[0052] In addition, the output processing unit 62 may determine whether the task corresponding to the last output guidance information has been completed based on the captured image taken by the camera 42 of the display device 2, and output the next guidance information if it is determined that the task has been completed.

[0053] However, the worker who is unfamiliar with using the image processing device 1 may not be able to identify which part of the image processing device 1 is the target of the work even when looking at the guidance screen displayed on the operation display unit 16. However, conventionally, there has been no configuration that allows the worker's hand to be guided to the target of the work in the image processing device 1.

[0054] In contrast to this, the work assistance system 100 according to the embodiment of the present invention can guide the worker's hand to the work target in the image processing device 1, as will be described below.

[0055] When the guidance information is output by the output processing unit 62, the display control unit 63 displays the work object corresponding to the guidance information contained in the captured image displayed on the display unit 43 of the display device 2 in an identifiable manner.

[0056] For example, the display control unit 63 displays a hand image X11 (see FIG. 5) corresponding to the work object superimposed on a predetermined position on the work object. Note that FIG. 5 shows a captured image X10, which is an example of the captured image displayed on the display unit 43 of the display device 2 after the guidance information including the work content for the paper feed cassette 33 (the work object) is output.

[0057] Here, the display control unit 63 may identify the components of the image processing device 1 included in the captured image by using sample images showing the respective components of the image processing device 1 stored in advance in the storage unit 18. Furthermore, the hand image X11 corresponding to each of the work objects may be stored in advance in the storage unit 18. Furthermore, the display position of the hand image X11 corresponding to each of the work objects may be determined in advance for each of the work objects.

[0058] Furthermore, when the captured image displayed on the display unit 43 of the display device 2 includes a predetermined contact prohibition portion in the image processing device 1, the display control unit 63 causes the contact prohibition portion to be displayed in an identifiable manner.

[0059] For example, the contact prevention unit is the fixing device of the image forming unit 14.

[0060] For example, the display control unit 63 causes the contact prohibition portion to blink. The display control unit 63 may also cause the contact prohibition portion to be displayed in a predetermined color such as red. The display control unit 63 may also cause a predetermined word or message, such as "Caution: High Temperature," to be displayed superimposed on the contact prohibition portion.

[0061] The contact prevention portion is not limited to the fixing device, and may be any portion that may cause injury, burns, or other damage to the worker if the worker comes into contact with it. The contact prevention portion may also be any portion that may cause a malfunction or failure if the worker comes into contact with it.

[0062] Each time the guidance information is output by the output processing unit 62, the display control unit 63 causes the work object corresponding to the guidance information contained in the captured image displayed on the display unit 43 of the display device 2 to be displayed in an identifiable manner.

[0063] If the hand of the worker included in the captured image is one of the left and right hands and the hand image X11 displayed superimposed on the work object is the other of the left and right hands, the control unit 11 may display a message indicating this on the display unit 43 or output a sound to that effect. Furthermore, if the orientation of the hand of the worker included in the captured image (upward, downward, leftward, rightward) differs from the orientation of the hand of the hand image X11 displayed superimposed on the work object, the control unit 11 may display a message indicating this on the display unit 43 or output a sound to that effect.

[0064] The record processing unit 64 records the progress of the work performed by the worker.

[0065] For example, when the specific operation is accepted, the recording processing unit 64 stores in the storage unit 18 first work log data indicating the completion of the work corresponding to the guidance information that was last output. Furthermore, when a predetermined failed operation on the operation display unit 16 is accepted, the recording processing unit 64 stores in the storage unit 18 second work log data indicating the failure of the work corresponding to the guidance information that was last output.

[0066] The control unit 11 causes the operation display unit 16 to display the first work log data and the second work log data stored in the memory unit 18 in response to a predetermined operation on the operation display unit 16. This allows the successor worker to understand the progress of the work performed by the previous worker when the worker is replaced.

[0067] The evaluation processing unit 65 evaluates the work performed by the worker.

[0068] For example, when the specific operation is accepted, the evaluation processing unit 65 evaluates the operation corresponding to the guidance information that was last output.

[0069] For example, when the specific operation is accepted, the evaluation processing unit 65 acquires the elapsed time from the last output of the guidance information.

[0070] Then, the evaluation processing unit 65 obtains an evaluation score for the task corresponding to the guidance information based on the obtained elapsed time. For example, the evaluation processing unit 65 calculates the evaluation score using a predetermined calculation formula. Here, the calculation formula may be determined so that the shorter the obtained elapsed time, the higher the evaluation score.

[0071] When a series of tasks corresponding to the plurality of pieces of guidance information outputted sequentially is completed, the evaluation processing unit 65 adds up the evaluation points for each task to obtain a total evaluation point corresponding to the series of tasks. Then, the evaluation processing unit 65 displays the obtained total evaluation point on the operation display unit 16. This allows the worker to check the evaluation of the tasks he or she has performed.

[0072] The evaluation processing unit 65 may store the acquired overall evaluation score in a memory area allocated to the user logged in to the image processing device 1. Furthermore, the control unit 11 may cause the operation display unit 16 to display the overall evaluation score stored in the memory area corresponding to the user logged in to the image processing device 1 in response to a predetermined operation by the user. Furthermore, the control unit 11 may consume a portion of the points acquired by the user logged in to the image processing device 1 (the total value of the overall evaluation scores stored in the memory area corresponding to the user) to issue a voucher to be used in exchange for a prize corresponding to the consumed points. For example, the control unit 11 may print the voucher using the image forming unit 14.

[0073] [Work support processing] 6, the work assistance method of the present invention will be described below together with an example of the procedure of the work assistance process executed by the control unit 11 of the image processing device 1 in the work assistance system 100. Here, steps S11, S12, etc. represent the numbers of the processing procedures (steps) executed by the control unit 11. For example, the work assistance process is executed when the detection processing unit 61 detects the abnormality.

[0074] <Step S11> First, in step S11, the control unit 11 activates the camera 42 of the display device 2, and causes the display unit 43 to display the image captured by the camera 42.

[0075] <Step S12> In step S12, the control unit 11 outputs the guidance information to which the sequence number corresponding to the number of times the processing of step S12 has been executed has been assigned, from among one or more pieces of guidance information included in the work procedure data corresponding to the abnormality detected by the detection processing unit 61. The processing of step S12 is an example of an output step of the present invention, and is executed by the output processing unit 62 of the control unit 11.

[0076] Specifically, the control unit 11 uses the audio input / output unit 46 of the display device 2 to output the guidance information by voice.

[0077] <Step S13> In step S13, the control unit 11 executes the arrival assistance process described below.

[0078] [Reaching assistance processing] Here, an example of the procedure of the arrival assistance process executed in step S13 of the task assistance process will be described with reference to FIG.

[0079] <Step S21> First, in step S21, the control unit 11 determines whether or not the work object corresponding to the guidance information that was last output has been detected from the captured image captured by the camera 42 of the display device 2.

[0080] Here, if the control unit 11 determines that the work object has been detected (Yes in S21), the control unit 11 shifts the process to step S22. On the other hand, if the work object has not been detected (No in S21), the control unit 11 shifts the process to step S23.

[0081] <Step S22> In step S22, the control unit 11 identifiably displays the work object corresponding to the guidance information that was last output and that is included in the captured image displayed on the display unit 43 of the display device 2. The processes of step S21 and step S22 are an example of a display control step of the present invention, and are executed by the display control unit 63 of the control unit 11.

[0082] Specifically, the control unit 11 displays a hand image X11 (see FIG. 5) corresponding to the work object so as to be superimposed on a predetermined position on the work object, thereby enabling the worker to grasp to which part of the work object the hand should be moved.

[0083] <Step S23> In step S23, the control unit 11 determines whether or not the touch-prohibited portion has been detected from the image captured by the camera 42 of the display device 2.

[0084] Here, if the control unit 11 determines that the contact prohibition unit has been detected (Yes in S23), the control unit 11 shifts the process to step S24. On the other hand, if the contact prohibition unit has not been detected (No in S23), the control unit 11 shifts the process to step S25.

[0085] <Step S24> In step S24, the control unit 11 causes the touch-prohibited portion included in the captured image to be displayed in an identifiable manner on the display unit 43 of the display device 2. The processes of steps S23 and S24 are executed by the display control unit 63 of the control unit 11.

[0086] Specifically, the control unit 11 causes the contact prohibition portion to blink, thereby enabling the worker to visually recognize the contact prohibition portion.

[0087] <Step S25> In step S25, the control unit 11 determines, based on the captured image captured by the camera 42 of the display device 2, whether or not the worker's hand has reached the work object.

[0088] Here, if the control unit 11 determines that the worker's hand has reached the work object (Yes in S25), it ends the reach assistance process. On the other hand, if the worker's hand has not reached the work object (No in S25), the control unit 11 shifts the process to step S21.

[0089] This concludes the description of the arrival assistance process, and the description of the work assistance process from step S14 onwards will be resumed.

[0090] <Step S14> In step S14, the control unit 11 determines whether or not the specific operation has been accepted.

[0091] Here, if the control unit 11 determines that the specific operation has been accepted (Yes in S14), it shifts the process to step S15. On the other hand, if the specific operation has not been accepted (No in S14), the control unit 11 waits for acceptance of the specific operation in step S14.

[0092] <Step S15> In step S15, the control unit 11 records the completion of the task corresponding to the guidance information that was last output. The process of step S15 is executed by the record processing unit 64 of the control unit 11.

[0093] Specifically, the control unit 11 stores the first work log data indicating the completion of the work corresponding to the guidance information that was last output in the storage unit 18. Note that, when the failed operation is accepted instead of the specific operation, the control unit 11 may store the second work log data indicating the failure of the work corresponding to the guidance information that was last output in the storage unit 18.

[0094] <Step S16> In step S16, the control unit 11 evaluates the task corresponding to the guidance information that was last output. The process of step S16 is executed by the evaluation processing unit 65 of the control unit 11.

[0095] Specifically, the control unit 11 acquires the elapsed time since the last output of the guidance information, and then substitutes the acquired elapsed time into the calculation formula to calculate the evaluation score for the task corresponding to the last output of the guidance information.

[0096] <Step S17> In step S17, the control unit 11 determines whether all of the guidance information included in the work procedure data corresponding to the abnormality detected by the detection processing unit 61 has been output.

[0097] Here, if the control unit 11 determines that all of the guidance information has been output (Yes in S17), it shifts the process to step S18. On the other hand, if all of the guidance information has not been output (No in S17), the control unit 11 shifts the process to step S12.

[0098] <Step S18> In step S18, the control unit 11 stops the camera 42 of the display device 2, and causes the display unit 43 to end the display of the image captured by the camera 42.

[0099] <Step S19> In step S19, the control unit 11 adds up the evaluation points obtained in the processing of step S16 to obtain the overall evaluation point corresponding to the series of tasks, and displays the obtained overall evaluation point on the operation display unit 16. The processing of step S19 is executed by the evaluation processing unit 65 of the control unit 11.

[0100] In this way, in the work assistance system 100, when the guidance information is output, the work object corresponding to the guidance information included in the captured image displayed on the display unit 43 of the display device 2 is displayed in an identifiable manner. This makes it possible to guide the worker's hand to the work object in the image processing device 1.

[0101] [Notes on the Invention] The following is a summary of the invention extracted from the above-described embodiment. Note that the configurations and processing functions described in the following supplementary notes can be selected and combined as desired.

[0102] <Appendix 1> A work assistance system comprising: a head-mounted display device having a camera and a display unit that displays an image captured by the camera; an output processing unit that outputs guidance information that provides guidance on work content for a part of an electronic device; and a display control unit that, when the guidance information is output by the output processing unit, causes a work target that corresponds to the guidance information included in the captured image displayed on the display unit to be identifiable.

[0103] <Appendix 2> 2. The work assistance system according to claim 1, wherein the display control unit displays a hand image corresponding to the work object in a manner superimposed on a predetermined position on the work object.

[0104] <Appendix 3> 3. The work assistance system according to claim 1, wherein, when the captured image displayed on the display unit includes a predetermined contact-prohibited part of the electronic device, the display control unit causes the contact-prohibited part to be identifiable.

[0105] <Appendix 4> the output processing unit sequentially outputs one or more pieces of guidance information corresponding to the abnormality when the abnormality is detected by the detection processing unit; and the display control unit identifiably displays the work target corresponding to the guidance information included in the captured image displayed on the display unit every time the output processing unit outputs the guidance information.

[0106] <Appendix 5> The work assistance system according to claim 4, wherein the output processing unit outputs the next guidance information in response to reception of a predetermined specific operation by voice.

[0107] <Appendix 6> A work assistance method executed by a work assistance system including a camera and a head-mounted display device having a display unit that displays an image captured by the camera, the work assistance method including: an output step of outputting guidance information that provides guidance on work content for a part of an electronic device; and a display control step of, when the guidance information is output by the output step, causing a work target that corresponds to the guidance information included in the captured image displayed on the display unit to be identifiable. [Explanation of symbols]

[0108] 1. Image processing device 2 Display device 3. Communication Network 11 Control section 12 ADF 13 Image reading unit 14 Image forming unit 15 Paper feed section 16 Operation display section 17 Communications Department 18 Memory section 31 Front cover 32 Right side cover 33 Paper cassette 41 Control Unit 42 Camera 43 Display section 44 Communications Department 45 Storage section 46 Audio input / output section 61 Detection processing unit 62 Output processing section 63 Display control unit 64 Recording processing section 65 Evaluation processing section 100 Work assistance system

Claims

1. a head-mounted display device having a camera and a display unit that displays an image captured by the camera; an output processing unit that outputs guidance information that provides guidance on work content for a part of the electronic device; a display control unit that, when the guidance information is output by the output processing unit, causes a work object corresponding to the guidance information included in the captured image displayed on the display unit to be identifiable; and A work assistance system comprising:

2. the display control unit displays a hand image corresponding to the work object superimposed on a predetermined position on the work object, The work assistance system according to claim 1 .

3. the display control unit, when the captured image displayed on the display unit includes a predetermined contact prohibition portion of the electronic device, causes the display control unit to identifiably display the predetermined contact prohibition portion. The work assistance system according to claim 1 .

4. a detection processing unit that detects an abnormality in the electronic device; the output processing unit sequentially outputs, when the abnormality is detected by the detection processing unit, one or more pieces of guidance information corresponding to the abnormality; the display control unit, each time the guidance information is output by the output processing unit, causes the work object corresponding to the guidance information included in the captured image displayed on the display unit to be identifiable. The work assistance system according to any one of claims 1 to 3.

5. the output processing unit outputs the next guidance information in response to reception of a predetermined specific operation by voice. The work assistance system according to claim 4 .

6. A work assistance method executed by a work assistance system including a camera and a head-mounted display device having a display unit that displays an image captured by the camera, an output step of outputting guidance information that provides guidance on work content for a part of the electronic device; a display control step of, when the guidance information is output by the output step, identifiably displaying a work object corresponding to the guidance information included in the captured image displayed on the display unit; A work assistance method including:

Images