Work assistance device, work assistance method, and work assistance program

Abstract

A work assistance device is provided with: an information determination unit that determines information about a work instruction during work by a worker on the basis of work state information about the work instruction by the worker and self-sensing information about the work by the worker; and an information presentation unit that presents information of the work instruction determined by the information determination unit.

Description

Technical Field

[0001] This disclosure relates to work assistance devices, work assistance methods, and work assistance procedures for assisting workers. Background Technology

[0002] In the past, various work assistance devices have been proposed to provide suggestions on the work performed by the operator or the results of the work performed by the operator.

[0003] In this regard, Japanese Patent Application Publication No. 2023-8625 (Patent Document 1) proposes a method for outputting work instructions based on each worker's proficiency information.

[0004] Existing technical documents

[0005] Patent documents

[0006] Patent Document 1: Japanese Patent Application Publication No. 2023-8625 Summary of the Invention

[0007] The problem that the invention aims to solve

[0008] On the other hand, there is the following problem: even when the operator cannot understand the content of the work instructions, or when the operator feels that the work instructions are difficult to execute, the content of the work instructions is maintained.

[0009] This disclosure is intended to solve the aforementioned problems, and its purpose is to provide a work assistance device, work assistance method, and work assistance procedure that can provide work-related instructions that are matched to the operator's situation.

[0010] Methods for solving problems

[0011] One example of the work assistance device disclosed herein includes: an information determination unit that determines work instruction information during the work process based on the operator's work status information in response to work instructions and the operator's work-related self-perception information; and an information prompting unit that prompts the work instruction information determined by the information determination unit. According to this structure, since the work instruction information during the work process is determined based on the operator's work-related self-perception information, work instructions related to the work can be provided in a way that matches the operator's condition.

[0012] The work assistance device also includes: a work information acquisition unit that acquires the worker's work information; and an analysis unit that analyzes the worker's work information acquired by the work information acquisition unit to generate work status information. Based on this structure, by analyzing the worker's work information to generate work status information, work instructions related to the work can be provided in accordance with the worker's condition.

[0013] The work assistance device also includes a self-perception information acquisition unit, which acquires the operator's work-related self-perception information. Because this structure includes a self-perception information acquisition unit, it can determine work instructions during the work process based on the operator's work-related self-perception information, thus providing work instructions that are matched to the operator's condition.

[0014] The work assistance device includes an information storage unit that stores multiple work instruction contents, which are information for work instructions. These multiple work contents are categorized into multiple work instruction content groups. An information decision unit determines one of the multiple work instruction content groups based on work status information and the operator's subjective feelings, and then selects one of the multiple work instruction contents from that determined work instruction content group. According to this structure, a single work instruction content is selected from the multiple work instruction contents contained in one of the multiple work instruction content groups, thus enabling the provision of work instructions related to the work that are matched to the operator's condition.

[0015] The work assistance device also includes an information receiving unit that receives input of the operator's self-perception information. Because this structure includes an information receiving unit that accepts self-perception information, it is possible to provide work-related instructions in a simple manner that matches the operator's condition.

[0016] The operator's self-perceived information is related to whether they have understood the work instructions. According to this structure, since self-perceived information is related to whether they have understood the work instructions, it is possible to provide work instructions that are relevant to the operator's condition.

[0017] The operator's self-perceived information is information related to whether the work is being done properly in accordance with the work instructions. According to this structure, since self-perceived information is related to whether the work is being done properly in accordance with the work instructions, it is possible to provide work instructions related to the work that are matched with the operator's condition.

[0018] The work assistance method disclosed herein includes the following steps: determining work instruction information during the work process based on the worker's work status information in response to work instructions and the worker's self-perception information related to the work; and providing information to prompt the determined work instructions.

[0019] The job assistance program of this disclosure enables a computer to execute the job assistance method of this disclosure, which includes the following steps: determining job instruction information during the job operation process based on the job status information of the operator in relation to the job instruction and the operator's self-perception information related to the job; and providing information to prompt the determined job instruction.

[0020] The effects of the invention

[0021] According to the work assistance device, work assistance method and work assistance procedure disclosed herein, work instructions related to the work can be provided in a way that matches the worker's condition. Attached Figure Description

[0022] Figure 1 This is a diagram illustrating the structure of the work assistance system 1 according to the implementation method.

[0023] Figure 2 This diagram illustrates the situation where an operator uses a screwdriver DR to tighten screws in an implementation method.

[0024] Figure 3 This is a diagram illustrating the structure of server 20 in the implementation method.

[0025] Figure 4 This diagram illustrates the functional blocks of server 20 in the implementation method.

[0026] Figure 5 This is a flowchart illustrating the processing of server 20 in the implementation method.

[0027] Figure 6 The content of the implementation method determines the migration diagram.

[0028] Figure 7 This diagram illustrates the determination of the work instruction content of the first work instruction content group in the implementation method.

[0029] Figure 8 This diagram illustrates the determination of the work instruction content of the second work instruction content group in the implementation method.

[0030] Figure 9 This diagram illustrates the determination of the work instruction content for the third work instruction content group in the implementation method. Detailed Implementation

[0031] Embodiments of the present invention will be described in detail with reference to the accompanying drawings. Furthermore, identical or corresponding parts in the drawings will be labeled with the same reference numerals and their descriptions will not be repeated.

[0032] (Overall structure)

[0033] The structure of the work assistance system 1 of the implementation method will be described. Figure 1 This is a diagram illustrating the structure of the work assistance system 1 according to the embodiment. (Refer to...) Figure 1 The work assistance system 1 includes a projector 10, a server 20, a camera 30, and an input device 50. The projector 10, camera 30, and input device 50 are all connected to the server 20. As an example, an operator uses a screwdriver DR to perform a prescribed operation on a workpiece W placed on a worktable TB. In this example, as a case study of a prescribed operation, the operator will describe the case of using the screwdriver DR to perform a screw tightening operation on the workpiece W. The case of repeatedly performing the screw tightening operation on the workpiece W will be described. Although not shown, a tilt sensor (described later) is installed on the screwdriver DR. Additionally, although not shown, a pressure sensor is installed on the worktable TB. The tilt sensor and pressure sensor are configured to communicate with the server 20.

[0034] As an example, projector 10 projects (outputs) the work instruction information of the prescribed task onto the projection area DP, which is part of the workbench TB. Camera 30 captures the worker's prescribed work status and outputs the captured image data as work information to server 20. Input device 50 is a device for inputting the worker's self-perception information related to the task. As an example, input device 50 is provided with a switch-type button. Input device 50 is configured to accept input of information related to the worker's self-perception. For example, input device 50 is configured to selectively accept input of self-perception information related to whether the work was performed properly in accordance with the work instructions. For example, the worker inputs self-perception information related to the prescribed task for each prescribed task via input device 50. If the worker determines, based on self-perception information, that the prescribed task was performed in accordance with the work instructions, they press one of the two switches provided on input device 50. As a result, the worker's self-perception information (work performed properly) is sent to server 20 via input device 50. Conversely, if the worker determines, based on self-perception information, that the prescribed task was not performed in accordance with the work instructions, they press the other switch provided on input device 50. Therefore, the operator's self-perception information (the job is inappropriate) is sent to the server 20 via the input device 50.

[0035] Server 20 acquires image data captured via camera 30 and / or data input via screwdriver DR as work information. Based on the analyzed work status information and the operator's self-perception information input via input device 50, it determines the work instructions during the operator's work process and displays the determined work instructions. For example, server 20 displays the determined work instructions via projector 10.

[0036] In this example, we will describe the situation where the operator uses a screwdriver DR to tighten a screw on workpiece W, but this is not the only example; other operations could also be performed. We will also describe the method of using the screwdriver DR, but it is also possible to describe a method where the screwdriver DR is not used. In this example, we will describe the situation where the projector 10 projects (outputs) the work instructions for the specified operation onto the projection area DP, but this is not the only example; for example, a display device could be used instead of the projector 10 to display the work instructions for the specified operation to the operator. Furthermore, we will describe the situation where the work instructions for the specified operation are displayed visually, but for example, a speaker could be used to display the information to the operator audibly. Alternatively, a speaker and the projector 10 could be used in combination.

[0037] Figure 2 This diagram illustrates the use of a screwdriver DR to tighten screws in an implementation scenario. (Refer to...) Figure 2 A tilt sensor 16 is provided on the screwdriver DR. The tilt sensor 16, for example, is composed of an accelerometer or gyroscope sensor, and continuously detects the tilt angle of the screwdriver DR's tip relative to the workpiece W, and sends data representing the detected tilt angle to the server 20. The tilt sensor 16 is equipped with a wireless communication function capable of communicating with the server 20. As a wireless interface, for example, an interface using a low-power data communication standard such as Bluetooth (registered trademark) can be used. Alternatively, a wired communication line such as a LAN (Local Area Network) can be used instead of a wireless interface, and a power cord can also be used as a communication line.

[0038] As an example, a pressure sensor 15 is installed on the workbench TB. The pressure sensor 15 continuously detects the pressure (load) applied to the workpiece W by the tip of the screwdriver DR and sends data representing the detected pressure value to the server 20. The pressure sensor 15 is equipped with a wireless communication function that enables communication with the server 20. As a wireless interface, for example, an interface using a low-power data communication standard such as Bluetooth (registered trademark) can be used. Alternatively, a wired communication line such as a wired LAN (Local Area Network) can be used instead of a wireless interface, and the power cord can also be used as a communication line. Alternatively, a structure in which at least one of the pressure sensor 15 and the tilt sensor 16 is installed inside the screwdriver DR can also be adopted.

[0039] Figure 3 This is a diagram illustrating the structure of server 20 in the implementation method. (Refer to...) Figure 3The server 20 typically has a structure that follows a general computer architecture. Specifically, the server 20 includes a processor 101 such as a CPU (Central Processing Unit) or MPU (Micro-Processing Unit), memory 102, storage 103, a display controller 104, an input interface 105, and a communication interface 106. These components are connected to each other via a bus in a manner that enables data communication. The processor 101 performs various processes in this embodiment by expanding and executing various programs stored in the storage 103 in the storage 102. The storage 102 is typically a volatile storage device such as DRAM (Dynamic Random Access Memory) and stores programs read from the storage 103. The storage 103 is typically a non-volatile magnetic storage device such as a hard disk drive. The storage 103 stores a job assistance program 131 executed by the processor 101. In addition, the storage 103 stores job information 132 and content information 133. Job information 132 is data received via communication interface 106 from camera 30, pressure sensor 15, and tilt sensor 16 related to the operator's job status in response to job instructions. Content information 133 is pre-saved information about the job instructions for the specified job.

[0040] Various programs installed in memory 103 are stored in the memory card or similar device. Display controller 104 is connected to projector 10 and outputs signals to projector 10 for displaying various information according to internal commands from processor 101. Input interface 105 is connected to input device 50 and accepts user feedback information input via input device 50. Additionally, although not shown, input interface 105 can also mediate data transmission between input devices such as keyboards, mice, touch panels, and dedicated consoles. Communication interface 106 mediates data transmission between processor 101 and external devices (e.g., camera 30, pressure sensor 15, and tilt sensor 16). Communication interface 106 typically includes Ethernet, USB (Universal Serial Bus), etc. Furthermore, various programs stored in memory 103 can also be downloaded from distribution servers or similar devices via communication interface 106.

[0041] In the case of using a computer constructed according to a general computer architecture as described above, in addition to the application used to provide the functions of this embodiment, an OS (Operating System) can also be installed to provide the basic functions of the computer. In this case, the program of this embodiment can also execute processing by calling necessary modules from the program modules provided as part of the OS in a predetermined order and at predetermined times. That is, the program of this embodiment itself may sometimes not contain the modules described above, but performs processing in cooperation with the OS. Alternatively, some or all of the functions provided by the execution of the operation assistance program 131 may be installed as dedicated hardware circuitry.

[0042] Figure 4 This diagram illustrates the functional blocks of server 20 in the implementation method. (Refer to...) Figure 4 The server 20 constitutes a work assistance device, including a work information acquisition unit 110, a self-perception information acquisition unit 111, an analysis unit 112, an information decision unit 114, and an information prompting unit 115. Each functional block is implemented by the processor 101 executing the work assistance program 131.

[0043] The work information acquisition unit 110 acquires image data from the camera 30 as work information and stores it in the memory 103 as work information 132. The work information acquisition unit 110 also acquires wireless signals from the pressure sensor 15 and the tilt sensor 16 as work information. The work information acquisition unit 110 acquires the wireless signals transmitted from the pressure sensor 15 and the tilt sensor 16, decodes the signals, acquires pressure data and tilt data for the workpiece W, and stores them in the memory 103 as work information 132. The self-perception information acquisition unit 111 acquires the operator's self-perception information input via the input device 50. The analysis unit 112 analyzes the work information 132 stored in the memory 103 and generates work status information for the operator in response to work instructions. Specifically, the analysis unit 112 analyzes the tilt data of the operator's work status transmitted from the tilt sensor 16, i.e., the work information 132, and generates an analysis result indicating whether the screwdriver DR is kept straight relative to the screw as work status information. The analysis unit 112 analyzes the image data of the operator's work status input via the camera 30, i.e., the work information 132, and generates an analysis result indicating whether the screwdriver DR is held in a relaxed manner, i.e., whether the wrist is bent, as work status information. The analysis unit 112 also analyzes the pressure data of the operator's work status sent from the pressure sensor 15, i.e., the work information 132, and generates an analysis result indicating whether the screwdriver DR is not being pressed forcefully as work status information.

[0044] Based on the analysis results of the analysis unit 112, namely the operator's work status information in response to work instructions and the operator's self-perception information related to the work, the information decision unit 114 determines the work instruction information during the operator's work process. Specifically, the information decision unit 114 determines the work instruction information according to the migration diagram described later.

[0045] The information prompting unit 115 prompts the information of the work instruction determined by the information decision unit 114. Specifically, the information prompting unit 115 projects (outputs) the content of the determined work instruction onto the projection area DP via the projector 10.

[0046] Figure 5 This is a flowchart illustrating the processing of server 20 in the implementation method. (Refer to...) Figure 5 The server 20 determines the content of the work instructions displayed to the operator (step S0). Specifically, the information determination unit 114 determines the content of the work instructions displayed to the operator during the work process. As an example, the information determination unit 114 determines the content of a pre-set initial state. The information determination unit 114 determines the content D1 of the first work instruction content group corresponding to state N1 in the content determination transition diagram described later. Next, the server 20 outputs the content (step S2). The information prompting unit 115 projects the determined content onto the projection area DP via the projector 10 (output).

[0047] Next, server 20 acquires the operator's work information (step S4). Specifically, the work information acquisition unit 110 decodes the image data from camera 30 and the wireless signals transmitted from pressure sensor 15 and tilt sensor 16 to acquire pressure data and tilt data as work information. Next, server 20 analyzes the acquired operator's work information (step S6). Specifically, analysis unit 112 analyzes the work information stored in memory 103. Next, server 20 generates work status information as the analysis result (step S8). Specifically, analysis unit 112 analyzes the tilt data of the operator's work status transmitted from tilt sensor 16, i.e., work information, and generates an analysis result indicating whether the screwdriver DR is kept straight relative to the screw as work status information. Analysis unit 112 analyzes the image data of the operator's work status input via camera 30, i.e., work information, and generates an analysis result indicating whether the screwdriver DR is held in a relaxed manner, i.e., whether the wrist is bent, as work status information. The analysis unit 112 analyzes the pressure data, i.e., the work information 132, sent from the pressure sensor 15 to the operator's work status, and generates an analysis result indicating whether the screwdriver DR was not pressed with force as work status information.

[0048] Next, server 20 obtains the operator's self-perception information (step S10). Specifically, self-perception information acquisition unit 111 obtains the operator's self-perception information input via input device 50. Next, server 20 determines the content to be displayed to the operator in the next job based on the operator's job status information and self-perception information (step S12). Specifically, information determination unit 114 uses a content determination transition diagram (described later) to determine the job instruction information based on the operator's job status information and self-perception information.

[0049] Next, server 20 determines whether the job has ended (step S14). In step S14, if server 20 determines that the job has ended ("Yes" in step S14), it terminates the process (ends). For example, the job can also be determined to be ended based on image data from camera 30 when the operator leaves the workbench TB. Alternatively, the job can be determined to be ended when there is no workpiece W.

[0050] On the other hand, if the server 20 determines that the job is not finished ("No" in step S14), it returns to step S2, and the server 20 outputs the content (step S2). The information prompting unit 115 projects (outputs) the determined content onto the projection area DP via the projector 10, and repeats the above process. For example, the server 20 may also determine that the next job is due based on image data from the camera 30 when the operator holds a new workpiece W, determine that the job is not finished, and output the content. Alternatively, the server 20 may detect the input of the switch to start the next job and output the content according to the detection.

[0051] (Content decision)

[0052] Figure 6 The content of the implementation method determines the migration diagram. (Refer to...) Figure 6 The content information includes multiple job instruction items. Specifically, as an example, these job instruction items are categorized into three job instruction item groups: Group 1 to Group 3. Job instruction items determined in the content decision migration diagram move from Group 1 to Group 2 as the operator's proficiency increases. Furthermore, job instruction items determined in the content decision migration diagram move from Group 2 to Group 3 as the operator's proficiency increases.

[0053] The first set of job instruction content includes job instruction contents D1, D1a, and D1b (also referred to as content). The second set of job instruction content includes job instruction contents D2, D2a, and D2b. The third set of job instruction content includes job instruction contents D3, D3a, and D3b.

[0054] The information decision unit 114 decides on one of the three work instruction content groups (1 to 3), selecting one from multiple work instruction contents within that group. The information notification unit 115 then notifies the operator of the decided work instruction content as the next work instruction.

[0055] (Work Instruction Group 1)

[0056] As the initial state, select the first job instruction content group and determine the job instruction content D1 of the first job instruction content group. That is, set the initial state in the content determination transition diagram to state N1.

[0057] The operator confirms the work instruction information as work instruction content D1, "stand the screwdriver upright relative to the screw," and begins the work.

[0058] The work information acquisition unit 110 acquires tilt data of the operator's work status input via the screwdriver DR as work information. The analysis unit 112 uses the tilt data to analyze whether the screwdriver DR is standing upright relative to the screw. Based on the work information, the analysis unit 112 generates an analysis result of whether it is upright, i.e., work status information ("upright" or "not upright"), and outputs it to the information decision unit 114. The self-perception information acquisition unit 111 acquires the operator's self-perception information input via the input device 50. The operator inputs self-perception information related to each prescribed work via the input device 50. If the operator judges, based on the self-perception information, that following the prescribed work instructions is appropriate or inappropriate, they press one or the other of the two switches provided on the input device 50. The self-perception information acquisition unit 111 acquires the operator's self-perception information regarding the work instruction "standing the screwdriver upright relative to the screw" as work instruction content D1 via the input device 50. As an example, the self-perception information acquisition unit 111 acquires the operator's self-perception information ("held upright" or "not held upright") based on the pressing of one or the other of the two switches.

[0059] When the information decision unit 114 is in state N1, it transitions from state N1 to state N2 based on self-perception information ((1) "kept straight") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "straight"). The information decision unit 114 determines the second work instruction content group corresponding to state N2, and determines the work instruction content D2 of the second work instruction content group ("hold the screwdriver in a way that does not strain the wrist"). The information prompting unit 115 prompts the operator with the determined work instruction content D2 as the information for the next work instruction. When the information decision unit 114 is in state N1, it maintains state N1 based on self-perception information ((1) "not kept straight") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "not straight"). The information decision unit 114 determines the first work instruction content group corresponding to state N1, and determines the work instruction content D1 of the first work instruction content group ("hold the screwdriver upright relative to the screw"). The information prompting unit 115 will prompt the operator with the determined work instruction content D1 as the next work instruction.

[0060] When the information decision unit 114 is in state N1, it transitions from state N1 to state N1A based on self-perception information ((1) "kept straight") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "not straight"). The information decision unit 114 determines the first work instruction content group corresponding to state N1A and determines the work instruction content D1a of the first work instruction content group ("hold the screwdriver close to the center of the body"). The information prompting unit 115 prompts the worker with the determined work instruction content D1a as the information for the next work instruction. When the information decision unit 114 is in state N1, it transitions from state N1 to state N1B based on self-perception information ((1) "not kept straight") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "straight"). The information decision unit 114 determines the first work instruction content group corresponding to state N1B, and determines the work instruction content D1b of the first work instruction content group ("The screwdriver used in the last operation was straight. Perform the operation in the same way"). The information prompting unit 115 prompts the operator with the determined work instruction content D1b as the information for the next work instruction.

[0061] When the information decision unit 114 is in state N1A, it maintains state N1A based on self-perception information ((1) "held straight" or "not held straight") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "not straight"). The information decision unit 114 determines the first work instruction content group corresponding to state N1A and determines the work instruction content D1a of the first work instruction content group ("hold the screwdriver close to the center of the body"). The information prompting unit 115 prompts the operator with the determined work instruction content D1a as the information for the next work instruction. When the information decision unit 114 is in state N1A, it transitions from state N1A to state N1B based on self-perception information ((1) "not held straight") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "straight"). The information decision unit 114 determines the first work instruction content group corresponding to state N1B, and determines the work instruction content D1b of the first work instruction content group ("The screwdriver used in the last operation was straight. Perform the operation in the same way"). The information prompting unit 115 prompts the operator with the determined work instruction content D1b as the information for the next work instruction.

[0062] When the state is N1A, the information decision unit 114 transitions from state N1A to state N1 based on its own perception information ((1) "keep straight") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "straight"). The information decision unit 114 determines the first work instruction content group corresponding to state N1, and determines the work instruction content D1 of the first work instruction content group ("hold the screwdriver straight relative to the screw"). The information prompting unit 115 prompts the operator with the determined work instruction content D1 as the information for the next work instruction.

[0063] When the information decision unit 114 is in state N1B, it maintains state N1B based on its own perception information ((1) "not kept straight") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "straight"). The information decision unit 114 determines the first work instruction content group corresponding to state N1B, and determines the work instruction content D1b of the first work instruction content group ("The screwdriver used in the last operation was straight. Perform the operation in the same way"). The information prompting unit 115 prompts the operator with the determined work instruction content D1b as the information for the next work instruction. When the information decision unit 114 is in state N1B, it transitions from state N1B to state N1A based on its own perception information ((1) "kept straight" or "not kept straight") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "not straight"). The information decision unit 114 determines the first work instruction content group corresponding to state N1A, and determines the work instruction content D1b of the first work instruction content group ("Hold the screwdriver close to the center of the body"). The information prompting unit 115 prompts the operator with the determined work instruction content D1b as the information for the next work instruction.

[0064] When the state is N1B, the information decision unit 114 transitions from state N1B to state N1 based on its own perception information ((1) "keep straight") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "straight"). The information decision unit 114 determines the first work instruction content group corresponding to state N1, and determines the work instruction content D1 of the first work instruction content group ("hold the screwdriver straight relative to the screw"). The information prompting unit 115 prompts the operator with the determined work instruction content D1 as the information for the next work instruction.

[0065] (Work Instructions Group 2)

[0066] The operator confirms the work instruction information in the work process corresponding to state N2, namely "hold the screwdriver in a way that does not strain the wrist", and begins the work.

[0067] The work information acquisition unit 110 acquires image data of the operator's work status input via camera 30 as work information. The analysis unit 112 uses the image data to analyze whether the wrist is bent during the screw tightening operation. Based on the work information, the analysis unit 112 generates an analysis result, i.e., work status information ("wrist bent" or "wrist not bent"), and outputs it to the information decision unit 114. The self-perception information acquisition unit 111 acquires the operator's self-perception information input via input device 50. The operator inputs self-perception information related to each prescribed work via input device 50. If the operator determines, based on self-perception information, that a prescribed work has been performed or not performed in accordance with the work instructions, they press one or the other of the two switches provided on input device 50. The self-perception information acquisition unit 111 acquires the operator's self-perception information regarding the work instruction D2, "hold the screwdriver in a way that does not strain the wrist," via input device 50. As an example, the self-perception information acquisition unit 111 acquires the operator's self-perception information ("wrist bent" or "wrist not bent") based on the pressing of one or the other of the two switches.

[0068] When the information decision unit 114 is in state N2, it transitions from state N2 to state N3 based on self-perceived information ((1) "wrist not bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist not bent"). The information decision unit 114 determines the third work instruction content group corresponding to state N3, and determines the work instruction content D3 of the third work instruction content group ("do not press the screwdriver forcefully"). The information prompting unit 115 prompts the operator with the determined work instruction content D3 as the information for the next work instruction. When the information decision unit 114 is in state N2, it maintains state N2 based on self-perceived information ((1) "wrist bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist bent"). The information decision unit 114 determines the second work instruction content group corresponding to state N2, and determines the work instruction content D2 of the second work instruction content group ("hold the screwdriver in a way that does not strain the wrist"). Information prompting unit 115 will prompt the operator with the determined work instruction content D2 as the next work instruction.

[0069] When the information decision unit 114 is in state N2, it transitions from state N2 to state N2A based on self-perceived information ((1) "wrist not bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist is bent"). The information decision unit 114 determines the second work instruction content group corresponding to state N2A, and determines the work instruction content D2a of the second work instruction content group ("adopt a posture that forms a triangle with the center of the body, elbow, and screwdriver"). The information prompting unit 115 prompts the worker with the determined work instruction content D2a as the information for the next work instruction. When the information decision unit 114 is in state N2, it transitions from state N2 to state N2B based on self-perceived information ((1) "wrist bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist not bent"). The information decision unit 114 determines the second work instruction content group corresponding to state N2B, and determines the work instruction content D2b of the second work instruction content group ("The last work was performed with the wrist not bent. Perform the work in the same manner"). The information prompting unit 115 prompts the operator with the determined work instruction content D2b as the information for the next work instruction.

[0070] When the information decision unit 114 is in state N2A, it maintains state N2A based on self-perception information ((1) "wrist not bent" or "wrist bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist bent"). The information decision unit 114 determines the second work instruction content group corresponding to state N2A, and determines the work instruction content D2a of the second work instruction content group ("adopt a posture that forms a triangle with the center of the body, elbow, and screwdriver"). The information prompting unit 115 prompts the worker with the determined work instruction content D2a as the information for the next work instruction. When the information decision unit 114 is in state N2A, it transitions from state N2A to state N2B based on self-perception information ((1) "wrist bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist not bent"). The information decision unit 114 determines the second work instruction content group corresponding to state N2B, and determines the work instruction content D2b of the second work instruction content group ("The last work was performed with the wrist not bent. Perform the work in the same manner"). The information prompting unit 115 prompts the operator with the determined work instruction content D2b as the information for the next work instruction.

[0071] When the state is N2A, the information decision unit 114 transitions from state N2A to state N2 based on self-perceived information ((1) "wrist not bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist not bent"). The information decision unit 114 determines the second work instruction content group corresponding to state N2, and determines the work instruction content D2 of the second work instruction content group ("hold the screwdriver in a way that does not strain the wrist"). The information prompting unit 115 prompts the worker with the determined work instruction content D2 as the information for the next work instruction.

[0072] When the information decision unit 114 is in state N2B, it maintains state N2B based on self-perceived information ((1) "wrist bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist not bent"). The information decision unit 114 determines the second work instruction content group corresponding to state N2B, and determines the work instruction content D2b of the second work instruction content group ("The last work was performed with the wrist not bent. Perform the work in the same manner"). The information prompting unit 115 prompts the worker with the determined work instruction content D2b as the information for the next work instruction. When the information decision unit 114 is in state N2B, it transitions from state N2B to state N2A based on self-perceived information ((1) "wrist not bent" or "wrist bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist bent"). Information decision unit 114 determines the second work instruction content group corresponding to state N2A, and determines the work instruction content D2a of the second work instruction content group ("adopt a posture that forms a triangle with the center of the body, elbow, and screwdriver"). Information prompting unit 115 prompts the operator with the determined work instruction content D2a as the information for the next work instruction.

[0073] When the state is N2B, the information decision unit 114 transitions from state N2B to state N2 based on self-perceived information ((1) "wrist not bent") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "wrist not bent"). The information decision unit 114 determines the second work instruction content group corresponding to state N2, and determines the work instruction content D2 of the second work instruction content group ("hold the screwdriver in a way that does not strain the wrist"). The information prompting unit 115 prompts the worker with the determined work instruction content D2 as the information for the next work instruction.

[0074] (Work Instructions Group 3)

[0075] The operator confirms the work instruction information D3 corresponding to state N3, namely "Do not press the screwdriver with force" during the work process, and then begins the work.

[0076] The work information acquisition unit 110 acquires pressure data of the operator's work status input via the screwdriver DR as work information. The analysis unit 112 uses the pressure data to analyze whether the screwdriver DR was pressed with excessive force. Based on the work information, the analysis unit 112 generates an analysis result, i.e., work status information ("no excessive force applied" or "excessive force applied"), and outputs it to the information decision unit 114. The self-perception information acquisition unit 111 acquires the operator's self-perception information input via the input device 50. The operator inputs self-perception information related to each prescribed work via the input device 50. If the operator determines, based on self-perception information, that a prescribed work following the work instruction has been performed or not, they press one or the other of the two switches provided on the input device 50. The self-perception information acquisition unit 111 acquires the operator's self-perception information regarding the work instruction "do not press the screwdriver with excessive force" during the work process, which is the work instruction content D3. As an example, the self-perception information acquisition unit 111 acquires the operator's self-perception information ("pressed with force" or "not pressed with force") based on the pressing of one or the other of the two switches.

[0077] When the information decision unit 114 is in state N3, it transitions from state N3 to state N4 based on the user's subjective feeling ((1) "not pressed with force") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "not applied with force"). The information decision unit 114 decides not to display any content as state N4. The information prompting unit 115 does not prompt the operator with information about the next work instruction. When the information decision unit 114 is in state N3, it maintains state N3 based on the user's subjective feeling ((1) "pressed with force") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "applied with force"). The information decision unit 114 determines the third work instruction content group corresponding to state N3, and determines the work instruction content D3 of the third work instruction content group ("do not press the screwdriver with force"). The information prompting unit 115 prompts the operator with the determined work instruction content D3 as the information for the next work instruction.

[0078] When the information decision unit 114 is in state N3, it transitions from state N3 to state N3A based on self-perceived information ((1) "not pressed with force") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "force was applied"). The information decision unit 114 determines the third work instruction content group corresponding to state N3A, and determines the work instruction content D3a of the third work instruction content group ("hold the screwdriver with your thumb and middle finger and press it down"). The information prompting unit 115 prompts the operator with the determined work instruction content D3a as the information for the next work instruction. When the information decision unit 114 is in state N3, it transitions from state N3 to state N3B based on self-perceived information ((1) "pressed with force") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "not applied with force"). The information decision unit 114 determines the third work instruction content group corresponding to state N3B, and determines the work instruction content D3b of the third work instruction content group ("The last work was not pressed with force. Perform the work in the same way"). The information prompting unit 115 prompts the operator with the determined work instruction content D3b as the information for the next work instruction.

[0079] When the information decision unit 114 is in state N3A, it maintains state N3A based on self-perceived information ((1) "pressed with force" or "not pressed with force") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "force was applied"). The information decision unit 114 determines the third work instruction content group corresponding to state N3A and determines the work instruction content D3a of the third work instruction content group ("hold the screwdriver with your thumb and middle finger and press it down"). The information prompting unit 115 prompts the operator with the determined work instruction content D3a as the information for the next work instruction. When the information decision unit 114 is in state N3A, it transitions from state N3A to state N3B based on self-perceived information ((1) "pressed with force") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "not applied with force"). The information decision unit 114 determines the third work instruction content group corresponding to state N3B, and determines the work instruction content D3b of the third work instruction content group ("The last work was not pressed with force. Perform the work in the same way"). The information prompting unit 115 prompts the operator with the determined work instruction content D3b as the information for the next work instruction.

[0080] When the state is N3A, the information decision unit 114, based on its own perception information ((1) "not pressed with force") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "not applied with force"), transitions from state N3A to state N3. The information decision unit 114 determines the third work instruction content group corresponding to state N3, and determines the work instruction content D3 of the third work instruction content group ("do not press the screwdriver with force"). The information prompting unit 115 prompts the operator with the determined work instruction content D3 as the information for the next work instruction.

[0081] When the information decision unit 114 is in state N3B, it maintains state N3B based on self-perceived information ((1) "pressed with force") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "no force was applied"). The information decision unit 114 determines the third work instruction content group corresponding to state N3B and determines the work instruction content D3b of the third work instruction content group ("the last work was not pressed with force. Perform the work in the same way"). The information prompting unit 115 prompts the operator with the determined work instruction content D3b as the information for the next work instruction. When in state N3B, the information decision unit 114 transitions from state N3B to state N3A based on self-perceived information ((1) "pressed with force" or "not pressed with force") and the analysis result of the analysis unit 112, i.e., the work status information ((2) "force was applied"). The information decision unit 114 determines the third work instruction content group corresponding to state N3A, and determines the work instruction content D3a of the third work instruction content group ("Hold the screwdriver with your thumb and middle finger and press down"). The information prompting unit 115 prompts the operator with the determined work instruction content D3a as the information for the next work instruction.

[0082] When the state is N3B, the information decision unit 114, based on its own perception information ((1) "not pressed with force") and the analysis results of the analysis unit 112, i.e., the work status information ((2) "not applying strong force"), transitions from state N3B to state N3. The information decision unit 114 determines the third work instruction content group corresponding to state N3, and determines the work instruction content D3 of the third work instruction content group ("do not press the screwdriver with force"). The information prompting unit 115 prompts the operator with the determined work instruction content D3 as the information for the next work instruction.

[0083] Figure 7 This diagram illustrates the determination of the work instruction content for the first work instruction content group in the implementation method. (Refer to...) Figure 7The information used to determine the next task instruction is based on (1) self-perceived information ("stood straight" or "did not stand straight") and (2) task status information ("stood straight" or "did not stand straight").

[0084] Figure 8 This diagram illustrates the determination of the work instruction content for the second work instruction content group in the implementation method. (Refer to...) Figure 8 The information used to determine the next task instruction is based on (1) self-perceived information ("wrist bent" or "wrist not bent") and (2) task status information ("wrist not bent" or "wrist bent").

[0085] Figure 9 This diagram illustrates the determination of the work instruction content for the third work instruction content group in the implementation method. (Refer to...) Figure 9 The information used to determine the next work instruction is based on (1) self-perceived information ("pressed with force" or "pressed without force") and (2) work status information ("no force was applied" or "force was applied").

[0086] In this example, the scenario of setting up task instruction content groups 1 through 3 has been described, but it is also possible to set up other task instruction content groups. Alternatively, it is also possible to set up only one task instruction content group.

[0087] In this example, the work instructions during the work process are determined based on the worker's self-perceived information related to the task, thus providing work instructions that match the worker's condition. For example, if the worker's self-perceived information indicates they are unable to perform the task appropriately, but they are actually capable of performing it appropriately, the instructions can be tailored to the worker's condition, allowing them to continue working with peace of mind. Similarly, if the worker's self-perceived information indicates they are capable of performing the task appropriately, but they are actually unable to, another work instruction can be provided in a way that indicates they are capable of performing it appropriately, thus providing work instructions tailored to the worker's condition to enable them to perform the task appropriately.

[0088] In this example, we have described a scenario where the operator's subjective feelings (work appropriate or inappropriate) are sent to the server 20 via input device 50. However, this is not the only example; the operator's subjective feelings (understanding or not understanding the work instructions) related to their comprehension of the work instructions can also be sent to the server 20. For example, if the operator's subjective feelings indicate that they cannot understand the work instructions, the work instructions can be modified in a way that makes them understandable. This allows the operator to receive work instructions that match their condition, enabling them to continue working with peace of mind. Alternatively, if the operator's subjective feelings indicate that they understand the work instructions, but they are actually unable to perform the work appropriately, another work instruction can be provided in a way that makes the work appropriate. This allows the operator to receive work instructions that match their condition, enabling them to perform the work appropriately.

[0089] In this example, we will describe a case where two switches are set on the input device 50 to classify the operator's self-perception information into two categories. Specifically, as self-perception information, we will describe a case where the operation is appropriate or inappropriate. However, we are not limited to this. We can further set multiple switches to classify the operator's self-perception information into multiple modes. Based on the analysis results of the analysis unit 112, namely the operator's work status information in response to the work instructions and the operator's work-related self-perception information, we will determine the work instructions information during the operation process.

[0090] In this example, a structure for a switch that the operator can selectively press is described as one example of input device 50. However, it is not limited to a switch; a keyboard or other input devices can also be used to receive self-perceived information. For example, a microphone can be used as input device 50. For example, sound can also be input to the microphone to obtain the operator's self-perceived information.

[0091] In this example, the use of tilt sensor 16 and pressure sensor 15 of the screwdriver DR to determine whether the screwdriver is held vertically relative to the screw and whether it is not being pressed down forcefully is explained. However, this is not a limitation, and other methods can be used to perform the above determinations. For example, image data from camera 30 can be analyzed to determine whether the screwdriver is held vertically relative to the screw, thereby generating work status information. Similarly, image data from camera 30 can also be analyzed to determine whether the screwdriver is not being pressed down forcefully, thereby generating work status information.

[0092] In this example, the method by which the analysis unit 112 analyzes job information to generate the operator's job status information has been described, but it is not limited to this. The job status information can also be input from an external source. For example, the operator's manager can observe the operator's compliance with job instructions and input the job status information based on the manager's observation into the server 20. For example, an input device 50 for the manager can be set up to input the job status information ("straight" or "not straight") into the server 20.

[0093] Embodiments of the invention have been described, but should be considered illustrative rather than limiting in all respects. The scope of the invention is set forth in the claims and is intended to include all modifications within the meaning and scope equivalent to the claims.

[0094] Label Explanation

[0095] 1: Work assistance system; 10: Projector; 11: Housing; 12: Blade tip component; 14: Power circuit; 15: Pressure sensor; 16: Tilt sensor; 17: Communication unit; 18: Antenna; 20: Server; 30: Camera; 50: Input device; 101: Processor; 102: Memory; 103: Storage device; 104: Display controller; 105: Input interface; 106: Communication interface; 110: Work information acquisition unit; 111: Self-perception information acquisition unit; 112: Analysis unit; 114: Information decision unit; 115: Information prompting unit; 131: Work assistance program; 132: Work information; 133: Content information.

Claims

1. A work assistance device, wherein, This work assistance device has the following features: The information decision-making unit determines the information of the work instructions during the work process of the operator based on the operator's work status information in response to the work instructions and the operator's self-perception information related to the work. as well as The information prompting unit prompts information about the work instructions determined by the information decision unit.

2. The work assistance device according to claim 1, wherein, This work assistance device also has: The job information acquisition unit acquires the job information of the worker; and The analysis unit analyzes the work information of the operator obtained by the work information acquisition unit to generate work status information.

3. The work assistance device according to claim 1, wherein, The work assistance device also has a self-perception information acquisition unit, which acquires the worker's work-related self-perception information.

4. The work assistance device according to claim 1, wherein, The work assistance device has an information storage unit that stores multiple work instruction contents that serve as information for the work instructions. The multiple task contents are categorized into multiple task instruction content groups. The information decision unit determines one of the multiple sets of work instruction content based on the work status information and self-perception information, and determines one of the multiple work instruction contents in the determined set of work instruction content.

5. The work assistance device according to claim 1, wherein, The work assistance device also has an information receiving unit, which accepts the input of the operator's self-perception information.

6. The work assistance device according to claim 5, wherein, The operator's self-perception information is information related to whether or not they have understood the work instructions.

7. The work assistance device according to claim 5, wherein, The operator's self-perception information is information related to whether the work performed in accordance with the work instructions was appropriate.

8. A method for assisting with a task, wherein, This task assistance method includes the following steps: Based on the operator's work status information in response to work instructions and the operator's self-perception information related to the work, the information of the work instructions during the work process of the operator is determined; as well as The prompt indicates the information regarding the determined work instructions.

9. A job assistance program that causes a computer to perform a job assistance method, wherein, This task assistance method includes the following steps: Based on the operator's work status information in response to work instructions and the operator's self-perception information related to the work, the information of the work instructions during the work process of the operator is determined; as well as The prompt indicates the information regarding the determined work instructions.

Images