Work support device and work support method

Abstract

The present invention provides technology for assisting with work depending on the work-performing state of a worker.　This work assistance device comprises: a stop detection unit that determines whether sensor information acquired by a sensor device attached to a worker satisfies a prescribed first condition, detects the stopping of work, and identifies the work; and a stop state recognition unit that, if the stopping of said work is detected, notifies the worker of the stop by means of light, sound, or vibration.

Description

[Technical field]

[0001] The present invention relates to a task assistance device and a task assistance method. [Background technology]

[0002] Patent Document 1 describes a work recording system equipped with a control unit that includes a video analysis unit that acquires video of a worker and analyzes the video to identify gestures made by the worker, an input identification unit that identifies the input of process start or process completion represented by the gesture, and an information processing unit that calculates the work time spent by the worker on a process from the time when the process start was input and the time when the process completion was input. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-109658 A Summary of the Invention [Problem to be solved by the invention]

[0004] The above technology can calculate the task time from video that includes the worker's movements, but does not provide support for the task based on the worker's performance status.

[0005] An object of the present invention is to provide a technique for supporting a work according to the working situation of a worker. [Means for solving the problem]

[0006] The present application includes a number of means for solving at least part of the above problems, examples of which are as follows: A work support device according to one aspect of the present invention includes an interruption detection unit that detects an interruption of work by determining whether or not sensor information acquired by a sensor device attached to a worker satisfies a predetermined first condition, and identifies the work, and an interruption state recognition unit that notifies the worker of the interruption by light, sound, or vibration when the interruption of the work is detected.

[0007] Further, for example, in the above-mentioned work assistance device, the interruption detection unit may generate display information that identifies work content to be performed after resumption of the work for which interruption has been detected, and provides instructions on the work content.

[0008] For example, in the above-mentioned work assistance device, the sensor device may acquire an image including at least a part or all of the worker's field of vision as the sensor information, and the interruption state recognition unit may create screen information that displays the image at the time of interruption by including it in the display information.

[0009] Furthermore, for example, the above-mentioned work assistance device may be provided with a restart operation determination unit that determines whether the sensor information satisfies a predetermined second condition and detects the resumption of the work whose interruption has been detected, and a restart notification unit that notifies the display information about the work whose resumption has been detected.

[0010] Furthermore, for example, in the above-described work assistance device, the interrupted state recognition unit may identify at least a task to be performed after resuming the interrupted task, and display an explanatory video of the task.

[0011] Also, for example, in the above-mentioned work assistance device, the interruption detection unit may determine that the specified first condition is met when the image includes a display screen or a procedure manual for the work, or when the image does not include the worker's hands.

[0012] For example, in the above-mentioned work assistance device, the sensor device may acquire at least the voice spoken by the worker as the sensor information, and the interruption detection unit may determine that the specified first condition is satisfied when the voice includes a conversation with another person for a predetermined period of time or longer.

[0013] For example, in the above-mentioned work assistance device, the sensor device may acquire at least biometric information of the worker as the sensor information, and the interruption detection unit may determine that the specified first condition is satisfied when the biometric information is not within a specified normal range.

[0014] For example, in the above-mentioned work assistance device, the sensor device may acquire an image including at least a part or all of the worker's field of vision or a voice uttered by the worker as the sensor information, and the resume operation determination unit may determine that the specified second condition is satisfied when at least the image includes a specified gesture of the worker or the voice includes a specified utterance of the worker.

[0015] Further, for example, in the above-mentioned work assistance device, the sensor device may acquire at least biometric information of the worker as the sensor information, and the resume operation determination unit may determine that the specified second condition is satisfied when the biometric information is within a specified normal range.

[0016] Furthermore, for example, the work support device may further include a calibration unit that calibrates a value serving as a criterion for determining the first condition, the second condition, or both of the first condition and the second condition.

[0017] Further, for example, the above-mentioned work support device may be provided with an evidence acquisition unit that stores the sensor information relating to the work before and after the interruption in a specified memory unit, and reproduces the sensor information in response to a request from another device.

[0018] Furthermore, for example, the work support device may further include an improvement suggestion unit that calculates statistical information related to the interruption for each worker and indicates a task that is significantly different from that of other workers.

[0019] Furthermore, a work assistance method according to another aspect of the present invention is a work assistance method using a work assistance device, the work assistance device including a processing unit, which performs an interruption detection step of detecting an interruption of work by determining whether sensor information acquired by a sensor device attached to a worker satisfies a predetermined first condition and identifying the work, and an interruption state recognition step of notifying the worker of the interruption by light, sound or vibration upon detecting the interruption of the work. Effect of the Invention

[0020] According to the present invention, it is possible to provide a technique for supporting a task according to the worker's working situation.

[0021] Problems, configurations and effects other than those described above will become apparent from the following description of the embodiments. [Brief description of the drawings]

[0022] [Figure 1] 1 is a block diagram illustrating a configuration of a work support system according to an embodiment. [Diagram 2] FIG. 4 illustrates an example of a data structure of a setting storage unit; [Diagram 3] FIG. 13 illustrates an example of a data structure of an evidence storage unit. [Figure 4] 13 illustrates an example of a data structure of an advice storage unit; FIG. [Diagram 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of a work support device. [Figure 6] FIG. 11 illustrates an example of a detection start process flow. [Figure 7] FIG. 13 is a diagram illustrating an example of a suspend / resume processing flow. [Figure 8] FIG. 11 is a diagram illustrating an example of an analysis processing flow. [Figure 9]FIG. 13 is a diagram illustrating an example of a setting screen. [Figure 10] FIG. 13 is a diagram showing an example of an evidence confirmation screen. [Figure 11] FIG. 13 is a diagram showing an example of an analysis result confirmation screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] A work support system 1 to which an embodiment according to one aspect of the present invention is applied will be described below with reference to the drawings. In the following embodiment, when necessary for convenience, the description will be divided into a plurality of sections or embodiments, but unless otherwise specified, they are not unrelated to each other, and one is a partial or complete modification, detail, supplementary explanation, etc. of the other.

[0024] In addition, in the following embodiments, when referring to the number of elements (including the number, numerical values, quantities, ranges, etc.), unless specifically stated or clearly limited to a specific number in principle, the number is not limited to that specific number and may be more than or less than a specific number.

[0025] Furthermore, in the following embodiments, the components (including element steps, etc.) are not necessarily essential unless specifically stated otherwise or considered to be clearly essential in principle.

[0026] Similarly, in the following embodiments, when referring to the shapes, positional relationships, etc. of components, etc., unless otherwise specified or considered to be obviously different in principle, it includes those that are substantially similar or similar to the shapes, etc. The same applies to the above numerical values ​​and ranges.

[0027] In addition, in all the drawings for explaining the embodiments, the same members are generally given the same reference numerals, and repeated explanations thereof will be omitted.

[0028] Work is always accompanied by mistakes. It is believed that mistakes are caused by psychological upsets and an "increase in mistake potential" that induces mistakes. In order to prevent mistakes from occurring, it is important not to increase the mistake potential. Examples of mistakes include being interrupted by a colleague or interrupting a task to perform another task, and then making an erroneous operation after returning from the interruption. In such cases, the interruption reduces attention, and causes misunderstanding or negligence of the work situation, which increases the mistake potential. In order to reduce the mistake potential, it is considered effective to make the worker aware of the interruption and, when returning, to reliably inform him of the work situation before the interruption and the tasks to be performed after returning.

[0029] Specifically, if the work status can be grasped at any time by an information processing device and notified to the worker, it is believed that the worker will pay more attention to the work content, misunderstanding of the work status will decrease, and an increase in the error potential will be suppressed.To achieve this, it is believed to be effective to utilize an information processing system that specifies the work to be interrupted, detects interruption behavior, notifies the worker, specifies the interruption return conditions, confirms the next work after return, and provides instructions to resume work in a timely manner.

[0030] 1 is a block diagram illustrating a configuration of a work support system according to this embodiment. In the work support system 1, a worker wears a sensor device 100 to perform work, and transfers detected sensor information to a work support device 200. The sensor device 100 transfers the sensor information to the work support device 200 preferably via a wireless network 50, and is controlled by the work support device 200. Note that the communication path between the sensor device 100 and the work support device 200 is not limited to the wireless network 50, and may be via wireless communication such as Bluetooth (registered trademark) or 802.11 series, a wired connection such as USB (Universal Serial Bus), or a wired network such as LAN (Local Area Network).

[0031] The work support device 200 is communicably connected to the management device 300 via a communication path such as the Internet. The work support device 200 receives various settings related to detection of interruption and resumption from the management device 300. The work support device 200 also outputs a work record in a referable manner in response to a request from the management device 300.

[0032] The wireless network 50 through which the work assistance device 200 and the sensor device 100 are connected for communication may be a WAN (Wide Area Network), the Internet, a mobile phone network, or a combination of these. The wireless network 50 may be a VPN (Virtual Private Network) on a wireless communication network such as a mobile phone network.

[0033] An example of the application of the work assistance system 1 is a business system that assists workers in managing structures such as bridges and buildings, where the workers work outdoors using both hands.

[0034] In a task using the task support system 1, a worker moves the location where the task is performed for each task and task object. Therefore, it is desirable that the sensor device 100 is a wearable device that allows both hands to be used freely. In addition, when one hand is used to hold the sensor device 100 or the movable range of both hands is limited, holding the sensor device 100 may reduce work efficiency, so it is desirable that the sensor device 100 is a wearable device, but a wearable device is not essential. In the following embodiment, the sensor device 100 is implemented as a wearable device that can be used hands-free. For example, the sensor device 100 is a wearable camera that acquires an image including at least a part or all of the worker's field of vision as sensor information, a wearable microphone that acquires the voice of the worker as sensor information, and a vital sensor that acquires the worker's biological information as sensor information.

[0035] Furthermore, without being limited to this, the sensor device 100 may include various sensors such as a glove-type sensor (a combination of a fingertip pressure sensor, an inertial sensor, and a microphone), a heart rate sensor (obtaining the worker's heart rate using clothing made of conductive fibers), a wristwatch sensor (obtaining the wearer's venous blood oxygen concentration (SpO2: transcutaneous oxygen saturation)), a room temperature sensor (temperature sensor), and an electromyography sensor (obtaining the amount of movement of the worker).

[0036] The sensor device 100 includes a detection processing unit 110, a communication unit 120, and a display unit 130. The detection processing unit 110 receives control via a wireless network 50 and detects a measurement target. The communication unit 120 transmits sensor information including information on the measurement target detected by the detection processing unit 110 via the wireless network 50. The display unit 130 displays screen information, messages, AR (Augmented Reality), VR (Virtual Reality), MR (Mixed Reality), and the like. When there are multiple sensor devices 100 worn by an operator, the display unit 130 may be provided in any one of them.

[0037] The work assistance device 200 is an information processing device including a storage unit 210, a processing unit 220, and a communication unit 230. The work assistance device 200 is, for example, a smartphone or a tablet PC carried by a worker. In this case, the wireless network 50 is a short-range wireless communication network such as Bluetooth or NFC (Near Field Communication), or a wired peer-to-peer communication line such as a USB cable.

[0038] Alternatively, the work support device 200 may be implemented by a server device or the like on a cloud. In that case, the wireless network 50 is a wide area communication network such as the Internet or a mobile phone network.

[0039] The storage unit 210 includes a setting storage unit 211 , an evidence storage unit 212 , and an advice storage unit 213 .

[0040] 2 is a diagram showing an example of a data structure of the setting storage unit. The setting storage unit 211 stores setting information required for the operation of the work support device 200 in a key-value format (a data structure in which setting items and setting values ​​of the items are stored in association with each other). In particular, the setting storage unit 211 includes settings for defining interruptions to work, notification methods when an interruption is detected, and operations to be performed for resuming work when an interruption is detected.

[0041] The example of the setting storage unit 211 in FIG. 2 is an example in which a setting hierarchy 211A, an item 211B, a setting value 211C, a valid period 211D, and an invalid period 211E are stored in association with each other. Information for identifying the hierarchy of the setting is stored in the setting hierarchy 211A. Each setting value is defined hierarchically in consideration of the operation set by a plurality of setting persons, and the setting of the lower hierarchy is adopted preferentially. Specifically, the structure is such that a higher-level organization cross-sectionally sets the settings of the lower organizations under its jurisdiction, and the lower organizations adopt the settings of the higher-level organization as default values ​​while setting and overwriting their own setting values ​​to suit the business of the lower organizations.

[0042] For example, in order to set settings common to all companies in an entire corporate group and allow each company to overwrite and use its own settings, the upper level is the setting layer for the corporate group, the lower level is the setting layer for each company, and even lower levels are set for each department of the company, with different setting values ​​for each business field.

[0043] The set value may be set stricter or looser in a lower hierarchy than in a higher hierarchy. For example, if a set value is set as a rule for each department, such as "looking away for 5 seconds is judged as an interruption," depending on the work to be done that day, the rule may be set stricter for each worker, such as "looking away for 3 seconds is judged as an interruption," or looser, such as "looking away for 10 seconds is judged as an interruption."

[0044] Information for identifying a setting item is stored in item 211B. Setting value 211C stores a setting value of the item identified by item 211B.

[0045] The validity period 211D stores information that specifies the period during which the setting value of the item specified by the item 211B is valid.

[0046] In the invalid period 211E, information specifying the period during which the setting value of the item specified by the item 211B is invalid is stored.

[0047] 3 is a diagram showing an example of the data structure of the evidence storage unit 212. The evidence storage unit 212 includes a worker identifier 212A, an executed task 212B, interruption status 212C, interruption time 212D, and video information 212E.

[0048] The worker identifier 212A is information for identifying a worker. The performed work 212B is information for identifying a work performed by the worker identified by the worker identifier 212A. The interruption presence / absence 212C is information for identifying whether an interruption was detected in the performed work 212B. The interruption time 212D is information for identifying the time when the interruption occurred when the interruption presence / absence 212C indicates that there was an interruption. The video information 212E is video spanning a predetermined period before and after the time when the interruption occurred (for example, between 15 seconds before the interruption and 15 seconds after recovery).

[0049] 4 is a diagram showing an example of a data structure of the advice storage unit. The advice storage unit 213 stores advice information such as improvement points for each worker obtained as a result of acquiring statistical information on interruptions for each worker and analyzing it using a predetermined algorithm. The advice storage unit 213 includes a worker identifier 213A, an interruption frequency 213B, an interruption reason 213C, an interrupted task 213D, an interruption time 213E, and advice 213F.

[0050] The worker identifier 213A is information for identifying a worker. The interruption frequency 213B is information for identifying the frequency with which interruptions occurred in the work performed by the worker identified by the worker identifier 213A. The interruption reason 213C is information in which interruption reasons (conditions satisfied when an interruption was detected) are arranged in order of frequency of occurrence as reasons for interruption for the worker. The interrupted work 213D is information in which the work in which interruptions occur frequently occurs for the worker. The interruption time 213E is information in which the time periods in which interruptions occur for the worker are arranged in order of frequency of occurrence. The advice 213F is information on advice such as improvements for each worker obtained as a result of performing an analysis using a predetermined algorithm using the information on the interruption frequency 213B, the interruption reason 213C, the interrupted work 213D, and the interruption time 213E for each worker.

[0051] The processing unit 220 includes an interruption detection unit 221, an interruption state recognition unit 222, a resume operation determination unit 223, a resume notification unit 224, a setting unit 225, an improvement proposal unit 226, a calibration unit 227, an exclusion work setting unit 228, and an evidence acquisition unit 229.

[0052] The interruption detection unit 221 detects an interruption of a task by determining whether or not the sensor information acquired by the sensor device 100 attached to the worker satisfies a predetermined first condition, and identifies the task. The predetermined first condition is that the state of the worker estimated from the sensor information by a predetermined algorithm is in a state previously determined as a set value.

[0053] Specifically, conditions for detecting an interruption include a state in which a laptop (notebook PC) or the display screen of the laptop is visible in part of the image in the worker's field of vision for a predetermined period of time (e.g., 2 seconds), a state in which a manual (document such as a work procedure manual) is visible in part of the image in the worker's field of vision for a predetermined period of time (e.g., 2 seconds), a state in which the worker's hands are not visible in part of the image in the worker's field of vision for a predetermined period of time (e.g., 10 seconds), a state in which the worker's speech includes a conversation with another person that lasts for longer than a predetermined period of time, and a state in which various biological information such as the worker's heart rate, blood oxygen concentration, muscle potential, etc. are not within a predetermined normal range.

[0054] When the interruption state recognition unit 222 detects that the worker has interrupted his / her work, it notifies the worker of the interruption by light (visual information), audio guidance, or vibration.

[0055] Furthermore, the interrupted state recognition unit 222 generates display information for the work for which interruption has been detected. For example, the interrupted state recognition unit 222 creates display information including screen information that displays an image of the worker's field of vision at the time of interruption. For example, the interrupted state recognition unit 222 generates display information that identifies at least the work content to be performed after resumption and instructs the work content. For example, the interrupted state recognition unit 222 identifies and displays the work that was completed before the interruption. Alternatively, the interrupted state recognition unit 222 identifies and displays at least the interrupted work and the work to be performed after the work is resumed. Furthermore, when the interrupted state recognition unit 222 identifies the work to be performed after the interrupted work is resumed, it may refer to the work information (not shown) in the storage unit 210 and identify and display an explanatory video for the work to be performed after the work is resumed.

[0056] The restart operation determination unit 223 determines whether the sensor information satisfies a second predetermined condition and detects that the interrupted work has been restarted. The second predetermined condition is that the state of the worker estimated from the sensor information by a predetermined algorithm is in a state previously determined as a set value.

[0057] Specifically, conditions for detecting resumption include a state in which a specified gesture by the worker is included in an image of part of the worker's field of vision, a state in which a specified utterance is included in the worker's speech, a state in which the worker's biometric information is within a specified normal range, or a combination of these.

[0058] The resume notification unit 224 notifies the worker of the work to be performed after the resume when the resume operation determination unit 223 detects the resume of the work. Specifically, the resume notification unit 224 creates display information indicating the work that the worker was performing, the history of the work content, and the work to be performed after the resume, and displays the information on the display unit 130 of the sensor device 100.

[0059] The setting unit 225 accepts settings from the management device 300 via the network, and stores them in the setting storage unit 211. Furthermore, upon receiving a request from the management device 300, the setting unit 225 creates a setting screen for accepting the settings, and causes the management device 300 to display it.

[0060] The improvement suggestion unit 226 calculates statistical information related to interruptions of work for each worker. The improvement suggestion unit 226 creates a screen for suggesting improvements to work efficiency by showing the work or time period with a large difference compared to other workers, and causes the management device 300 to display the screen.

[0061] The calibration unit 227 calibrates a value serving as a criterion for determining the first condition, the second condition, or both of them. Specifically, the calibration unit 227 performs a calibration process or a learning process to allow for variations in the movements of the worker by widening the allowable range of similarity in determining the gesture, or to reduce false detections by determining the gesture more accurately. Even for the same worker, the learning process is necessary because there is a possibility that the sensor information will vary due to changes in the work environment (work position, work posture, work target, outside temperature, etc.). The algorithm used for this calibration or learning process may be an existing one.

[0062] The exclusion work setting unit 228 receives settings for work that excludes application of interruption detection from the management device 300 via the network, and stores the settings in the setting storage unit 211. Furthermore, upon receiving a request from the management device 300, the exclusion work setting unit 228 creates a setting screen for receiving the settings, and causes the management device 300 to display the setting screen.

[0063] The evidence acquiring unit 229 stores the sensor information in the evidence storage unit 212. In addition, the evidence acquiring unit 229 stores sensor information relating to the work before and after the interruption in the evidence storage unit 212, and reproduces the sensor information in response to a request from the management device 300.

[0064] The communication unit 230 receives sensor information including information on a measurement target detected by the sensor device 100 via the wireless network 50. The communication unit 230 also controls the operation of the sensor device 100, such as issuing an instruction to start detection or stopping detection.

[0065] The management device 300 is an information processing device such as a personal computer or a workstation, and is connected to the work support device 200 via a communication network such as the Internet (not shown), inputs setting values, and refers to work records stored in the work support device 200. Note that the management device 300 is not limited to this, and may be a smartphone, a tablet device, or a server device.

[0066] The worker wears one or more of the following sensor devices 100: a wearable camera, a wearable microphone, a vital sensor, a glove-type sensor which is a combination of various sensor devices (a combination of a fingertip pressure sensor, an inertial sensor, and a microphone), a heart rate sensor (which acquires the worker's heart rate using clothing made of conductive fibers), a wristwatch sensor (which acquires the wearer's venous blood oxygen concentration (SpO2: transcutaneous oxygen saturation)), a room temperature sensor (temperature sensor), an electromyography sensor (which acquires the worker's movement amount), etc.

[0067] An example of the usage is that a smartphone held by a worker is used as the work support device 200, paired with the sensor device 100 worn by the worker, and sensor information is acquired to detect interruption and resumption. Also, a management device 300 provided in an organization that manages workers accesses the work support device 200 to check evidence of the worker's work and perform management tasks such as changing settings to optimize the support operation. Also, improvement points for each worker calculated by the improvement suggestion unit 226 are acquired from the management device 300 and used for training and work quality management.

[0068] The implementation is not limited to the above example. For example, if the sensor device 100 is capable of operating as an IoT (Internet of Things) device, the work assistance device 200 can be implemented as a cloud server and configured to receive sensor information from the sensor device 100 via the Internet.

[0069] Also, for example, a smartphone carried by a worker may be used as the work support device 200, and the sensor device 100 may be realized by the work support device 200. In other words, by using the camera function of the smartphone as a wearable camera that obtains the worker's field of view, the worker's equipment can be made lighter and work efficiency can be prevented from decreasing. It goes without saying that other implementable devices may be combined to obtain similar information and perform control.

[0070] 5 is a diagram showing an example of the hardware configuration of the work support device 200. The work support device 200 has a hardware configuration realized by the housing of a so-called server device, a workstation, a personal computer, a smartphone, or a tablet terminal. The work support device 200 has a calculation device 201, a main memory device 202, an auxiliary memory device 203, a communication device 204, and a bus 207 connecting each device. The same is true for the management device 300. In addition, the management device 300 has input / output devices such as a touch panel, a keyboard, a microphone, and a display.

[0071] The arithmetic device 201 is, for example, a arithmetic device such as a CPU (Central Processing Unit).

[0072] The main storage device 202 is a memory device such as a RAM (Random Access Memory).

[0073] The auxiliary storage device 203 is a non-volatile storage device capable of storing digital information, such as a so-called hard disk drive, a solid state drive (SSD), or a flash memory.

[0074] The communication device 204 is a wired communication device such as a network card, or a wireless communication device.

[0075] The interruption detection unit 221, interrupted state recognition unit 222, resume operation determination unit 223, resume notification unit 224, setting unit 225, improvement proposal unit 226, calibration unit 227, excluded work setting unit 228, and evidence acquisition unit 229 of the work support device 200 described above are realized by a program that causes the arithmetic device 201 to perform processing. This program is stored in the main memory device 202, the auxiliary memory device 203, or a ROM device (not shown), and is loaded onto the main memory device 202 for execution and executed by the arithmetic device 201.

[0076] Moreover, the storage unit 210 of the work support apparatus 200 is realized by the main storage device 202 and the auxiliary storage device 203. Moreover, the communication unit 230 is realized by the communication device 204. An example of the hardware configuration of the work support apparatus 200 has been described above.

[0077] The configuration of the work support device 200 can be further divided into more components according to the processing content, or each component can be divided into more processes.

[0078] Furthermore, each processing unit (interruption detection unit 221, interruption state recognition unit 222, restart operation determination unit 223, restart notification unit 224, setting unit 225, improvement proposal unit 226, calibration unit 227, exception operation setting unit 228, and evidence acquisition unit 229) may be constructed with dedicated hardware (ASIC, GPU, etc.) that realizes each function. Furthermore, the processing of each processing unit may be executed by one piece of hardware or by multiple pieces of hardware.

[0079] Next, the operation of the work support system 1 in this embodiment will be described.

[0080] 6 is a diagram showing an example of a flow of the detection start process. The detection start process is started by starting setting input from the management device 300.

[0081] First, the management device 300 accepts a setting input (step S001). Specifically, the management device 300 requests the work support device 200 to input a setting, displays a screen for inputting a setting value, and upon receiving an input from an operator, passes the input setting value to the work support device 200.

[0082] The setting unit 225 of the work support device 200 updates the setting value based on the received setting value (step S002). Then, the calibration unit 227 performs a calibration process (step S003). For example, the calibration unit 227 prompts the worker to perform the gesture action multiple times (for example, 10 times at a fixed time, or multiple times until sufficient accuracy is obtained), and performs learning and calibration processes.

[0083] Then, the interruption detection unit 221 issues a control instruction to the sensor device 100 to start detection (step S004). After that, the sensor device 100 continuously performs detection at a predetermined sampling rate and reports the sensor information to the work support device 200 (step S005). Furthermore, the interruption detection unit 221 intermittently performs interruption detection processing using the reported sensor information (step S006).

[0084] The above is an example of the detection start process flow. According to the detection start process flow, it is possible to start detecting an interruption of work with high accuracy.

[0085] 7 is a diagram showing an example of the flow of the interruption / resume processing. The interruption / resume processing is started when the work support device 200 detects an interruption of work during the detection processing.

[0086] The interrupted state recognition unit 222 identifies the work at the time of interruption (step S101). Specifically, the interrupted state recognition unit 222 identifies the work being performed at the time of interruption according to the progress of a work instruction sheet (not shown). For example, when a worker performs an action of checking the work content by referring to a laptop, the interrupted time is determined to be the time when the laptop is captured by the camera.

[0087] Then, the interrupted state recognition unit 222 identifies the task to be resumed (step S102). Specifically, the interrupted state recognition unit 222 identifies the task next to the ongoing task identified in step S101 as the task to be resumed.

[0088] Then, the interrupted state recognition unit 222 notifies the worker that the interruption has been detected and the work to be resumed (step S103). Specifically, the interrupted state recognition unit 222 notifies the worker of the interruption through the sensor device 100 by a visual display such as a screen, AR, VR, or MR, an auditory stimulus such as a guidance voice, or a tactile stimulus such as vibration, or a combination of these.

[0089] Then, the restart operation determination unit 223 issues a control instruction to the sensor device 100 to start detection (step S104). After that, the sensor device 100 continuously performs detection at a predetermined sampling rate and reports the sensor information to the work support device 200 (step S105). Furthermore, the restart operation determination unit 223 uses the reported sensor information to intermittently perform restart detection processing (step S106).

[0090] Then, when the restart operation determination unit 223 detects the restart of the work, the restart notification unit 224 notifies the worker of the work to be performed after the restart (step S107). Specifically, the restart notification unit 224 creates any one or a combination of display, sound, and vibration information indicating the work that the worker was performing, the history of the work content, and the work to be performed after the restart, and displays it on the display unit 130 of the sensor device 100.

[0091] The above is an example of an interruption / resume processing flow. With this interruption / resume processing flow, it is possible to detect the resumption of work with high accuracy and at least indicate the next task to be performed when resuming. This enables the worker to specifically recall memories from before the interruption, and supports the resumption of work with reduced mistake potential.

[0092] 8 is a diagram showing an example of an analysis process flow. The analysis process is started in the work support apparatus 200 at a predetermined cycle (for example, once a day or once a week).

[0093] First, the improvement suggestion unit 226 identifies the frequency of interruptions for each worker from the total number of tasks performed and the number of interruptions (step S201).Then, the improvement suggestion unit 226 counts the number of interruptions for each task using the task content and the number of interruptions, and identifies the task with the most interruptions as the difficult task (step S202).

[0094] Then, the improvement proposing unit 226 estimates the relationship between the occurrence of interruptions and the occurrence time (step S203). Specifically, the improvement proposing unit 226 associates each interruption with a predetermined occurrence time period, and estimates the most frequent occurrence time period.

[0095] Then, the improvement proposing unit 226 estimates the correlation between the interruption frequency and the working situation (step S204). Specifically, the improvement proposing unit 226 counts the working hours for each worker for a predetermined period (for example, one month or one week) and estimates the degree of correlation with the number of interruptions during that period.

[0096] Then, the improvement proposing unit 226 identifies a time period during which interruptions are likely to occur (step S205). Specifically, the improvement proposing unit 226 divides time into predetermined time periods, counts the number of interruptions occurring in each time period, and identifies a time period during which interruptions occur more frequently than a predetermined frequency as a time period during which interruptions are likely to occur.

[0097] Then, the setting unit 225 changes the accuracy of interruption detection (step S206). Specifically, the setting unit 225 calculates the accuracy of interruption detection, i.e., the occurrence rate of false positives, and specifies the setting value that maximizes the accuracy of interruption detection by changing the detection conditions in various ways, and stores the specified setting value in the setting storage unit 211.

[0098] When a request for analysis results for each worker is made from the management device 300 (step S207), the improvement proposing unit 226 calculates a predetermined statistical value for each worker and compares the statistical values ​​with those of other workers (step S208).

[0099] Then, the improvement suggesting unit 226 identifies advice contents and presents them together with the analysis results (step S209). Specifically, the improvement suggesting unit 226 uses the information calculated in steps S203 to S205 to identify items that are significantly different from the average of other workers, creates predetermined advice contents for improving the items, creates a screen to be displayed together with the information of steps S202 to S205, and transmits the screen to the management device 300.

[0100] The above is an example of the analysis process flow. According to the analysis process flow, it is possible to detect the tendency of work interruptions with high accuracy and to identify the factors that increase the mis-potential based on the past performance, thereby considering measures to suppress the occurrence of interruptions.

[0101] 9 is a diagram showing an example of a setting screen. The setting screen 400 is a screen that the setting unit 225 transmits to the management device 300 to be output. The setting screen 400 includes, for example, a setting 401 related to interruption, a setting 402 related to a notification method when an interruption is detected, and a setting 403 related to what to do to resume.

[0102] The setting 401 regarding interruptions accepts an input to select one or more actions (first conditions) to be regarded as interruptions, such as "looking at a laptop," "looking at a manual," "talking to someone," "hands out of sight," etc.

[0103] The setting 402 for the notification method when an interruption is detected accepts an input for specifying the method for notifying the worker when an interruption is detected, such as an alert sound, voice, vibration, light (such as a patrol lamp), etc.

[0104] The setting 403 regarding what to do to resume accepts an input for selecting one or more conditions (second conditions) indicating the resumption of work. For example, "point and confirm," "press a button on a tablet," "press a safety confirmation button," "speak "confirm," etc.

[0105] 10 is a diagram showing an example of an evidence confirmation screen. An evidence confirmation screen 500 includes a date input area 501, a worker selection input area 502, a list display area 503, an evidence detail display area 504, and a seek bar display area 505.

[0106] The date input area 501 accepts the selection input of a specific date. The worker selection input area 502 accepts the selection input of the worker to be checked for evidence. The list display area 503 displays evidence, i.e., work records, in a list separated into items such as date and time, whether or not work is interrupted, and interruption time. The presence or absence of work interruption indicates whether or not the work includes an interruption, the interruption time indicates the interruption time if an interruption is included, and the evidence detail display area 504 displays a camera image of a predetermined length before and after the interruption corresponding to the evidence selected in the list display area 503 as video information. The images before and after the interruption or a link to play the video information are displayed. The seek bar display area 505 displays a seek bar, which is information specifying the playback time point of the video information. The seek bar includes a time range marked in a strip shape, and by displaying the marked time range, the time determined to be interrupted can be highlighted.

[0107] 11 is a diagram showing an example of an analysis result confirmation screen 600. The analysis result confirmation screen 600 includes a worker selection input area 601, a period input area 602, an analysis result display area 603, and advice items 604.

[0108] The worker selection input area 601 accepts the selection input of the worker for whom the analysis results are to be checked. The period input area 602 accepts the selection input of a specified period. The analysis result display area 603 displays the analysis results divided into categories such as interruption frequency, difficult tasks, most frequent interruption times, and interruption ratio to workload. Each analysis result item is an item that displays the results of analysis using a specified analysis algorithm in the analysis processing flow. The advice item 604 is an item that displays advice contents created by identifying items that deviate greatly from the average of other workers.

[0109] The above is an example of the work support system according to the embodiment. According to the example of the work support system according to the embodiment, the work support can be performed according to the implementation status of the worker, so that the worker can receive appropriate guidance when resuming the interrupted work and can reliably resume it.

[0110] Furthermore, while the above embodiment describes general tasks, more specifically, the steps of a task can be replaced with a recipe and applied to cooking, or the steps can be replaced with a daily timetable and applied to housekeeping.

[0111] Furthermore, the technical elements of the above-described embodiments may be applied independently, or may be divided into a plurality of parts, such as program parts and hardware parts, and then applied.

[0112] The present invention has been described above mainly with reference to the embodiment. [Explanation of symbols]

[0113] 1...work support system, 50...wireless network, 100...sensor device, 110...detection processing unit, 120...communication unit, 130...display unit, 200...work support device, 210...storage unit, 211...setting storage unit, 212...evidence storage unit, 213...advice storage unit, 220...processing unit, 221...interruption detection unit, 222...interrupted state recognition unit, 223...resume operation determination unit, 224...resume notification unit, 225...setting unit, 226...improvement proposal unit, 227...calibration unit, 228...exclusion work setting unit, 229...evidence acquisition unit, 230...communication unit, 300...management device.

Claims

1. an interruption detection unit that detects an interruption of work by determining whether or not sensor information acquired by a sensor device attached to a worker satisfies a predetermined first condition; an interruption state recognition unit that notifies the worker of the interruption by light, sound, or vibration when the interruption of the work is detected; Equipped with The interrupted state recognition unit identifies an interrupted task according to the state of the worker identified by the sensor information and the progress of the work instruction, and generates display information for identifying the next task to be performed after resuming the task according to the work instruction for the task where the interruption was detected and for instructing the task. A work support device characterized by:

2. an interruption detection unit that detects an interruption of work by determining whether or not sensor information acquired by a sensor device attached to a worker satisfies a predetermined first condition; an interruption state recognition unit that notifies the worker of the interruption by light, sound, or vibration when the interruption of the work is detected; Equipped with the interrupted state recognition unit identifies an interrupted task according to the state of the worker identified by the sensor information and the progress of the work instruction, and generates display information for identifying the next task to be performed after resuming the task according to the work instruction for which the interruption was detected, and for instructing the task content; a restart operation determination unit that determines whether the sensor information satisfies a predetermined second condition and detects restart of the work whose interruption was detected; a restart notification unit that notifies the user of the display information regarding the work whose restart has been detected; A work support device comprising:

3. The work support device according to claim 1 or 2, The sensor device acquires at least a voice uttered by the worker as the sensor information, The interruption detection unit determines that the predetermined first condition is satisfied when the voice includes a conversation with another person for a predetermined period of time or longer. A work support device characterized by:

4. The work support device according to claim 2, The sensor device acquires, as the sensor information, an image including at least a part or all of the field of vision of the worker or a voice uttered by the worker; the restart operation determination unit determines that the predetermined second condition is satisfied when the video includes at least a predetermined gesture of the worker or the audio includes a predetermined utterance of the worker. A work support device characterized by:

5. The work support device according to claim 2, The sensor device acquires at least biological information of the worker as the sensor information, The restart operation determination unit determines that the predetermined second condition is satisfied when the biological information is in a predetermined normal range. A work support device characterized by:

6. The work support device according to any one of claims 1 to 5, an evidence acquisition unit that stores the sensor information relating to the work before and after the interruption in a predetermined storage unit and reproduces the sensor information in response to a request from another device; A work support device comprising:

7. The work support device according to any one of claims 1 to 6, an improvement suggestion unit that calculates statistical information related to the interruption for each of the workers and indicates an operation that is significantly different from that of other workers; A work support device comprising:

8. A work assistance method using a work assistance device, comprising: The work support apparatus includes a processing unit, The processing unit includes: an interruption detection step of detecting an interruption of work by determining whether or not sensor information acquired by a sensor device attached to the worker satisfies a predetermined first condition; an interruption state recognition step of notifying the worker of the interruption by light, sound or vibration when the interruption of the work is detected; and in the interrupted state recognition step, the interrupted work is identified according to the state of the worker identified by the sensor information and the progress of the work instruction, and for the work in which the interruption was detected, the next work is identified as the work content to be performed after resuming according to the work instruction, and display information is generated to instruct the work content. A work support method comprising:

Images