Work assistance device, work assistance method, and work assistance system

Abstract

A work assistance device (2) is configured to be provided with: a sensing data acquisition unit (11) that acquires sensing data indicating a work implementation status from a sensor (1) that monitors the work implementation status of a worker; an AR content generation unit (12) that generates AR content corresponding to the job implementation status on the basis of the sensing data acquired by the sensing data acquisition unit (11); and a display data output unit (13) that outputs display data indicating the AR content generated by the AR content generation unit (12).

Description

Technical Field

[0001] This disclosure relates to work assistance devices, work assistance methods, and work assistance systems. Background Technology

[0002] There are work assistance devices that assist workers in their work.

[0003] As such work assistance devices, for example, Patent Document 1 discloses a fork positioning assistance device equipped with a camera and an image display unit.

[0004] The camera captures an image of the forklift's front and outputs image data representing that area to an image display unit. The area captured by the camera includes the pallet being transported by the forklift and the forklift's forks. The image display unit displays the image represented by the image data output from the camera on a monitor.

[0005] Existing technical documents

[0006] Patent documents

[0007] Patent Document 1: Japanese Patent Application Publication No. 2013-86959 Summary of the Invention

[0008] The problem that the invention aims to solve

[0009] In the fork positioning aid device disclosed in Patent Document 1, although the operator of the forklift can confirm the relative position of the pallet and the fork simply by observing the display, there is a problem that it is impossible to confirm the progress of the pallet conveying operation.

[0010] This disclosure was made to solve the aforementioned problems, and its purpose is to provide an operation assistance device that allows the operator to confirm the operation status.

[0011] Methods for solving problems

[0012] The work assistance device disclosed herein includes: a sensing data acquisition unit that acquires sensing data representing the work performance status from a sensor that monitors the work performance status of the operator; an AR content generation unit that generates AR (Augmented Reality) content corresponding to the work performance status based on the sensing data acquired by the sensing data acquisition unit; and a display data output unit that outputs display data representing the AR content generated by the AR content generation unit.

[0013] Invention Effects

[0014] According to this disclosure, the operator is able to confirm the status of the operation. Attached Figure Description

[0015] Figure 1 This is a structural diagram showing a work assistance system that includes the work assistance device 2 of embodiment 1.

[0016] Figure 2 This is a hardware structure diagram showing the hardware of the work assistance device 2 in Embodiment 1.

[0017] Figure 3 This is a hardware structure diagram of the computer when the work assistance device 2 is implemented through software or firmware.

[0018] Figure 4 This is a flowchart illustrating the processing steps, or work assistance methods, of the work assistance device 2.

[0019] Figure 5 This is an explanatory diagram showing products transported by a belt conveyor.

[0020] Figure 6 This is an explanatory diagram showing an example of AR content corresponding to the task completion rate (Acr).

[0021] Figure 7 This is an explanatory diagram showing an example of AR content corresponding to the task completion rate (Acr).

[0022] Figure 8 This is an explanatory diagram showing an example of AR content corresponding to the task completion rate (Acr).

[0023] Figure 9 This is an explanatory diagram showing an example of AR content corresponding to the task completion rate (Acr).

[0024] Figure 10 This is an explanatory diagram showing an example of AR content at the current moment within the operation time.

[0025] Figure 11 This is an illustration showing an example of AR content during a rest period at the current moment.

[0026] Figure 12 This is an illustration showing an example of AR content associated with summer, representing an example of AR content corresponding to the current season.

[0027] Figure 13 This is an explanatory diagram showing an example of AR content corresponding to the time of the operation.

[0028] Figure 14 This is an illustration showing an example of AR content corresponding to the current weather.

[0029] Figure 15 This is a structural diagram showing a work assistance system including the work assistance device 2 of embodiment 6.

[0030] Figure 16 This is a hardware structure diagram showing the hardware of the work assistance device 2 in embodiment 6.

[0031] Figure 17 This is an explanatory diagram showing an example of AR content containing accumulated garbage.

[0032] Figure 18 This is a structural diagram showing a work assistance system including the work assistance device 2 of embodiment 7.

[0033] Figure 19 This is a hardware structure diagram showing the hardware of the work assistance device 2 in embodiment 7.

[0034] Figure 20 This is an explanatory diagram showing an example of AR content representing a role that guides the implementation of a task.

[0035] Figure 21 This is a structural diagram showing a work assistance system including the work assistance device 2 of embodiment 8.

[0036] Figure 22 This is a hardware structure diagram showing the hardware of the work assistance device 2 in embodiment 8.

[0037] Figure 23 This is an explanatory diagram showing an example of AR content representing the actions of a skilled worker. Detailed Implementation

[0038] Hereinafter, in order to illustrate this disclosure in more detail, the manner in which this disclosure is carried out will be described with reference to the accompanying drawings.

[0039] Implementation method 1.

[0040] Figure 1 This is a structural diagram showing a work assistance system that includes the work assistance device 2 of embodiment 1.

[0041] Figure 2 This is a hardware structure diagram showing the hardware of the work assistance device 2 in Embodiment 1.

[0042] Figure 1 The work assistance system shown includes a sensor 1, a work assistance device 2, and a display device 3.

[0043] Sensor 1 is implemented, for example, by a camera or a lidar device.

[0044] Sensor 1 monitors the operator's work performance and outputs the sensing data indicating the work performance to work assistance device 2.

[0045] The camera and the lidar device are the imaging sensors used to capture the status of the shooting operation. In particular, the lidar device is a device that can shine a laser beam towards an object, receive the reflected light from the object, and detect the shape of the object based on the reflected light.

[0046] As an operator's job, there are jobs such as receiving products from a belt conveyor, sorting products from a belt conveyor, assembling products, assembling products by operating a robot, judging the quality of products, judging the quality of products by operating a robot, or transporting pallets by operating a forklift.

[0047] As a measure of task implementation status, there are metrics such as the task completion rate of the task, the number of times the task was completed by the task, the number of days the task was completed by the task, the progress of the task, or the accuracy of the task.

[0048] If the operator's task is, for example, receiving products, then the task completion rate can be expressed as, for example, the ratio of the number of products received up to the current time to the target number of products received. Alternatively, the task completion count can be expressed as, for example, the number of products received up to the current time.

[0049] If the operator's task is, for example, pallet delivery, then the task completion rate can be expressed as the ratio of the number of pallets delivered up to the current time to the target number of pallets delivered. Additionally, the task completion count can be expressed as the number of pallets delivered up to the current time.

[0050] If the operator's task is, for example, the operator assembling a product, then as a task progress status, there is a status indicating the status of the implemented task elements among the multiple task elements required from the start of product assembly to the completion of the product.

[0051] The work assistance device 2 includes a sensing data acquisition unit 11, an AR content generation unit 12, and a display data output unit 13.

[0052] The operation assistance device 2 generates AR (Augmented Reality) content corresponding to the operation implementation status and outputs the display data representing the AR content to the display device 3.

[0053] Display devices 3 can be implemented, for example, through AR glasses, tablets, or smartphones.

[0054] Display device 3 displays AR content according to the display data output from work assistance device 2.

[0055] The sensing data acquisition unit 11, for example, is composed of Figure 2The sensing data acquisition circuit 21 shown is implemented.

[0056] The sensing data acquisition unit 11 acquires sensing data representing the operation status from the sensor 1. If the sensor 1 is a camera sensor that captures the operation status, the sensing data acquisition unit 11 acquires camera data representing the capture results of the camera sensor as sensing data representing the operation status.

[0057] The sensing data acquisition unit 11 outputs the sensing data to the AR content generation unit 12 and the display data output unit 13 respectively.

[0058] AR content generation unit 12, for example, is composed of... Figure 2 The AR content generation circuit 22 shown is implemented.

[0059] AR content generation unit 12 acquires sensing data from sensing data acquisition unit 11.

[0060] The AR content generation unit 12 generates AR content corresponding to the operation status based on the sensing data.

[0061] The AR content generation unit 12 outputs display data representing AR content to the display data output unit 13.

[0062] The display data output unit 13 is, for example, composed of... Figure 2 The data output circuit 23 shown is implemented.

[0063] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11 and acquires display data representing AR content from the AR content generation unit 12.

[0064] If the display device 3 is, for example, AR glasses, and the operator wearing the AR glasses can observe the operation status with the naked eye through the AR glasses, then the display data output unit 13 only acquires the display data representing the AR content and outputs the display data to the display device 3.

[0065] If the operator wearing AR glasses cannot observe the operation status with the naked eye through the AR glasses, the display data output unit 13 acquires both display data and sensing data representing AR content.

[0066] In the case of a display device 3, such as a tablet or smartphone, the display data output unit 13 also acquires both display data and sensing data representing AR content.

[0067] The display data output unit 13 overlays the display data representing AR content with the shooting data, which is sensing data, and outputs the shooting data after overlay with the display data to the display device 3.

[0068] exist Figure 1In this context, it is envisioned that the sensing data acquisition unit 11, the AR content generation unit 12, and the display data output unit 13, which are components of the work assistance device 2, respectively transmit data via... Figure 2 This is implemented using dedicated hardware as shown. That is, the work assistance device 2 is envisioned to be implemented by a sensing data acquisition circuit 21, an AR content generation circuit 22, and a display data output circuit 23.

[0069] The sensing data acquisition circuit 21, the AR content generation circuit 22, and the display data output circuit 23 are, for example, single circuits, composite circuits, programmable processors, parallel programmable processors, ASICs (Application Specific Integrated Circuits), FPGAs (Field-Programmable Gate Arrays), or circuits combining them.

[0070] The components of the work assistance device 2 are not limited to being implemented through dedicated hardware; the work assistance device 2 can also be implemented through software, firmware, or a combination of software and firmware.

[0071] Software or firmware is stored as a program in a computer's memory. A computer refers to the hardware that executes programs, such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, processor, or DSP (Digital Signal Processor).

[0072] Figure 3 This is a hardware structure diagram of the computer when the work assistance device 2 is implemented through software or firmware.

[0073] When the work assistance device 2 is implemented via software or firmware, a program for causing the computer to perform each processing step in the sensing data acquisition unit 11, the AR content generation unit 12, and the display data output unit 13 is stored in the memory 31. Then, the computer's processor 32 executes the program stored in the memory 31.

[0074] In addition, Figure 2 The diagram shows an example where the components of the work assistance device 2 are implemented using dedicated hardware. Figure 3 The example shown is an example of a work assistance device 2 implemented by software or firmware. However, this is just one example; it is also possible that some components of the work assistance device 2 are implemented by dedicated hardware, while the remaining components are implemented by software or firmware.

[0075] Next, for Figure 1 The operation of the work assistance system shown is explained.

[0076] Figure 4 This is a flowchart illustrating the processing steps, or work assistance methods, of the work assistance device 2.

[0077] Sensor 1 may be installed, for example, on the helmet worn by the worker, the AR glasses worn by the worker, or on the walls or ceiling of the factory where the work is carried out.

[0078] Sensor 1 monitors the operator's work performance and outputs the sensing data indicating the work performance to work assistance device 2.

[0079] Figure 5 This is an explanatory diagram showing products transported by a belt conveyor.

[0080] The following example illustrates an operator's task of receiving products transported by a belt conveyor.

[0081] exist Figure 5 The operator is not shown, but the operator may be standing, for example, on the side of the belt conveyor or near the front of the belt conveyor.

[0082] The sensing data acquisition unit 11 acquires sensing data representing the operation status from the sensor 1. Figure 4 Step ST1).

[0083] For ease of explanation, it is assumed that sensor 1 is a shooting sensor for shooting operation status, and the sensing data acquisition unit 11 acquires shooting data representing the shooting results of the shooting sensor as sensing data representing the operation status.

[0084] The sensing data acquisition unit 11 outputs the sensing data to the AR content generation unit 12 and the display data output unit 13 respectively.

[0085] AR content generation unit 12 acquires sensing data from sensing data acquisition unit 11.

[0086] The AR content generation unit 12 generates AR content corresponding to the operation status based on the sensing data. Figure 4 Step ST2).

[0087] The AR content generation unit 12 outputs display data representing AR content to the display data output unit 13.

[0088] The following describes in detail the AR content generation process based on the AR content generation unit 12.

[0089] The AR content generation unit 12 counts the number of products received by the operator from the belt conveyor based on sensing data. The process of counting the number of products received by the operator based on the captured data used as sensing data is a known technique, therefore a detailed explanation is omitted.

[0090] If the target number of products to be received is Enum, and the number of products received by the operator is Tnum, then the AR content generation unit 12 calculates the job completion rate Acr as shown in the following formula (1).

[0091] Acr = (Tnum / Enum) × 100%

[0092] The AR content generation unit 12 generates AR content corresponding to the job completion rate (Acr) as AR content corresponding to the job implementation status. The AR content generation process itself is a well-known technology, so detailed explanation is omitted.

[0093] Figure 6 , Figure 7 as well as Figure 8 These are explanatory diagrams showing an example of AR content corresponding to the task completion rate (Acr).

[0094] Figure 6 , Figure 7 as well as Figure 8 Examples of tulips are shown, each corresponding to an AR (Action Reality) value (Acr). Here, the higher the Acr, the more tulips bloom.

[0095] Figure 6 This example illustrates how tulips failed to bloom at all due to a low achievement rate (Acr).

[0096] Figure 7 This example illustrates how a small number of tulips bloomed due to a slight increase in the job completion rate (Acr).

[0097] Figure 8 The example shown is that almost all the tulips bloomed because the completion rate (Acr) was close to 100%.

[0098] Here, the AR content corresponding to the operation implementation status shows tulips whose flowering rate changes according to the achievement rate (Acr). However, this is just one example; the AR content generation unit 12 can also, for example, [show other examples]. Figure 9 As shown, generate AR content representing the task completion rate (Acr) as AR content corresponding to the task implementation status.

[0099] Figure 9 This is an explanatory diagram showing an example of AR content corresponding to the task completion rate (Acr).

[0100] exist Figure 9In the image, AR content corresponding to the achievement rate Acr is shown, with the number representing the achievement rate Acr surrounded by flowers.

[0101] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11 and acquires display data representing AR content from the AR content generation unit 12.

[0102] The display data output unit 13 overlaps the display data representing AR content with the captured data, which is sensing data.

[0103] When displaying data and shooting data are overlapped, the display data output unit 13 overlaps the display data and shooting data in a way that the operator's work performance status will not be invisible due to the AR content.

[0104] That is, such as Figures 6-9 As shown, the display data output unit 13 overlaps the display data with the captured data in a way that the product being transported by the belt conveyor will not be visible due to the AR content.

[0105] The display data output unit 13 outputs the captured data, which is superimposed on the display data, to the display device 3. Figure 4 Step ST3).

[0106] The display device 3 obtains the captured data that overlaps with the displayed data from the display data output unit 13 of the work assistance device 2.

[0107] Display device 3 displays AR content based on the captured data superimposed on the display data.

[0108] Therefore, in display device 3, for example, displaying such as Figures 6-9 AR content shown in any of the directions.

[0109] In the above-described embodiment 1, the work assistance device 2 is configured to include: a sensing data acquisition unit 11, which acquires sensing data representing the work implementation status from a sensor 1 that monitors the work implementation status of the operator; an AR content generation unit 12, which generates AR content corresponding to the work implementation status based on the sensing data acquired by the sensing data acquisition unit 11; and a display data output unit 13, which outputs display data representing the AR content generated by the AR content generation unit 12. Therefore, in the work assistance device 2, the operator can confirm the work implementation status.

[0110] In addition, by displaying AR content corresponding to the work implementation status, it is possible to maintain the worker's concentration, improve the worker's enthusiasm, or prompt the worker to change their mood.

[0111] Furthermore, in Embodiment 1, the work assistance device 2 is configured such that the AR content generation unit 12 calculates the worker's work completion rate as the work implementation status based on the sensing data acquired by the sensing data acquisition unit 11, and generates AR content corresponding to the work completion rate. Therefore, in the work assistance device 2, the worker can confirm the work completion rate.

[0112] exist Figure 1 In the work assistance device 2 shown, the AR content generation unit 12 generates tulips whose flowering rate varies according to the work completion rate Acr as AR content corresponding to the work implementation status. However, this is just one example; the AR content generation unit 12 may also accept the selection of AR content for the object to be generated before generating AR content corresponding to the work implementation status.

[0113] Specifically, the AR content generation unit 12, for example, has a user interface, and if the user selects, for example, by operating the user interface... Figures 6-8 If the tulips whose flowering rate varies according to the task completion rate Acr are used as the AR content of the generated object, then tulips whose flowering rate varies according to the task completion rate Acr will be generated.

[0114] If the user selects, for example, by operating the user interface... Figure 9 If the AR content surrounding the number representing the achievement rate Acr is used as the AR content to be generated, then the AR content generation unit 12 generates AR content surrounding the number representing the achievement rate Acr.

[0115] In addition, the AR content generation unit 12 can also obtain the current season from either the built-in calendar or an external calendar, and switch the AR content corresponding to the work implementation status according to the current season.

[0116] If the current season is spring, then AR content generation department 12, as shown... Figures 6-8 As shown, for example, tulips with flowering rates varying according to the task completion rate (Acr) are generated as AR content corresponding to the task implementation status.

[0117] If the current season is summer, the AR content generation unit 12 generates, for example, cherry blossoms whose flowering rate varies according to the task completion rate Acr as AR content corresponding to the task implementation status.

[0118] If the current season is autumn, the AR content generation unit 12 generates, for example, red leaves whose coloring changes according to the job completion rate (Acr) as AR content corresponding to the job implementation status.

[0119] If the current season is winter, the AR content generation unit 12 generates, for example, snow accumulation that varies according to the work completion rate Acr as AR content corresponding to the work implementation status.

[0120] exist Figure 1 In the work assistance device 2 shown, the AR content generation unit 12 generates AR content corresponding to the work completion rate Acr as AR content corresponding to the work implementation status. However, this is just one example. As AR content corresponding to the work implementation status, the AR content generation unit 12 may also generate AR content corresponding to any one of the following: the number of times the worker completes the work, the number of days the worker has implemented the work, the worker's work progress status, and the worker's work accuracy.

[0121] When generating AR content that corresponds to the progress of the work, the AR content generation unit 12 can identify the progress of the work by simply counting the number of work elements that have been implemented from the start of product assembly to the completion of the product.

[0122] exist Figure 1 In the work assistance device 2 shown, the AR content generation unit 12 generates AR content corresponding to the work implementation status. In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 12 can also generate AR content representing the ideal standing position of the worker. Information representing the ideal standing position of the worker is stored, for example, in the internal memory of the AR content generation unit 12. As AR content representing the ideal standing position of the worker, for example, there is a footprint illustration representing the ideal standing position of the worker.

[0123] Implementation method 2.

[0124] In Embodiment 2, the following work assistance device 2 will be described. In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 12 of the work assistance device 2 also generates AR content corresponding to the current time.

[0125] The structure of the work assistance device 2 in Embodiment 2 is the same as that in Embodiment 1. The structural diagram showing the work assistance system including the work assistance device 2 of Embodiment 2 is as follows: Figure 1 .

[0126] In addition to generating AR content corresponding to the operation status, the AR content generation unit 12 also generates AR content corresponding to the current moment.

[0127] The AR content generation unit 12 outputs display data representing AR content corresponding to the operation status and display data representing AR content corresponding to the current time to the display data output unit 13.

[0128] Next, the operation of the work assistance system in Embodiment 2 will be described. However, apart from the AR content generation unit 12, and... Figure 1The operation assistance system shown is the same. Therefore, the operation of the AR content generation unit 12 will be mainly explained here.

[0129] AR content generation unit 12 acquires sensing data from sensing data acquisition unit 11.

[0130] Similar to Embodiment 1, the AR content generation unit 12 generates AR content corresponding to the operation status based on sensing data.

[0131] The AR content generation unit 12 obtains the current time from either the built-in clock or an external clock.

[0132] AR content generation unit 12 generates AR content corresponding to the current moment.

[0133] The following describes in detail the AR content generation process performed by the AR content generation unit 12, which corresponds to the current moment.

[0134] If the current time is, for example, a time within the operation period, then the AR content generation unit 12, for example, Figure 10 As shown, AR content representing the time of the operation is generated.

[0135] Figure 10 This is an explanatory diagram showing an example of AR content at the current moment within the operation time.

[0136] If the current time is, for example, a time during a rest period, then the AR content generation unit 12, for example, Figure 11 As shown, AR content representing a break time is generated.

[0137] Figure 11 This is an illustration showing an example of AR content during a rest period at the current moment.

[0138] exist Figure 11 In the image, the coffee cup and teacup represent AR content indicating a break.

[0139] Here, the AR content generation unit 12 generates either AR content representing working hours or AR content representing rest hours as the AR content corresponding to the current time. However, this is just one example; as the AR content corresponding to the current time, the AR content generation unit 12 may also generate either AR content representing morning, AR content representing daytime, or AR content representing nighttime.

[0140] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11.

[0141] In addition, the display data output unit 13 obtains AR content corresponding to the operation implementation status and AR content corresponding to the current time from the AR content generation unit 12.

[0142] The display data output unit 13 overlaps the display data representing each AR content with the captured data, which is the sensing data.

[0143] When displaying data and shooting data are overlapped, the display data output unit 13 overlaps the display data and shooting data in a way that the operator's work performance is not obscured by the various AR contents.

[0144] That is, such as Figures 10-11 As shown, the display data output unit 13 overlaps the display data with the captured data in a way that the product being transported by the belt conveyor will not be visible due to the AR content.

[0145] The display data output unit 13 outputs the captured data, which is superimposed on the display data, to the display device 3.

[0146] The display device 3 obtains the captured data that overlaps with the displayed data from the display data output unit 13 of the work assistance device 2.

[0147] Display device 3 displays AR content based on the captured data superimposed on the display data.

[0148] Therefore, in display device 3, for example, displaying such as Figures 10-11 AR content shown in any of the directions.

[0149] In the above-described embodiment 2, the work assistance device 2 is configured such that the AR content generation unit 12 generates AR content corresponding to the work implementation status, as well as AR content corresponding to the current time. Therefore, in the work assistance device 2, in addition to the operator being able to confirm the work implementation status, the operator can also confirm the time period to which the current time belongs.

[0150] Implementation method 3.

[0151] In Embodiment 3, the following work assistance device 2 will be described. In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 12 of the work assistance device 2 also generates AR content corresponding to the current season.

[0152] The structure of the work assistance device 2 in Embodiment 3 is the same as that in Embodiment 1. The structural diagram showing the work assistance system including the work assistance device 2 of Embodiment 3 is as follows: Figure 1 .

[0153] In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 12 also generates AR content corresponding to the current season.

[0154] The AR content generation unit 12 outputs display data of AR content corresponding to the operation status and display data of AR content corresponding to the current season to the display data output unit 13.

[0155] Next, the operation of the work assistance system in Embodiment 3 will be described. However, apart from the AR content generation unit 12, and... Figure 1 The operation assistance system shown is the same. Therefore, the operation of the AR content generation unit 12 will be mainly explained here.

[0156] AR content generation unit 12 acquires sensing data from sensing data acquisition unit 11.

[0157] Similar to Embodiment 1, the AR content generation unit 12 generates AR content corresponding to the operation status based on sensing data.

[0158] The AR content generation unit 12 retrieves the current season from either the built-in calendar or an external calendar.

[0159] AR content generation unit 12 generates AR content corresponding to the current season.

[0160] The following is a detailed explanation of the AR content generation process performed by the AR content generation unit 12, which generates AR content corresponding to the current season.

[0161] If the current season is spring, the AR content generation unit 12 generates AR content associated with spring. Examples of AR content associated with spring include AR content representing cherry blossoms, AR content representing plum blossoms, or AR content representing bamboo shoots.

[0162] If the current season is summer, the AR content generation unit 12 generates AR content associated with summer. Examples of summer-related AR content include AR content representing watermelons, AR content representing fireworks, or AR content representing a beach.

[0163] If the current season is autumn, the AR content generation unit 12 generates AR content associated with autumn. Examples of AR content associated with autumn include AR content representing autumn leaves, AR content representing chestnuts, or AR content representing saury.

[0164] If the current season is winter, the AR content generation unit 12 generates AR content associated with winter. Examples of winter-related AR content include AR content representing a snowman, AR content representing skiing, or AR content representing a scarf.

[0165] Figure 12 This is an illustration showing an example of AR content associated with summer, representing an example of AR content corresponding to the current season.

[0166] Here, the AR content generation unit 12 generates any one of the following: AR content associated with spring, AR content associated with summer, AR content associated with autumn, and AR content associated with winter, as AR content corresponding to the current season. However, this is just one example; the AR content generation unit 12 could also generate AR content associated with each month from January to December as AR content corresponding to the current season.

[0167] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11.

[0168] In addition, the display data output unit 13 obtains AR content corresponding to the operation implementation status and AR content corresponding to the current season from the AR content generation unit 12.

[0169] The display data output unit 13 overlaps the display data representing each AR content with the captured data, which is the sensing data.

[0170] When displaying data and shooting data are overlapped, the display data output unit 13 overlaps the display data and shooting data in a way that the operator's work performance is not obscured by the various AR contents.

[0171] That is, such as Figure 12 As shown, the display data output unit 13 overlaps the display data with the captured data in a way that the product being transported by the belt conveyor will not be visible due to the AR content.

[0172] The display data output unit 13 outputs the captured data, which is superimposed on the display data, to the display device 3.

[0173] The display device 3 obtains the captured data that overlaps with the displayed data from the display data output unit 13 of the work assistance device 2.

[0174] Display device 3 displays AR content based on the captured data superimposed on the display data.

[0175] Therefore, in display device 3, for example, displaying such as Figure 12 The AR content shown.

[0176] In the above-described embodiment 3, the work assistance device 2 is configured such that the AR content generation unit 12 generates AR content corresponding to the work implementation status, as well as AR content corresponding to the current season. Therefore, in the work assistance device 2, in addition to the worker being able to confirm the work implementation status, the worker can also confirm the current season.

[0177] Implementation method 4.

[0178] In Embodiment 4, the following work assistance device 2 will be described. In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 12 of the work assistance device 2 also generates AR content corresponding to the work implementation time.

[0179] The structure of the work assistance device 2 in Embodiment 4 is the same as that in Embodiment 1. The structural diagram showing the work assistance system including the work assistance device 2 of Embodiment 4 is as follows: Figure 1 .

[0180] In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 12 also generates AR content corresponding to the work implementation time.

[0181] The AR content generation unit 12 outputs display data representing AR content corresponding to the work implementation status and display data representing AR content corresponding to the work implementation time to the display data output unit 13.

[0182] Next, the operation of the work assistance system in Embodiment 4 will be described. However, apart from the AR content generation unit 12, and... Figure 1 The operation assistance system shown is the same. Therefore, the operation of the AR content generation unit 12 will be mainly explained here.

[0183] AR content generation unit 12 acquires sensing data from sensing data acquisition unit 11.

[0184] Similar to Embodiment 1, the AR content generation unit 12 generates AR content corresponding to the operation status based on sensing data.

[0185] The AR content generation unit 12 obtains the current time from either the built-in clock or an external clock.

[0186] The AR content generation unit 12 stores the time when the operator starts the work.

[0187] The AR content generation unit 12 calculates the time from the moment the operator begins the work to the current moment as the work implementation time.

[0188] AR content generation unit 12, for example, Figure 13 As shown, AR content corresponding to the operation execution time is generated.

[0189] Figure 13 This is an explanatory diagram showing an example of AR content corresponding to the time of the operation.

[0190] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11.

[0191] In addition, the display data output unit 13 obtains AR content corresponding to the work implementation status and AR content corresponding to the work implementation time from the AR content generation unit 12.

[0192] The display data output unit 13 overlaps the display data representing each AR content with the captured data, which is the sensing data.

[0193] When displaying data and shooting data are overlapped, the display data output unit 13 overlaps the display data and shooting data in a way that the operator's work performance is not obscured by the various AR contents.

[0194] That is, such as Figure 13 As shown, the display data output unit 13 overlaps the display data with the captured data in a way that the product being transported by the belt conveyor will not be visible due to the AR content.

[0195] The display data output unit 13 outputs the captured data, which is superimposed on the display data, to the display device 3.

[0196] The display device 3 obtains the captured data that overlaps with the displayed data from the display data output unit 13 of the work assistance device 2.

[0197] Display device 3 displays AR content based on the captured data superimposed on the display data.

[0198] Therefore, in display device 3, for example, displaying such as Figure 13 The AR content shown.

[0199] In the above-described embodiment 4, the work assistance device 2 is configured such that the AR content generation unit 12 generates AR content corresponding to the work implementation status as well as AR content corresponding to the work implementation time. Therefore, in the work assistance device 2, in addition to the operator being able to confirm the work implementation status, the operator can also confirm the work implementation time.

[0200] Implementation method 5.

[0201] In embodiment 5, the following work assistance device 2 will be described. In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 12 of the work assistance device 2 also generates AR content corresponding to the current weather.

[0202] The structure of the work assistance device 2 in Embodiment 5 is the same as that in Embodiment 1. The structural diagram showing the work assistance system including the work assistance device 2 of Embodiment 5 is as follows: Figure 1 .

[0203] In addition to generating AR content corresponding to the operational status, the AR content generation unit 12 also generates AR content corresponding to the current weather.

[0204] The AR content generation unit 12 outputs display data of AR content corresponding to the operation status and display data of AR content corresponding to the current weather to the display data output unit 13.

[0205] Next, the operation of the work assistance system in Embodiment 5 will be described. However, apart from the AR content generation unit 12, and... Figure 1 The operation assistance system shown is the same. Therefore, the operation of the AR content generation unit 12 will be mainly explained here.

[0206] AR content generation unit 12 acquires sensing data from sensing data acquisition unit 11.

[0207] Similar to Embodiment 1, the AR content generation unit 12 generates AR content corresponding to the operation status based on sensing data.

[0208] AR content generation unit 12, for example, obtains weather information indicating the current weather from a weather website that has not been shown.

[0209] AR content generation unit 12, for example, Figure 14 As shown, AR content corresponding to the weather information is generated.

[0210] Figure 14 This is an illustration showing an example of AR content corresponding to the current weather.

[0211] exist Figure 14 In one example, AR content corresponding to the current weather is displayed as a background for a conveyor belt, etc. Figure 14 The example shows that the current weather is part of a blue sky with clouds present.

[0212] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11.

[0213] In addition, the display data output unit 13 obtains AR content corresponding to the operation implementation status and AR content corresponding to the current weather from the AR content generation unit 12.

[0214] The display data output unit 13 overlaps the display data representing each AR content with the captured data, which is the sensing data.

[0215] When displaying data and shooting data are overlapped, the display data output unit 13 overlaps the display data and shooting data in a way that the operator's work performance is not obscured by the various AR contents.

[0216] That is, such as Figure 14 As shown, the display data output unit 13 overlaps the display data with the captured data in a way that the product being transported by the belt conveyor will not be visible due to the AR content.

[0217] The display data output unit 13 outputs the captured data, which is superimposed on the display data, to the display device 3.

[0218] The display device 3 obtains the captured data that overlaps with the displayed data from the display data output unit 13 of the work assistance device 2.

[0219] Display device 3 displays AR content based on the captured data superimposed on the display data.

[0220] Therefore, in display device 3, for example, displaying such as Figure 14 The AR content shown.

[0221] In the above-described embodiment 5, the work assistance device 2 is configured such that the AR content generation unit 12 generates AR content corresponding to the work implementation status, as well as AR content corresponding to the current weather. Therefore, in the work assistance device 2, in addition to the operator being able to confirm the work implementation status, the operator can also confirm the current weather.

[0222] Implementation method 6.

[0223] In embodiment 6, the following work assistance device 2 will be described. In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 12 of the work assistance device 2 also generates AR content corresponding to the cleaning status of the facility where the work is being carried out.

[0224] Figure 15 This is a structural diagram showing a work assistance system including the work assistance device 2 of embodiment 6. Figure 15 In, with Figure 1 The same labels indicate the same or equivalent parts, so detailed descriptions are omitted.

[0225] Figure 16 This is a hardware structure diagram showing the hardware of the work assistance device 2 in embodiment 6. Figure 16 In, with Figure 2 The same labels indicate the same or equivalent parts, so detailed descriptions are omitted.

[0226] Figure 15 The work assistance system shown includes sensor 1, camera 4, work assistance device 2, and display device 3.

[0227] Camera 4 captures images of the facility where the work is being carried out and outputs the captured data to the work assistance device 2. Examples of locations within the facility that can be captured include the area around a conveyor belt or the facility's entrances and exits.

[0228] AR content generation unit 14, for example, is composed of... Figure 16 The AR content generation circuit 24 shown is implemented.

[0229] The AR content generation unit 14 acquires sensing data from the sensing data acquisition unit 11 and acquires imaging data from the camera 4.

[0230] AR Content Generation Department 14 and Figure 1 Similarly, the AR content generation unit 12 shown generates AR content corresponding to the operation status based on sensing data.

[0231] The AR content generation unit 14 determines whether there is accumulated trash in the facility based on the shooting data inside the facility.

[0232] AR content generation unit 14 generates AR content corresponding to the cleaning status within the facility where the work is being carried out.

[0233] Specifically, if there is garbage accumulated in the facility, the AR content generation unit 14 generates AR content representing the garbage accumulation as the cleaning status of the facility where the operation is being carried out.

[0234] The AR content generation unit 14 outputs display data of AR content corresponding to the operation status and display data of AR content corresponding to the cleaning status in the facility to the display data output unit 13.

[0235] exist Figure 15 In this context, it is envisioned that the sensing data acquisition unit 11, the AR content generation unit 14, and the display data output unit 13, which are components of the work assistance device 2, respectively transmit data via... Figure 16 This is implemented using dedicated hardware as shown. That is, the work assistance device 2 is envisioned to be implemented by a sensing data acquisition circuit 21, an AR content generation circuit 24, and a display data output circuit 23.

[0236] The sensing data acquisition circuit 21, the AR content generation circuit 24, and the display data output circuit 23 are, for example, single circuits, composite circuits, programmed processors, parallel programmed processors, ASICs, FPGAs, or circuits combining these.

[0237] The components of the work assistance device 2 are not limited to being implemented through dedicated hardware; the work assistance device 2 can also be implemented through software, firmware, or a combination of software and firmware.

[0238] When the work assistance device 2 is implemented through software or firmware, the program for causing the computer to perform each processing step in the sensing data acquisition unit 11, the AR content generation unit 14, and the display data output unit 13 is stored in... Figure 3 In the memory 31 shown. Then. Figure 3 The processor 32 shown executes the program stored in the memory 31.

[0239] In addition, Figure 16 The diagram shows an example where the components of the work assistance device 2 are implemented using dedicated hardware. Figure 3 The example shown is an example of a work assistance device 2 implemented by software or firmware. However, this is just one example; it is also possible that some components of the work assistance device 2 are implemented by dedicated hardware, while the remaining components are implemented by software or firmware.

[0240] Next, for Figure 15 The operation of the work assistance system shown will be explained. However, apart from camera 4 and AR content generation unit 14, the operation of the system will also be explained. Figure 1 The operation assistance system shown is the same. Therefore, the operation of camera 4 and AR content generation unit 14 will be mainly explained here.

[0241] Camera 4 takes pictures of the facility where the operation is being carried out and outputs the picture data to the operation assistance device 2.

[0242] AR content generation unit 14 acquires sensing data from sensing data acquisition unit 11.

[0243] AR Content Generation Department 14 and Figure 1 Similarly, the AR content generation unit 12 shown generates AR content corresponding to the operation status based on sensing data.

[0244] AR content generation unit 14 acquires shooting data from camera 4 within the facility.

[0245] The AR content generation unit 14 determines whether there is accumulated trash in the facility based on the shooting data inside the facility.

[0246] The following is a detailed explanation of the decision-making process of the AR content generation unit 14.

[0247] AR content generation unit 14 acquires, for example, shooting data around a conveyor belt from camera 4 as shooting data within the facility.

[0248] The AR content generation unit 14 stores images of the area around the belt conveyor when no garbage has accumulated around it in its internal memory or other storage.

[0249] The AR content generation unit 14 compares the image represented by the shooting data around the belt conveyor with the image representing the area around the belt conveyor when there is no accumulated garbage.

[0250] If the consistency between the two images is above the threshold, the AR content generation unit 14 determines that no garbage has accumulated around the belt conveyor.

[0251] If the similarity between two images is less than a threshold, the AR content generation unit 14 determines that there is garbage accumulating around the belt conveyor. The threshold can be stored in the internal memory of the AR content generation unit 14 or provided from the outside of the work assistance device 2.

[0252] If there is accumulated trash within the facility, then the AR content generation department 14, for example... Figure 17 As shown, AR content representing accumulated trash is generated to depict the cleaning status of the facility where the operation is being carried out. The generation and processing of AR content representing accumulated trash is a well-known technique, so detailed explanation is omitted.

[0253] Figure 17 This is an explanatory diagram showing an example of AR content containing accumulated garbage.

[0254] If no trash has accumulated in the facility, the AR content generation unit 14 generates AR content indicating that no trash has accumulated as the cleaning status of the facility where the operation is being carried out. For example, the AR content indicating no trash may include a message stating "No trash".

[0255] Here, the AR content generation unit 14 generates AR content indicating that no trash has accumulated. However, this is just one example; if no trash has accumulated in the facility, the AR content generation unit 14 may not generate AR content corresponding to the cleaning status of the facility.

[0256] The AR content generation unit 14 outputs display data representing AR content corresponding to the operation status to the display data output unit 13.

[0257] If the AR content generation unit 14 generates AR content corresponding to the cleaning status within the facility, it outputs display data representing the AR content to the display data output unit 13.

[0258] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11.

[0259] Additionally, the display data output unit 13 acquires AR content corresponding to the work implementation status from the AR content generation unit 14. If AR content corresponding to the cleaning status within the facility is output from the AR content generation unit 14, the display data output unit 13 acquires that AR content.

[0260] The display data output unit 13 overlaps the display data representing each AR content with the captured data, which is the sensing data.

[0261] When displaying data and shooting data are overlapped, the display data output unit 13 overlaps the display data and shooting data in a way that the operator's work performance is not obscured by the various AR contents.

[0262] That is, such as Figure 17 As shown, the display data output unit 13 overlaps the display data with the captured data in a way that the product being transported by the belt conveyor will not be visible due to the AR content.

[0263] The display data output unit 13 outputs the captured data, which is superimposed on the display data, to the display device 3.

[0264] The display device 3 obtains the captured data that overlaps with the displayed data from the display data output unit 13 of the work assistance device 2.

[0265] Display device 3 displays AR content based on the captured data superimposed on the display data.

[0266] Therefore, in display device 3, for example, displaying such as Figure 17 The AR content shown.

[0267] In the above-described embodiment 6, the work assistance device 2 is configured such that the AR content generation unit 12 generates AR content corresponding to the work implementation status, as well as AR content corresponding to the cleaning status within the facility where the work is being performed. Therefore, in the work assistance device 2, in addition to the operator being able to confirm the work implementation status, the operator can also confirm the cleaning status within the facility.

[0268] Implementation method 7.

[0269] In Embodiment 7, the following work assistance device 2 will be described. In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 15 of the work assistance device 2 also generates AR content representing the role that guides the work implementation content.

[0270] Figure 18 This is a structural diagram showing a work assistance system including the work assistance device 2 of embodiment 7. Figure 18 In, with Figure 1 and Figure 15 The same labels indicate the same or equivalent parts, so detailed descriptions are omitted.

[0271] Figure 19 This is a hardware structure diagram showing the hardware of the work assistance device 2 in embodiment 7. Figure 19 In, with Figure 2 and Figure 16 The same labels indicate the same or equivalent parts, so detailed descriptions are omitted.

[0272] AR content generation unit 15, for example, is composed of... Figure 19 The AR content generation circuit 25 shown is implemented.

[0273] The AR content generation unit 15 acquires sensing data from the sensing data acquisition unit 11 and acquires operation information representing the operation implementation content.

[0274] AR Content Generation Department 15 and Figure 1 Similarly, the AR content generation unit 12 shown generates AR content corresponding to the operation status based on sensing data.

[0275] The AR content generation department 15 uses job information to understand the content of the job performed by the operator.

[0276] AR Content Generation Unit 15 generates AR content representing the roles that guide the implementation of the operation.

[0277] The AR content generation unit 15 outputs display data of AR content corresponding to the operation status and display data of AR content representing the character to the display data output unit 13.

[0278] Figure 18 The work assistance device 2 shown applies the AR content generation unit 15 to... Figure 1 The work assistance device 2 shown is an example. However, this is just one example; the AR content generation unit 15 can also be applied to... Figure 15 The work assistance device 2 shown.

[0279] exist Figure 18 In this context, it is envisioned that the sensing data acquisition unit 11, the AR content generation unit 15, and the display data output unit 13, which are components of the work assistance device 2, respectively transmit data via... Figure 19 This is implemented using dedicated hardware as shown. That is, the work assistance device 2 is envisioned to be implemented by a sensing data acquisition circuit 21, an AR content generation circuit 25, and a display data output circuit 23.

[0280] The sensing data acquisition circuit 21, the AR content generation circuit 25, and the display data output circuit 23 are, for example, single circuits, composite circuits, programmed processors, parallel programmed processors, ASICs, FPGAs, or circuits combining these.

[0281] The components of the work assistance device 2 are not limited to being implemented through dedicated hardware; the work assistance device 2 can also be implemented through software, firmware, or a combination of software and firmware.

[0282] When the work assistance device 2 is implemented through software or firmware, the program for causing the computer to perform each processing step in the sensing data acquisition unit 11, the AR content generation unit 15, and the display data output unit 13 is stored in... Figure 3 In the memory 31 shown. Then. Figure 3 The processor 32 shown executes the program stored in the memory 31.

[0283] In addition, Figure 19 The diagram shows an example where the components of the work assistance device 2 are implemented using dedicated hardware. Figure 3 The example shown is an example of a work assistance device 2 implemented by software or firmware. However, this is just one example; it is also possible that some components of the work assistance device 2 are implemented by dedicated hardware, while the remaining components are implemented by software or firmware.

[0284] Next, for Figure 18 The operation of the work assistance system shown will be explained. However, apart from the AR content generation unit 15, the operation of the system will also be explained. Figure 1 The operation assistance system shown is the same. Therefore, the operation of the AR content generation unit 15 will be mainly explained here.

[0285] The AR content generation unit 15 acquires sensing data from the sensing data acquisition unit 11 and acquires operation information representing the operation implementation content.

[0286] AR Content Generation Department 15 and Figure 1 Similarly, the AR content generation unit 12 shown generates AR content corresponding to the operation status based on sensing data.

[0287] The AR content generation department 15 uses job information to understand the content of the job performed by the operator.

[0288] like Figure 20 As shown, the AR content generation unit 15 generates AR content representing the roles that guide the implementation of the operation.

[0289] Figure 20 This is an explanatory diagram showing an example of AR content representing a role that guides the implementation of a task.

[0290] exist Figure 20 The text shows the task description: "Please remove the lid located in the green box."

[0291] The AR content generation unit 15 outputs display data of AR content corresponding to the operation status and display data of AR content representing the character to the display data output unit 13.

[0292] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11.

[0293] In addition, the display data output unit 13 obtains AR content corresponding to the operation implementation status and AR content representing the character from the AR content generation unit 15.

[0294] The display data output unit 13 overlaps the display data representing each AR content with the captured data, which is the sensing data.

[0295] When displaying data and shooting data are overlapped, the display data output unit 13 overlaps the display data and shooting data in a way that the operator's work performance is not obscured by the various AR contents.

[0296] That is, such as Figure 20 As shown, the display data output unit 13 overlaps the display data with the captured data in a way that the product being transported by the belt conveyor will not be visible due to the AR content.

[0297] The display data output unit 13 outputs the captured data, which is superimposed on the display data, to the display device 3.

[0298] The display device 3 obtains the captured data that overlaps with the displayed data from the display data output unit 13 of the work assistance device 2.

[0299] Display device 3 displays AR content based on the captured data superimposed on the display data.

[0300] Therefore, in display device 3, for example, displaying such as Figure 20 The AR content shown.

[0301] In the above-described embodiment 7, the work assistance device 2 is configured such that the AR content generation unit 15 generates AR content corresponding to the work implementation status, as well as AR content representing the role guiding the work implementation content. Therefore, in the work assistance device 2, in addition to the operator being able to check the work implementation status, the operator can also check the work implementation content.

[0302] exist Figure 18 In the work assistance device 2 shown, the AR content generation unit 15 generates AR content representing a character guiding the implementation of the work. At this time, the AR content generation unit 15 can also adjust the speed of the work represented by the character-guided implementation content based on either the operator's skill or the operator's physical condition.

[0303] Specifically, if the task involves, for example, "tightening screws," the AR content generation unit 15 adjusts the speed of the "tightening screws" task based on either the operator's skill level or their physical condition. That is, if the operator's skill level increases, the AR content generation unit 15 might guide the tightening of screws to be faster, for example, by setting a prompt such as "tighten the screws in 00 seconds." Conversely, if the operator's physical condition is poor, the AR content generation unit 15 might guide the tightening of screws to be slower, for example, by setting a prompt such as "tighten the screws in approximately △ minutes."

[0304] The AR content generation unit 15, for example, provides any one of the operator's skills and physical condition to a learning model (not shown), and obtains speed information from the learning model representing the operation speed corresponding to any one of the operator's skills and physical condition.

[0305] When learning, if the learning model is provided with any one of the operator's skills and physical condition, and training data representing the work speed, it learns the work speed corresponding to any one of the operator's skills and physical condition.

[0306] AR content generation unit 15 generates AR content representing a role that guides the implementation of work at the speed indicated by the speed information.

[0307] exist Figure 18 In the work assistance device 2 shown, the AR content generation unit 15 generates AR content representing a bear-themed character, which serves as AR content representing the character guiding the work execution. However, this is just one example; the AR content generation unit 15 may also accept the selection of AR content representing the character to be generated before generating AR content representing the character guiding the work execution.

[0308] Specifically, the AR content generation unit 15 may have a user interface, and if the user selects AR content representing a character of the object to be generated by operating the user interface, then AR content representing that character is generated.

[0309] Implementation method 8.

[0310] In embodiment 8, the following work assistance device 2 will be described. In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 16 of the work assistance device 2 also generates AR content representing the actions of the skilled worker related to the work.

[0311] Figure 21 This is a structural diagram showing a work assistance system including the work assistance device 2 of embodiment 8. Figure 21 In, with Figure 1 , Figure 15 and Figure 18 The same labels indicate the same or equivalent parts, so detailed descriptions are omitted.

[0312] Figure 22 This is a hardware structure diagram showing the hardware of the work assistance device 2 in embodiment 8. Figure 22 In, with Figure 2 , Figure 16 and Figure 19 The same labels indicate the same or equivalent parts, so detailed descriptions are omitted.

[0313] AR content generation unit 16, for example, is composed of... Figure 22 The AR content generation circuit 26 shown is implemented.

[0314] The AR content generation unit 16 acquires sensing data from the sensing data acquisition unit 11 and acquires motion information representing the actions of skilled workers regarding the work performed by the operator.

[0315] AR Content Generation Department 16 and Figure 1 Similarly, the AR content generation unit 12 shown generates AR content corresponding to the operation status based on sensing data.

[0316] The AR content generation department 16 uses motion information to learn the movements of skilled workers.

[0317] AR content generation unit 16 generates AR content representing the actions of skilled workers.

[0318] The AR content generation unit 16 outputs display data of AR content corresponding to the work implementation status and display data of AR content representing the actions of skilled workers to the display data output unit 13.

[0319] Figure 21 The work assistance device 2 shown applies the AR content generation unit 16 to... Figure 1 The work assistance device 2 shown is an example. However, this is just one example; the AR content generation unit 16 can also be applied to... Figure 15 The work assistance device 2 shown or Figure 18 The work assistance device 2 shown.

[0320] exist Figure 21 In this context, it is envisioned that the sensing data acquisition unit 11, the AR content generation unit 16, and the display data output unit 13, which are components of the work assistance device 2, respectively transmit data via... Figure 22 This is implemented using dedicated hardware as shown. That is, the work assistance device 2 is envisioned to be implemented by a sensing data acquisition circuit 21, an AR content generation circuit 26, and a display data output circuit 23.

[0321] The sensing data acquisition circuit 21, the AR content generation circuit 26, and the display data output circuit 23 are, for example, single circuits, composite circuits, programmed processors, parallel programmed processors, ASICs, FPGAs, or circuits combining these.

[0322] The components of the work assistance device 2 are not limited to being implemented through dedicated hardware; the work assistance device 2 can also be implemented through software, firmware, or a combination of software and firmware.

[0323] When the work assistance device 2 is implemented through software or firmware, the program for causing the computer to perform each processing step in the sensing data acquisition unit 11, the AR content generation unit 16, and the display data output unit 13 is stored in... Figure 3 In the memory 31 shown. Then. Figure 3 The processor 32 shown executes the program stored in the memory 31.

[0324] In addition, Figure 22 The diagram shows an example where the components of the work assistance device 2 are implemented using dedicated hardware. Figure 3 The example shown is an example of a work assistance device 2 implemented by software or firmware. However, this is just one example; it is also possible that some components of the work assistance device 2 are implemented by dedicated hardware, while the remaining components are implemented by software or firmware.

[0325] Next, for Figure 21 The operation of the work assistance system shown will be explained. However, apart from the AR content generation unit 16, the operation of the system will also be explained. Figure 1 The operation assistance system shown is the same. Therefore, the operation of the AR content generation unit 16 will be mainly explained here.

[0326] The AR content generation unit 16 acquires sensing data from the sensing data acquisition unit 11 and acquires motion information representing the actions of skilled workers regarding the work performed by the operator.

[0327] Actions of skilled workers include, for example, the movement routes or body movements of skilled workers.

[0328] AR Content Generation Department 16 and Figure 1 Similarly, the AR content generation unit 12 shown generates AR content corresponding to the operation status based on sensing data.

[0329] The AR content generation unit 16 learns the skilled worker's movements based on motion information. If the motion information represents, for example, the skilled worker's movement route during work, then the AR content generation unit 16 learns the movement route during work. If the motion information represents, for example, the way the body moves during work, then the AR content generation unit 16 learns the way the body moves during work.

[0330] like Figure 23 As shown, the AR content generation unit 16 generates AR content representing the actions of skilled workers.

[0331] Figure 23 This is an explanatory diagram showing an example of AR content representing the actions of a skilled worker.

[0332] exist Figure 23 In the middle, AR content representing the actions of skilled workers is displayed, along with AR content showing the movement routes of skilled workers during their work.

[0333] The AR content generation unit 16 outputs display data of AR content corresponding to the work implementation status and display data of AR content representing the actions of skilled workers to the display data output unit 13.

[0334] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11.

[0335] In addition, the display data output unit 13 obtains AR content corresponding to the work implementation status and AR content representing the actions of skilled workers from the AR content generation unit 16.

[0336] The display data output unit 13 overlaps the display data representing each AR content with the captured data, which is the sensing data.

[0337] When displaying data and shooting data are overlapped, the display data output unit 13 overlaps the display data and shooting data in a way that the operator's work performance is not obscured by the various AR contents.

[0338] That is, such as Figure 23 As shown, the display data output unit 13 overlaps the display data with the captured data in a way that the product being transported by the belt conveyor will not be visible due to the AR content.

[0339] The display data output unit 13 outputs the captured data, which is superimposed on the display data, to the display device 3.

[0340] The display device 3 obtains the captured data that overlaps with the displayed data from the display data output unit 13 of the work assistance device 2.

[0341] Display device 3 displays AR content based on the captured data superimposed on the display data.

[0342] Therefore, in display device 3, for example, displaying such as Figure 23 The AR content shown.

[0343] In embodiment 8 described above, the work assistance device 2 is configured such that the AR content generation unit 16 generates AR content corresponding to the work implementation status, as well as AR content representing the actions of skilled workers related to the work. Therefore, in the work assistance device 2, in addition to the worker being able to confirm the work implementation status, the worker can also confirm the actions of skilled workers.

[0344] Furthermore, this disclosure allows for free combination of various embodiments, modification of any constituent element of each embodiment, or omission of any constituent element in each embodiment.

[0345] Industrial availability

[0346] This disclosure applies to work assistance devices, work assistance methods, and work assistance systems.

[0347] Label Explanation

[0348] 1: Sensor; 2: Work assistance device; 3: Display device; 4: Camera; 11: Sensing data acquisition unit; 12, 14, 15, 16: AR content generation unit; 13: Display data output unit; 21: Sensing data acquisition circuit; 22, 24, 25, 26: AR content generation circuit; 23: Display data output circuit; 31: Memory; 32: Processor.

Claims

1. A work assistance device, comprising: The sensing data acquisition unit acquires sensing data representing the work performance status from sensors that monitor the work performance status of the operator; The AR content generation unit generates AR (Augmented Reality) content corresponding to the operation implementation status based on the sensing data acquired by the sensing data acquisition unit; and The display data output unit outputs display data representing the AR content generated by the AR content generation unit.

2. The work assistance device according to claim 1, characterized in that, The sensor is a camera sensor used to capture images of the operation being performed. The sensing data acquisition unit acquires the imaging data representing the imaging result of the imaging sensor as sensing data representing the operation implementation status. The display data output unit overlaps the display data representing the AR content generated by the AR content generation unit with the shooting data, and outputs the shooting data after overlapping with the display data.

3. The work assistance device according to claim 2, characterized in that, The display data output unit ensures that the display data representing the AR content overlaps with the shooting data in such a way that the operator's work performance status is not obscured by the AR content generated by the AR content generation unit.

4. The work assistance device according to claim 1, characterized in that, Before generating AR content corresponding to the operation implementation status, the AR content generation unit accepts the selection of AR content for the object to be generated.

5. The work assistance device according to claim 1, characterized in that, The AR content generation unit calculates the operator's task completion rate as the task implementation status based on the sensing data acquired by the sensing data acquisition unit, and generates AR content corresponding to the task completion rate.

6. The work assistance device according to claim 1, characterized in that, The AR content generation unit generates AR content corresponding to the current season as AR content corresponding to the operation implementation status.

7. The work assistance device according to claim 1, characterized in that, In addition to generating AR content corresponding to the operation implementation status, the AR content generation unit also generates AR content corresponding to the current moment.

8. The work assistance device according to claim 1, characterized in that, In addition to generating AR content corresponding to the operation status, the AR content generation unit also generates AR content corresponding to the current season.

9. The work assistance device according to claim 1, characterized in that, In addition to generating AR content corresponding to the operation implementation status, the AR content generation unit also generates AR content corresponding to the operation implementation time.

10. The work assistance device according to claim 1, characterized in that, In addition to generating AR content corresponding to the operation implementation status, the AR content generation unit also generates AR content corresponding to the current weather.

11. The work assistance device according to claim 1, characterized in that, In addition to generating AR content corresponding to the operation implementation status, the AR content generation unit also generates AR content corresponding to the cleaning status within the facility where the operation is being carried out.

12. The work assistance device according to claim 1, characterized in that, In addition to generating AR content corresponding to the operation implementation status, the AR content generation unit also generates AR content representing the role that guides the operation implementation.

13. The work assistance device according to claim 12, characterized in that, The AR content generation unit adjusts the speed of the operation shown in the implementation content guided by the character based on either the operator's skill or the operator's physical condition.

14. The work assistance device according to claim 1, characterized in that, In addition to generating AR content corresponding to the work implementation status, the AR content generation unit also generates AR content representing the actions of skilled workers related to the work.

15. A method for assisting with a task, wherein, The sensing data acquisition unit acquires sensing data representing the work execution status from sensors that monitor the worker's work execution status. The AR content generation unit generates AR (Augmented Reality) content corresponding to the operation implementation status based on the sensing data acquired by the sensing data acquisition unit. The display data output unit outputs display data representing the AR content generated by the AR content generation unit.

16. A job assistance system, comprising: Sensors that monitor the operator's work performance; The sensing data acquisition unit acquires sensing data from the sensor that represents the status of the operation. The AR content generation unit generates AR (Augmented Reality) content corresponding to the operation implementation status based on the sensing data acquired by the sensing data acquisition unit. The display data output unit outputs display data representing the AR content generated by the AR content generation unit; as well as The display device displays AR content according to the display data output from the display data output unit.

Images