Work support device, work support procedure and work support system

Abstract

Work support device (2) comprising: a data acquisition unit (11) for acquiring data representing the execution status of work performed by an operator from a sensor (1) in order to monitor the execution status of the work; an AR content generation unit (12) for generating AR content corresponding to the execution status of the work based on the data acquired by the data acquisition unit (11); and a display data output unit (13) for outputting display data representing the AR content generated by the AR content generation unit (12).

Description

AREA OF TECHNOLOGY

[0001] The present disclosure relates to a work support device, a work support method and a work support system. STATE OF THE ART

[0002] There are work support devices to assist the work performed by an operator.

[0003] For example, patent literature 1 discloses a fork positioning support device with a camera and an image display unit as such a work support device.

[0004] The camera captures an image of the front of a forklift and outputs image data to the display unit, representing the image of the front. The camera's front image capture area encompasses a pallet being transported by the forklift and the forklift's forks. The display unit then initiates a display to show the image represented by the image data output from the camera. REFERENCE LIST PATENT LITERATURE

[0005] Patent Literature 1: JP-2013-86959-A SUMMARY OF THE INVENTIONAL PROBLEM

[0006] The problem with the device for supporting fork positioning disclosed in patent literature 1 is that an operator operating the forklift can check the relative positions of the pallet and the forks by looking at the display, but he cannot check how far the pallet transport operations have progressed, since the execution status of the pallet transport operations is not known.

[0007] The present disclosure was made to solve the problem described above, and one of its aims is to obtain a work support device that enables an operator to check the execution status of the work. SOLUTION TO THE TASK

[0008] A work support device according to the present disclosure comprises: a data acquisition unit for acquiring data representing the execution status of work performed by an operator from a sensor in order to monitor the execution status of the work; an augmented reality (AR) content generation unit for generating AR content corresponding to the execution status of the work based on the data acquired by the data acquisition unit; and a display data output unit for outputting display data representing the AR content generated by the AR content generation unit. ADVANTAGEOUS EFFECTS OF THE INVENTION

[0009] The present disclosure enables an operator to check the execution status of work. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 is a configuration diagram showing a work support system with a work support device 2 according to a first embodiment. Fig. Figure 2 is a hardware configuration diagram showing the hardware of the work support device 2 according to the first embodiment. Fig. Figure 3 is a hardware configuration diagram of a computer in the case where the work support device 2 is implemented by software, firmware or the like. Fig. Figure 4 is a flowchart illustrating a work support procedure performed by the work support device 2. Fig. Figure 5 is an explanatory illustration showing the products transported by a conveyor belt. Fig. Figure 6 is an explanatory illustration showing an example of AR content that corresponds to a work completion rate Acr. Fig. Figure 7 is an explanatory illustration that provides an example of the AR content corresponding to the work completion rate Acr. Fig. Figure 8 is an explanatory illustration that provides an example of the AR content corresponding to the work completion rate Acr. Fig. Figure 9 is an explanatory illustration that provides an example of the AR content that corresponds to the work completion rate Acr. Fig. Figure 10 is an explanatory illustration that provides an example of AR content indicating that the current time is within working hours. Fig. Figure 11 is an explanatory illustration that provides an example of AR content indicating that the current time is within a break time. Fig. 12 is an explanatory illustration showing AR content reminiscent of summer, as an example of AR content that corresponds to the current season. Fig. Figure 13 is an explanatory illustration showing an example of AR content that corresponds to the execution time of the work. Fig. Figure 14 is an explanatory illustration showing an example of AR content based on the current weather. Fig. Figure 15 is a configuration diagram showing a work support system with a work support device 2 according to a sixth embodiment. Fig. Figure 16 is a hardware configuration diagram showing the hardware of the work support device 2 according to the sixth embodiment. Fig. Figure 17 is an explanatory illustration showing an example of AR content indicating that trash has accumulated. Fig. Figure 18 is a configuration diagram showing a work support system with a work support device 2 according to a seventh embodiment. Fig. Figure 19 is a hardware configuration diagram showing the hardware of the work support device 2 according to the seventh embodiment. Fig. Figure 20 is an explanatory illustration that presents an example of AR content representing a mascot character that guides the execution of the work. Fig. Figure 21 is a configuration diagram showing a work support system with a work support device 2 according to an eighth embodiment. Fig. Figure 22 is a hardware configuration diagram that illustrates the hardware of the work support device 2 according to the eighth embodiment. Fig. Figure 23 is an explanatory illustration that provides an example of AR content representing operations performed by a skilled worker. DESCRIPTION OF THE EXAMPLES OF EXECUTION

[0010] The following sections, with reference to the attached drawings, explain ways of implementing the present disclosure in order to further clarify the present disclosure. First embodiment.

[0011] Fig. Figure 1 is a configuration diagram showing a work support system with a work support device 2 according to a first embodiment.

[0012] Fig. Figure 2 is a hardware configuration diagram showing the hardware of the work support device 2 according to the first embodiment.

[0013] The in Fig. The work support system shown comprises a sensor 1, the work support device 2 and a display device 3.

[0014] Sensor 1 is implemented, for example, by a camera or a lidar device.

[0015] Sensor 1 monitors the execution status of the work performed by an operator and outputs acquisition data to the work support device 2, representing the execution status of the work.

[0016] Both the camera and the lidar device are image acquisition sensors that capture an image of the work progress. Specifically, the lidar device is capable of emitting laser light towards a target object, receiving the reflected light from the laser light reflected by the target object, and determining the shape of the target object based on this reflected light.

[0017] The tasks performed by the operator include, for example: receiving products transported via a conveyor belt; sorting products transported via a conveyor belt; assembling products; assembling products by operating a robot; determining whether the quality of the products is good or not; determining whether the quality of the products is good or not by operating a robot; and transporting pallets by operating a forklift.

[0018] The execution status of the work includes, for example: a completion rate of the work performed by the operator; the success rate of the work performed by the operator; the number of days in which the work performed by the operator was carried out; the progress of the work performed by the operator; and the accuracy of the work performed by the operator.

[0019] If the work performed by the operator involves, for example, receiving products, then the work completion rate could be the ratio between the number of products received to date and the target number of products received. Other examples of work success metrics include the number of products received to date.

[0020] If the work performed by the operator involves, for example, conveying pallets, the work completion rate could be the ratio between the number of pallets conveyed to date and the target number of pallets conveyed. Other examples of work success metrics include the number of pallets conveyed to date.

[0021] For example, if the work performed by the operator involves the assembly of products, then examples of the progress status include one representing work elements that have been implemented by a variety of work elements required from the start of product assembly to the completion of the products.

[0022] The work support device 2 comprises a data acquisition unit 11, an AR content generation unit 12 and a display data output unit 13.

[0023] The work support device 2 generates augmented reality (AR) content that corresponds to the execution status of the work and outputs display data representing the AR content to the display device 3.

[0024] The display device 3 is implemented, for example, by AR glasses, a tablet or a smartphone.

[0025] The display device 3 displays the AR content based on the display data output by the work support device 2.

[0026] The data acquisition unit 11 is implemented, for example, by a data acquisition circuit 21, which is located in Fig. 2 is shown.

[0027] The data acquisition unit 11 acquires data from sensor 1 that represents the execution status of the work. If sensor 1 is an image sensor that captures an image of the execution status of the work, the data acquisition unit 11 acquires image data representing an image capture result from the image sensor as data representing the execution status of the work.

[0028] The data acquisition unit 11 outputs the acquisition data to the AR content generation unit 12 and the display data output unit 13, respectively.

[0029] The AR content generation unit 12 is implemented, for example, by an AR content generation circuit 22, which is located in Fig. 2 is shown.

[0030] The AR content generation unit 12 acquires the capture data from the capture data acquisition unit 11.

[0031] Based on the captured data, the AR content generation unit 12 generates the AR content that corresponds to the execution status of the work. The AR content generation unit 12 outputs the display data representing the AR content to the display data output unit 13.

[0032] The display data output unit 13 is, for example, provided by a Fig. 2. Display data output circuit 23 is implemented.

[0033] The display data output unit 13 captures the capture data from the capture data acquisition unit 11 and captures the display data representing the AR content from the AR content generation unit 12.

[0034] For example, if the display device 3 is an AR headset and the operator wearing the AR headset can see the execution status of the work through the AR headset with the naked eye, the display data output unit 13 only captures the display data that represents the AR content and outputs the display data to the display device 3.

[0035] If the operator wearing the AR glasses cannot see the execution status of the work through the AR glasses with the naked eye, the display data output unit 13 captures both the display data representing the AR content and the capture data.

[0036] If the display device 3 is, for example, a tablet or a smartphone, the display data output unit 13 captures both the display data representing the AR content and the capture data.

[0037] The display data output unit 13 overlays the image acquisition data, which represents the AR content, with the acquisition data and outputs the image acquisition data to the display device 3 after the overlay of the display data.

[0038] In Fig. 1 It is assumed that the data acquisition unit 11, the AR content generation unit 12 and the display data output unit 13, which are components of the work support device 2, are implemented by special hardware that is in Fig. Figure 2 is shown. That is, it is assumed that the work support device 2 is implemented by the data acquisition circuit 21, the AR content generation circuit 22, and the display data output circuit 23. For example, each of the data acquisition circuit 21, AR content generation circuit 22, and display data output circuit 23 corresponds to a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a combination thereof.

[0039] The components of the work support device 2 are not limited to those implemented by special hardware, but the work support device 2 can also be implemented by software, firmware or a combination of software and firmware.

[0040] The software or firmware is stored as a program in a computer's main memory. The computer is hardware for executing programs and corresponds, for example, to a central processing unit (CPU), a graphics processing unit (GPU), a central processing unit, a processing device, a computing device, a microprocessor, a microcomputer, a processor, or a digital signal processor (DSP).

[0041] Fig. Figure 3 is a hardware configuration diagram of the computer in the case that the work support device 2 is implemented by software, firmware or the like.

[0042] In a case where the work support device 2 is implemented by software, firmware, or the like, a program that causes the computer to perform a processing operation carried out in each of the data acquisition unit 11, the AR content generation unit 12, and the display data output unit 13 is stored in a memory 31. Then a processor 32 executes the programs stored in the memory 31.

[0043] Furthermore, it illustrates Fig. 2 an example in which each of the constituent elements of the work support device 2 is implemented by dedicated hardware, and Fig. Figure 3 illustrates an example where the work support device 2 is implemented by software, firmware, or the like. However, this is only an example. Some components of the work support device 2 may be implemented by special hardware, while the remaining components may be implemented by software, firmware, or the like.

[0044] The following are the items from the in Fig. The processes carried out in the work support system shown in section 1 are explained.

[0045] Fig. Figure 4 is a flowchart illustrating a work support procedure performed by the work support device 2.

[0046] Sensor 1 is attached, for example, to a helmet worn by the operator, to AR glasses worn by the operator, to the wall / ceiling of a factory where the work is carried out, or similar.

[0047] Sensor 1 monitors the execution status of the work performed by an operator and outputs the acquisition data representing the execution status of the work to the work support device 2.

[0048] Fig. Figure 5 is an explanatory illustration showing the products transported by a conveyor belt.

[0049] The following is an example where the work performed by the operator consists of receiving the products transported by the conveyor belt.

[0050] Although the operator in Fig. If 5 is not shown, it is assumed that the operator is standing, for example, to the side of the conveyor belt or near the front end of the conveyor belt.

[0051] The data acquisition unit 11 acquires the data representing the execution status of the work from sensor 1 (step ST1 in Fig. 4).

[0052] For the sake of simplicity, it is assumed here that sensor 1 is an image acquisition sensor that captures an image of the work's execution status, and that the data acquisition unit 11 captures image acquisition data representing an image acquisition result of the image acquisition sensor as acquisition data representing the work's execution status.

[0053] The data acquisition unit 11 outputs the acquisition data to the AR content generation unit 12 and the display data output unit 13, respectively.

[0054] The AR content generation unit 12 acquires the capture data from the capture data acquisition unit 11.

[0055] Based on the captured data, the AR content generation unit 12 generates the AR content that corresponds to the execution status of the work (step ST2 in Fig. 4).

[0056] The AR content generation unit 12 outputs the display data representing the AR content to the display data output unit 13.

[0057] The following section describes in more detail a process for generating AR content, which is carried out by AR Content Generation Unit 12.

[0058] Based on the captured data, the AR content generation unit 12 counts the number of products transported via the conveyor belt and received by the operator. Since the method for counting the number of products received by the operator based on image capture data is itself a known technology, a detailed explanation is omitted.

[0059] Assuming that the target number of products received is Enum and the number of products received by the operator is Tnum, the AR content generation unit 12 calculates a work completion rate Acr, which is represented by the following formula (1). Acr=(Tnum / Enum)×100%

[0060] As AR content corresponding to the work completion status, the AR content generation unit 12 generates AR content that corresponds to the work completion rate Acr. Since the process of generating AR content itself is a known technology, a detailed explanation is omitted.

[0061] Each of the Fig. 6, Fig. 7 and Fig. Figure 8 is an explanatory illustration that provides an example of the AR content corresponding to the work completion rate Acr.

[0062] Fig. 6, Fig. 7 and Fig. Figure 8 each shows an example where the AR content corresponding to the work completion rate Acr is tulips. The number of tulip blossoms increases with increasing work completion rate Acr.

[0063] Fig. Figure 6 shows an example where the tulips did not bloom at all because the work completion rate Acr is low.

[0064] Fig. Figure 7 shows an example where the tulips have bloomed a little because the work completion rate Acr has increased slightly.

[0065] Fig. Figure 8 shows an example where the tulips have almost fully bloomed, as the work completion rate Acr has approached 100%.

[0066] Here, the AR content corresponding to the work execution status represents tulips whose bloom level changes depending on the work completion rate (Acr). However, this is just one example. For instance, the AR content generation unit 12 could generate AR content representing the work completion rate (Acr) as the AR content corresponding to the work execution status, as shown in Fig. 9 shown.

[0067] Fig. Figure 9 is an explanatory illustration that provides an example of the AR content that corresponds to the work completion rate Acr.

[0068] As AR content that corresponds to the work completion rate Acr, it shows Fig. 9 an AR content in which a number representing the fulfillment rate Acr is surrounded by flowers.

[0069] The display data output unit 13 captures the capture data from the capture data acquisition unit 11 and captures the display data representing the AR content from the AR content generation unit 12.

[0070] The display data output unit 13 overlays the display data, which represents the AR content, onto the image capture data, which is the acquisition data.

[0071] When overlaying the display data on the image acquisition data, the display data output unit 13 places the display data on top of the image acquisition data in such a way that the execution status of the work performed by the operator is not obscured by the AR content.

[0072] That is, as in the Fig. 6, Fig. 7, Fig. 8 to Fig. As shown in Figure 9, the display data output unit 13 overlays the image acquisition data with the display data in such a way that the products transported by the conveyor belt are not obscured by the AR content.

[0073] The display data output unit 13 outputs the image acquisition data to the display device 3 after the display data has been superimposed (step ST3 in Fig. 4).

[0074] The display device 3 acquires the image acquisition data after the display data from the display data output unit 13 is superimposed onto the work support device 2.

[0075] The display device 3 displays the AR content based on the image capture data after the display data has been superimposed.

[0076] For example, the one in the Fig. 6, Fig. 7, Fig. 8 to Fig. 9 AR content is displayed on the display device 3.

[0077] In the first embodiment mentioned above, the work support device 2 comprises: the data acquisition unit 11, for acquiring data representing the work execution status from the sensor 1 in order to monitor the execution status of the work performed by the operator; the AR content generation unit 12, for generating AR content corresponding to the work execution status based on the data acquired by the data acquisition unit 11; and the display data output unit 13, for outputting the display data representing the AR content generated by the AR content generation unit 12. Accordingly, the work support device 2 enables the operator to verify the execution status of the work.

[0078] It should be noted that by displaying AR content that corresponds to the execution status of the work, the beneficial effect of maintaining the operator's concentration, increasing the operator's motivation, or promoting the operator's refreshment can also be achieved.

[0079] Furthermore, in the first embodiment, the work support device 2 is configured such that the AR content generation unit 12 calculates the completion rate of the work performed by the operator as the work execution status based on the acquisition data captured by the data acquisition unit 11, and generates the AR content accordingly. Thus, the work support device 2 enables the operator to verify the work completion rate.

[0080] In the Fig. The work support device 2 shown in Figure 1 generates the AR content generation unit 12 as AR content corresponding to the work execution status. Tulips, whose degree of bloom changes depending on the work completion rate Acr, are generated by the AR content generation unit 12. However, this is only an example. The AR content generation unit 12 can accept the selection of the AR content to be generated before generating the AR content corresponding to the work execution status.

[0081] In particular, the AR content generation unit 12 includes, for example, a user interface, and when a user operates the user interface to, for example, display tulips whose degree of bloom changes depending on the work completion rate Acr, as in the Fig. 6, Fig. 7 to Fig. As shown in 8, when selected as AR content to be generated, the AR content generation unit generates 12 tulips, whose degree of bloom changes depending on the work completion rate Acr.

[0082] When the user interacts with the user interface, for example to select AR content in which a number representing the fulfillment rate Acr is surrounded by flowers, as in Fig. Represented as AR content to be generated in 9, the AR content generation unit 12 generates the AR content in which a number representing the fulfillment rate Acr is surrounded by flowers.

[0083] In addition, the AR content generation unit 12 can retrieve the current season from a built-in or external calendar and switch the AR content according to the progress status of the work depending on the current season.

[0084] If the current season is spring, as in the Fig. 6, Fig. 7 to Fig. As shown in Figure 8, the AR content generation unit 12, for example, generates tulips whose degree of bloom changes as AR content depending on the work completion rate Acr, which corresponds to the execution status of the work.

[0085] If the current season is summer, the AR content generation unit generates 12 AR content items that correspond to the work's completion status, e.g., cherry blossoms whose bloom level changes depending on the work completion rate Acr.

[0086] If the current season is autumn, the AR content generation unit 12 generates AR content that corresponds to the work's completion status, e.g., autumn leaves whose coloring changes depending on the work completion rate Acr.

[0087] If the current season is winter, the AR content generation unit 12, for example, generates snowfall, the amount of which changes as AR content depending on the work completion rate Acr, according to the work's execution status.

[0088] In the Fig. The work support device 2 shown in Figure 1 generates the AR content generation unit 12 as AR content corresponding to the work completion status, specifically the AR content corresponding to the work completion rate Acr. However, this is only an example. For instance, the AR content generation unit 12 can generate AR content corresponding to the work completion status that represents one of the following: the success number of the work performed by the operator; the number of days the work was performed by the operator; the progress of the work performed by the operator; or the accuracy of the work performed by the operator.

[0089] In a case where the AR content corresponding to the work progress is generated, the AR content generation unit 12 can detect the work progress by counting the work elements that have been performed among a multitude of work elements required from the start of product assembly to product completion.

[0090] In the Fig. In the work support device 2 shown in Figure 1, the AR content generation unit 12 generates the AR content according to the work's execution status. The AR content generation unit 12 can generate AR content according to the work's execution status and can also generate AR content that represents an ideal standing position for the operator. For example, information about the operator's ideal standing position is stored in the internal memory of the AR content generation unit 12. Examples of AR content that represents the operator's ideal standing position include, for example, an illustration of footprints depicting the operator's ideal standing position. Second embodiment.

[0091] In a work support device 2 described in a second embodiment, an AR content generation unit 12 generates AR content according to the execution status of the work and additionally AR content according to the current time.

[0092] The configuration of the work support device 2 according to the second embodiment is similar to the configuration of the work support device 2 according to the first embodiment, and the configuration diagram representing a work support system with the work support device 2 according to the second embodiment is Fig. 1.

[0093] The AR content generation unit 12 generates the AR content according to the execution status of the work and additionally generates the AR content according to the current time.

[0094] The AR content generation unit 12 outputs display data to a display data output unit 13, representing the AR content according to the execution status of the work, and display data representing the AR content according to the current time.

[0095] The processes performed by the work support system according to the second embodiment are then explained. It should be noted that, with the exception of the AR content generation unit 12, the work support system according to the second embodiment is identical to the one described in Fig. The work support system shown in Figure 1 is similar. For this reason, the processes performed by the AR content generation unit 12 are mainly explained here.

[0096] The AR content generation unit 12 acquires capture data from a capture data acquisition unit 11.

[0097] Similar to the first embodiment, the AR content generation unit 12 generates the AR content based on the acquisition data, which corresponds to the execution status of the work.

[0098] The AR content generation unit 12 obtains the current time either from a built-in clock or an external clock.

[0099] The AR content generation unit 12 generates the AR content according to the current time.

[0100] The following section explains in more detail a process carried out by AR content generation unit 12 to generate AR content according to the current time.

[0101] If the current time falls within working hours, for example, as in Fig. As shown in Figure 10, the AR content generation unit produces 12 AR content items that indicate they are within working hours.

[0102] Fig. Figure 10 is an explanatory illustration that provides an example of the AR content indicating that the current time is within working hours.

[0103] If the current time falls within a break time, for example, as in Fig. As shown in Figure 11, the AR content generation unit creates 12 AR content items that indicate they are within the break time.

[0104] Fig. Figure 11 is an explanatory illustration showing an example of the AR content indicating that the current time is within the break time.

[0105] In Fig. 11 are a coffee cup and a tea bowl, each containing AR content, which means they are within break time.

[0106] Here, AR content generation unit 12 generates, as AR content corresponding to the current time, either AR content indicating that it is within working hours or AR content indicating that it is within break time. However, this is just one example. As AR content corresponding to the current time, AR content generation unit 12 could, for example, generate AR content indicating that it is morning, AR content indicating that it is daytime, or AR content indicating that it is nighttime.

[0107] The display data output unit 13 receives the acquisition data from the acquisition data acquisition unit 11.

[0108] In addition, the display data output unit 13 receives from the AR content generation unit 12 the AR content that corresponds to the execution status of the work and the AR content that corresponds to the current time.

[0109] The display data output unit 13 overlays the display data, which represents the individual types of AR content, with the image capture data, i.e. the acquisition data.

[0110] When the display data is overlaid on the image capture data, the display data output unit 13 overlays the display data on the image capture data in such a way that the execution status of the work performed by an operator is not obscured by either type of AR content.

[0111] This means that the display data output unit 13 overlays the image acquisition data with the display data, as described in the Fig. 10 to Fig. 11 is shown so that the products transported by the conveyor belt are not obscured by the AR content.

[0112] The display data output unit 13 outputs the image acquisition data to a display device 3 after the display data has been superimposed.

[0113] The display device 3 acquires the image acquisition data after the display data from the display data output unit 13 is superimposed onto the work support device 2.

[0114] The display device 3 displays the AR content based on the image capture data after the display data has been superimposed.

[0115] For example, the in Fig. 10 or Fig. 11 AR content is displayed on the display device 3.

[0116] In the second embodiment mentioned above, the work support device 2 is configured such that the AR content generation unit 12 generates AR content according to the execution status of the work and, additionally, AR content according to the current time. Accordingly, the work support device 2 allows the operator to check the execution status of the work and also to check the time period to which the current time belongs. Third embodiment.

[0117] In a work support device 2 described in a third embodiment, an AR content generation unit 12 generates AR content according to the status of the work and additionally AR content according to the current season.

[0118] The configuration of the work support device 2 according to the third embodiment is similar to the configuration of the work support device 2 according to the first embodiment, and the configuration diagram representing a work support system with the work support device 2 according to the third embodiment is Fig. 1.

[0119] The AR content generation unit 12 generates the AR content that corresponds to the execution status of the work and additionally generates the AR content that corresponds to the current season.

[0120] The AR content generation unit 12 outputs display data to a display data output unit 13, representing the AR content according to the execution status of the work, as well as display data representing the AR content according to the current season.

[0121] Next, the operations performed by the work support system according to the third embodiment will be explained. It should be noted that, with the exception of the AR content generation unit 12, the work support system according to the third embodiment is identical to the one described in Fig. The work support system shown in Figure 1 is similar. For this reason, the processes performed by the AR content generation unit 12 are mainly explained here.

[0122] The AR content generation unit 12 acquires capture data from a capture data acquisition unit 11.

[0123] Similar to the first embodiment, the AR content generation unit 12 generates the AR content based on the acquisition data, which corresponds to the execution status of the work.

[0124] The AR content generation unit 12 retrieves the current season from either a built-in or an external calendar.

[0125] The AR content generation unit 12 generates the AR content according to the current season.

[0126] The following section describes in more detail a process carried out by AR Content Generation Unit 12 to generate AR content corresponding to the current season.

[0127] If the current season is spring, the AR content generation unit creates 12 AR content items that evoke spring. Examples of spring-related AR content include content depicting cherry blossoms, plum blossoms, and bamboo shoots.

[0128] If the current season is summer, the AR content generation unit creates 12 AR content items that evoke summer. Examples of summer-themed AR content include watermelons, fireworks, and a beach.

[0129] If the current season is autumn, the AR content generation unit creates 12 AR content items that evoke autumn. Examples of autumn-themed AR content include content depicting autumn leaves, chestnuts, and Pacific mackerel.

[0130] If the current season is winter, the AR content generation unit creates 12 AR content items that evoke winter. Examples of winter-themed AR content include content depicting a snowman, skiing, and a scarf.

[0131] Fig. Figure 12 is an explanatory illustration that presents the AR content reminiscent of summer as an example of AR content that corresponds to the current season.

[0132] Here, AR Content Generation Unit 12 generates, as AR content corresponding to the current season, any AR content that evokes spring, summer, autumn, or winter. However, this is just one example. As AR content corresponding to the current season, AR Content Generation Unit 12 could, for example, generate AR content that evokes each month from January to December.

[0133] The display data output unit 13 receives the acquisition data from the acquisition data acquisition unit 11.

[0134] In addition, the display data output unit 13 receives from the AR content generation unit 12 the AR content corresponding to the execution status of the work and the AR content corresponding to the current season.

[0135] The display data output unit 13 overlays the display data, which represents the individual types of AR content, with the image capture data, i.e. the acquisition data.

[0136] When the display data is overlaid on the image capture data, the display data output unit 13 overlays the display data on the image capture data in such a way that the execution status of the work performed by an operator is not obscured by either type of AR content.

[0137] As in Fig. As shown in Figure 12, the display data output unit 13 overlays the image acquisition data with the display data so that the products transported on the conveyor belt are not obscured by the AR content.

[0138] The display data output unit 13 outputs the image acquisition data to a display device 3 after the display data has been superimposed.

[0139] The display device 3 acquires the image acquisition data after the display data from the display data output unit 13 is superimposed onto the work support device 2.

[0140] The display device 3 displays the AR content based on the image capture data after the display data has been superimposed.

[0141] For example, the in Fig. 12 AR content is displayed on the display device 3.

[0142] In the third embodiment mentioned above, the work support device 2 is configured such that the AR content generation unit 12 generates AR content according to the work's progress and, additionally, AR content according to the current season. Accordingly, the work support device 2 allows the operator to check the work's progress and also monitor the current season. Fourth embodiment.

[0143] In a work support device 2 described in a fourth embodiment, an AR content generation unit 12 generates AR content corresponding to the execution status of the work and additionally generates AR content corresponding to the execution time of the work.

[0144] The configuration of the work support device 2 according to the fourth embodiment is similar to the configuration of the work support device 2 according to the first embodiment, and the configuration diagram representing a work support system with the work support device 2 according to the fourth embodiment is Fig. 1.

[0145] The AR content generation unit 12 generates the AR content according to the execution status of the work and additionally generates the AR content according to the execution time of the work.

[0146] The AR content generation unit 12 outputs display data to a display data output unit 13, representing the AR content according to the execution status of the work, and display data representing the AR content according to the execution time of the work.

[0147] Next, the operations performed by the work support system according to the fourth embodiment will be explained. It should be noted that, with the exception of the AR content generation unit 12, the work support system according to the fourth embodiment is identical to the one described in Fig. The work support system shown in Figure 1 is similar. For this reason, the processes performed by the AR content generation unit 12 are mainly explained here.

[0148] The AR content generation unit 12 acquires capture data from a capture data acquisition unit 11.

[0149] Similar to the first embodiment, the AR content generation unit 12 generates the AR content based on the acquisition data, which corresponds to the execution status of the work.

[0150] The AR content generation unit 12 obtains the current time either from a built-in clock or an external clock.

[0151] The AR content generation unit 12 stores the time at which an operator started work.

[0152] The AR content generation unit 12 calculates the execution time of the work as the time from the time the operator started the work until the current time.

[0153] For example, the AR content generation unit 12 generates, as shown in Fig. 13 shows the AR content according to the execution time of the work.

[0154] Fig. 13 is an explanatory representation that shows an example of the AR content according to the execution time of the work.

[0155] The display data output unit 13 receives the acquisition data from the acquisition data acquisition unit 11.

[0156] In addition, the display data output unit 13 receives from the AR content generation unit 12 the AR content corresponding to the execution status of the work and the AR content corresponding to the execution time of the work.

[0157] The display data output unit 13 overlays the display data, which represents the individual types of AR content, with the image capture data, i.e. the acquisition data.

[0158] When overlaying the display data on the image capture data, the display data output unit 13 places the display data on top of the image capture data in such a way that the execution status of the work performed by the operator is not obscured by the individual types of AR content.

[0159] As in Fig. As shown in Figure 13, the display data output unit 13 overlays the image acquisition data with the display data so that the products transported on the conveyor belt are not obscured by the AR content.

[0160] The display data output unit 13 outputs the image acquisition data to a display device 3 after the display data has been superimposed.

[0161] The display device 3 acquires the image acquisition data after the display data from the display data output unit 13 is superimposed onto the work support device 2.

[0162] The display device 3 displays the AR content based on the image capture data after the display data has been superimposed.

[0163] For example, the in Fig. 13 AR content is displayed on the display device 3.

[0164] In the fourth embodiment mentioned above, the work support device 2 is configured such that the AR content generation unit 12 generates the AR content according to the execution status of the work and additionally generates the AR content according to the execution time of the work. Accordingly, the work support device 2 enables the operator to check the execution status of the work and additionally enables him to check the execution time of the work. Fifth embodiment.

[0165] In a work support device 2 described in a fifth embodiment, an AR content generation unit 12 generates AR content corresponding to the status of the work being carried out and additionally generates AR content corresponding to the current weather.

[0166] The configuration of the work support device 2 according to the fifth embodiment is similar to the configuration of the work support device 2 according to the first embodiment, and the configuration diagram representing a work support system with the work support device 2 according to the fifth embodiment is Fig. 1.

[0167] The AR content generation unit 12 generates the AR content according to the execution status of the work and additionally generates the AR content according to the current weather.

[0168] The AR content generation unit 12 outputs display data to a display data output unit 13, which represents the AR content according to the execution status of the work, and display data which represents the AR content according to the current weather.

[0169] Next, the operations performed by the work support system according to the fifth embodiment will be explained. It should be noted that, with the exception of the AR content generation unit 12, the work support system according to the fifth embodiment is identical to the one described in Fig. The work support system shown in Figure 1 is similar. For this reason, the processes performed by the AR content generation unit 12 are mainly explained here.

[0170] The AR content generation unit 12 acquires capture data from a capture data acquisition unit 11.

[0171] Similar to the first embodiment, the AR content generation unit 12 generates the AR content based on the acquisition data, which corresponds to the execution status of the work.

[0172] For example, AR Content Generation Unit 12 retrieves weather information representing the current weather from a non-illustrated weather page.

[0173] As in Fig. As shown in Figure 14, the AR content generation unit 12, for example, generates the AR content that corresponds to the weather represented by the weather information.

[0174] Fig. Figure 14 is an explanatory illustration showing an example of AR content according to the current weather.

[0175] In the example in Fig. In step 14, the AR content corresponding to the current weather is displayed as the background of the conveyor belt or similar. In the example in Fig. 14 depicts the current weather as weather in which part of the blue sky is cloudy.

[0176] The display data output unit 13 receives the acquisition data from the acquisition data acquisition unit 11.

[0177] In addition, the display data output unit 13 receives from the AR content generation unit 12 the AR content corresponding to the work execution status and the AR content corresponding to the current weather.

[0178] The display data output unit 13 overlays the display data, which represents the individual types of AR content, with the image capture data, i.e. the acquisition data.

[0179] When the display data is overlaid on the image capture data, the display data output unit 13 overlays the display data on the image capture data in such a way that the execution status of the work performed by an operator is not obscured by either type of AR content.

[0180] As in Fig. As shown in Figure 14, the display data output unit 13 overlays the image acquisition data with the display data so that the products transported on the conveyor belt are not obscured by the AR content.

[0181] The display data output unit 13 outputs the image acquisition data to a display device 3 after the display data has been superimposed.

[0182] The display device 3 acquires the image acquisition data after the display data from the display data output unit 13 is superimposed onto the work support device 2.

[0183] The display device 3 displays the AR content based on the image capture data after the display data has been superimposed.

[0184] For example, the in Fig. 14 AR content is displayed on the display device 3.

[0185] In the fifth embodiment described above, the work support device 2 is configured such that the AR content generation unit 12 generates AR content according to the work's progress and additionally AR content according to the current weather. Accordingly, the work support device 2 allows the operator to check the work's progress and also monitor the current weather. Sixth embodiment.

[0186] In a work support device 2, which is described in a sixth embodiment, an AR content generation unit 12 generates AR content corresponding to the execution status of the work, and additionally AR content corresponding to the cleaning status in the facility where the work is performed.

[0187] Fig. Figure 15 is a configuration diagram showing a work support system including the work support device 2 according to the sixth embodiment. Reference numerals in Fig. 15, who are with those in Fig. 1. "Identical" refers to identical or equivalent parts. Therefore, a detailed description of these is omitted.

[0188] Fig. Figure 16 is a hardware configuration diagram showing the hardware of the work support device 2 according to the sixth embodiment. Reference numerals in Fig. 16, who are with those in Fig. The terms "2" and "identical" refer to identical or equivalent parts. Therefore, a detailed description of these parts is omitted.

[0189] The in Fig. The work support system shown in Figure 15 comprises a sensor 1, a camera 4, the work support device 2 and a display device 3.

[0190] Camera 4 captures an image within the facility where the work is performed and outputs data from the captured image to the work support device 2. Examples of image capture locations within the facility include the area around the conveyor belt and the facility's entrance / exit.

[0191] For example, an AR content generation unit 14 is implemented by an AR content generation circuit 24, which is located in Fig. 16 is shown.

[0192] The AR content generation unit 14 acquires capture data from a capture data acquisition unit 11 and acquires the data of the image captured in the facility from camera 4.

[0193] Similar to the ones in Fig. The AR content generation unit 12 shown generates the AR content generation unit 14 based on the capture data, which corresponds to the execution status of the work.

[0194] The AR content generation unit 14 uses the data from the image captured in the facility to determine whether or not trash has accumulated in the facility.

[0195] The AR content generation unit 14 generates the AR content according to the cleaning status in the facility where the work is being performed.

[0196] When trash has accumulated in the facility, the AR content generation unit creates 14 AR content items that represent the cleaning status in the facility where the work is being performed.

[0197] The AR content generation unit 14 outputs display data to a display data output unit 13, representing the AR content according to the execution status of the work, and display data representing the AR content according to the cleaning status in the facility.

[0198] In Fig. 15 It is assumed that the data acquisition unit 11, the AR content generation unit 14 and the display data output unit 13, which are components of the work support device 2, are implemented by special hardware that is in Fig. Figure 16 is shown. That is, it is assumed that the work support device 2 is implemented by a data acquisition circuit 21, an AR content generation circuit 24 and a display data output circuit 23.

[0199] For example, each of the data acquisition circuit 21, the AR content generation circuit 24 and the display data output circuit 23 corresponds to a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA or a combination of these.

[0200] The components of the work support device 2 are not limited to those implemented by special hardware, but the work support device 2 can also be implemented by software, firmware or a combination of software and firmware.

[0201] In a case where the work support device 2 is implemented by software, firmware or the like, a program that causes a computer to execute a processing procedure performed at each of the data acquisition unit 11, the AR content generation unit 14 and the display data output unit 13 is in a Fig. 31 is stored in the memory 31 shown in 3. Subsequently, a [unclear] leads to Fig. 3. The processor 32 shown executes the programs stored in memory 31.

[0202] Furthermore, it illustrates Fig. 16 an example in which each of the constituent elements of the work support device 2 is implemented by dedicated hardware, and Fig. Figure 3 illustrates an example where the work support device 2 is implemented by software, firmware, or the like. However, this is only an example. Some components of the work support device 2 may be implemented by special hardware, while the remaining components may be implemented by software, firmware, or the like.

[0203] The following are the items from the in Fig. The processes carried out in the work support system shown in Figure 15 are explained. It should be noted that, according to the sixth embodiment, the work support system, with the exception of camera 4 and the AR content generation unit 14, is identical to the one shown in Figure 15. Fig. The work support system shown in Figure 1 is similar. For this reason, the processes performed by camera 4 and AR content generation unit 14 are mainly explained here.

[0204] Camera 4 captures an image in the facility where the work is performed and outputs data of the image captured in the facility to the work support device 2.

[0205] The AR content generation unit 14 acquires the capture data from the capture data acquisition unit 11.

[0206] Similar to the ones in Fig. The AR content generation unit 12 shown generates the AR content generation unit 14 based on the capture data, which corresponds to the execution status of the work.

[0207] The AR content generation unit 14 captures the data of the image taken in the facility by camera 4.

[0208] The AR content generation unit 14 uses the data from the image captured in the facility to determine whether or not trash has accumulated in the facility.

[0209] The following section explains in more detail a determination process carried out by the AR content generation unit 14.

[0210] For example, the AR content generation unit 14 captures data from an image taken around the conveyor belt by camera 4 as data from the image recorded in the system.

[0211] An image depicting the environment of the conveyor belt when no waste has accumulated around the conveyor belt is stored in an internal memory of the AR Content Generation Unit 14 or the like.

[0212] The AR content generation unit 14 compares the image represented by the data from the image captured around the conveyor belt with the image that represents the environment of the conveyor belt when no waste has accumulated.

[0213] If the similarity between the two images is equal to or greater than a threshold, the AR content generation unit 14 determines that no trash has accumulated around the conveyor belt.

[0214] If the similarity between the two images is less than the threshold, the AR content generation unit 14 detects that waste has accumulated around the conveyor belt. The threshold can be stored in the internal memory of the AR content generation unit 14 or specified from outside the work support device 2.

[0215] If trash has accumulated in the facility, the AR content generation unit creates 14 AR content items that represent the accumulated trash as a cleaning status in the facility where the work is being performed, such as in Fig. Figure 17 is shown. Since the process of generating AR content that represents the accumulated trash is a known technology, a detailed explanation is omitted.

[0216] Fig. Figure 17 is an explanatory illustration that provides an example of the AR content showing that trash has accumulated.

[0217] If no trash has accumulated in the facility, the AR content generation unit creates 14 AR content items that represent the cleaning status of the facility where the work is being performed, indicating that no trash has accumulated. Examples of AR content indicating that no trash has accumulated include the message "no trash".

[0218] This assumes that AR content generation unit 14 generates AR content representing that no trash has accumulated. However, this is only an example. If no trash has accumulated in the facility, AR content generation unit 14 cannot generate AR content reflecting the facility's cleaning status.

[0219] The AR content generation unit 14 outputs the display data representing the AR content corresponding to the execution status of the work to the display data output unit 13.

[0220] When the AR content generation unit 14 has generated the AR content according to the cleaning status in the facility, the AR content generation unit 14 outputs display data representing the AR content to the display data output unit 13.

[0221] The display data output unit 13 receives the acquisition data from the acquisition data acquisition unit 11.

[0222] Furthermore, the display data output unit 13 receives the AR content corresponding to the work execution status from the AR content generation unit 14. When the AR content corresponding to the cleaning status in the facility is output by the AR content generation unit 14, the display data output unit 13 receives the AR content.

[0223] The display data output unit 13 overlays the display data, which represents the individual types of AR content, with the image capture data, i.e. the acquisition data.

[0224] When the display data is overlaid on the image capture data, the display data output unit 13 overlays the display data on the image capture data in such a way that the execution status of the work performed by an operator is not obscured by either type of AR content.

[0225] As in Fig. As shown in Figure 17, the display data output unit 13 overlays the image acquisition data with the display data so that the products transported on the conveyor belt are not obscured by the AR content.

[0226] The display data output unit 13 outputs the image acquisition data to the display device 3 after the display data has been superimposed.

[0227] The display device 3 acquires the image acquisition data after the display data from the display data output unit 13 is superimposed onto the work support device 2.

[0228] The display device 3 displays the AR content based on the image capture data after the display data has been superimposed.

[0229] For example, the in Fig. 17 AR content is displayed on the display device 3.

[0230] The work support device 2 in the sixth embodiment mentioned above is configured such that the AR content generation unit 12 generates the AR content according to the execution status of the work and additionally generates the AR content according to the cleaning status in the facility where the work is performed. Accordingly, the work support device 2 enables the operator to check the execution status of the work and additionally to monitor the cleaning status in the facility. Seventh embodiment.

[0231] In a work support device 2, which is described in a seventh embodiment, an AR content generation unit generates 15 AR contents corresponding to the execution status of the work and additionally generates AR contents representing a mascot character that guides the execution content of the work.

[0232] Fig. Figure 18 is a configuration diagram showing a work support system including the work support device 2 according to the seventh embodiment. Reference numerals in Fig. 18, who are with those in Fig. 1 and Fig. The terms "15" and "identical" refer to identical or equivalent parts. Therefore, a detailed description of these parts is omitted.

[0233] Fig. Figure 19 is a hardware configuration diagram showing the hardware of the work support device 2 according to the seventh embodiment. Reference numerals in Fig. 19, who are with those in Fig. 2 and Fig. The terms "16" and "identical" refer to identical or equivalent parts. Therefore, a detailed description of these parts is omitted.

[0234] The AR content generation unit 15 is implemented, for example, by an AR content generation circuit 25, which is located in Fig. 19 is shown.

[0235] The AR content generation unit 15 captures capture data from a capture data acquisition unit 11 and acquires work information that represents the execution content of the work.

[0236] Similar to the ones in Fig. The AR content generation unit 12 shown generates the AR content generation unit 15 based on the capture data, which corresponds to the execution status of the work.

[0237] Based on the work information, the AR content generation unit 15 captures the execution content of the work performed by an operator.

[0238] The AR content generation unit 15 generates the AR content that represents the mascot character that guides the execution content of the work.

[0239] The AR content generation unit 15 outputs display data to a display data output unit 13, representing the AR content according to the execution status of the work, as well as display data of the AR content representing the mascot figure.

[0240] The in Fig. The work support device 2 shown in Figure 18 is created by applying the AR content generation unit 15 to the area shown in Figure 18. Fig. 1. The work support device 2 shown is obtained. However, this is only an example. The in Fig. The work support device 2 shown in Figure 18 can be used by applying the AR content generation unit 15 to the area shown in Figure 18. Fig. 15. Work support device 2 shown will be obtained.

[0241] In Fig. 18 It is assumed that the data acquisition unit 11, the AR content generation unit 15 and the display data output unit 13, which are components of the work support device 2, are implemented by special hardware that is in Fig. Figure 19 is shown. That is, it is assumed that the work support device 2 is implemented by a data acquisition circuit 21, the AR content generation circuit 25 and a display data output circuit 23.

[0242] For example, each of the data acquisition circuit 21, AR content generation circuit 25 and display data output circuit 23 corresponds to a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA or a combination of these.

[0243] The components of the work support device 2 are not limited to those implemented by special hardware, but the work support device 2 can also be implemented by software, firmware or a combination of software and firmware.

[0244] In a case where the work support device 2 is implemented by software, firmware or the like, a program that causes a computer to execute a processing procedure performed at each of the data acquisition unit 11, the AR content generation unit 15 and the display data output unit 13 is in a Fig. 31 is stored in the memory 31 shown in 3. Subsequently, a [unclear] leads to Fig. 3. The processor 32 shown executes the programs stored in memory 31.

[0245] Furthermore, it illustrates Fig. 19 an example in which each of the constituent elements of the work support device 2 is implemented by dedicated hardware, and Fig. Figure 3 illustrates an example where the work support device 2 is implemented by software, firmware, or the like. However, this is only an example. Some components of the work support device 2 may be implemented by special hardware, while the remaining components may be implemented by software, firmware, or the like.

[0246] The following are the items from the in Fig. The processes carried out in the work support system shown in Figure 18 are explained. It should be noted that, according to the seventh embodiment, the work support system, with the exception of the AR content generation unit 15, is identical to the one shown in Figure 18. Fig. The work support system shown in Figure 1 is similar. For this reason, the processes performed by the AR content generation unit 15 are mainly explained here.

[0247] The AR content generation unit 15 captures the capture data from the capture data acquisition unit 11 and acquires the work information that represents the execution content of the work.

[0248] Similar to the ones in Fig. The AR content generation unit 12 shown generates the AR content generation unit 15 based on the capture data, which corresponds to the execution status of the work.

[0249] Based on the work information, the AR content generation unit 15 captures the execution content of the work performed by the operator.

[0250] As in Fig. As shown in Figure 20, the AR content generation unit 15 generates the AR content, which represents the mascot figure that guides the execution content of the work.

[0251] Fig. Figure 20 is an explanatory illustration that provides an example of the AR content representing the mascot character that guides the execution content of the work.

[0252] Fig. Figure 20 shows an example where the execution content of the work is "remove lid in green frame".

[0253] The AR content generation unit 15 outputs display data to the display data output unit 13, representing the AR content according to the execution status of the work, as well as display data of the AR content representing the mascot character.

[0254] The display data output unit 13 receives the acquisition data from the acquisition data acquisition unit 11.

[0255] In addition, the display data output unit 13 receives from the AR content generation unit 15 the AR content corresponding to the execution status of the work and the AR content representing the mascot figure.

[0256] The display data output unit 13 overlays the display data, which represents the individual types of AR content, with the image capture data, i.e. the acquisition data.

[0257] When overlaying the display data on the image capture data, the display data output unit 13 places the display data on top of the image capture data in such a way that the execution status of the work performed by the operator is not obscured by the individual types of AR content.

[0258] As in Fig. As shown in Figure 20, the display data output unit 13 overlays the image acquisition data with the display data so that the products transported on the conveyor belt are not obscured by the AR content.

[0259] The display data output unit 13 outputs the image acquisition data to a display device 3 after the display data has been superimposed.

[0260] The display device 3 acquires the image acquisition data after the display data from the display data output unit 13 is superimposed onto the work support device 2.

[0261] The display device 3 displays the AR content based on the image capture data after the display data has been superimposed.

[0262] For example, the in Fig. 20 AR content is displayed on the display device 3.

[0263] In the seventh embodiment mentioned above, the work support device 2 is configured such that the AR content generation unit 15 generates the AR content corresponding to the execution status of the work and additionally generates the AR content representing the mascot figure that guides the execution content of the work. Accordingly, the work support device 2 enables the operator to check the execution status of the work and additionally allows him to check the execution content of the work.

[0264] In the Fig. In the work support device 2 shown in Figure 18, the AR content generation unit 15 generates the AR content representing the mascot figure that guides the execution of the work. At this point, the AR content generation unit 15 can adjust the work speed, represented by the execution content guided by the mascot figure, depending on the operator's skills or physical condition.

[0265] Assuming that the execution content of the work is the "work of tightening a screw," then the AR content generation unit 15 adjusts the work speed of the "work of tightening a screw," which is an execution content, depending on the operator's skill or physical condition. That is, for example, the AR content generation unit 15 sets an instruction "Tighten screw in ○○ seconds" for execution content where the work speed of tightening a screw increases with increasing operator skill. Furthermore, the AR content generation unit 15 sets an instruction "Tighten screw in approximately Δ minutes" for execution content where the work speed of tightening a screw decreases if the operator's physical condition is poor.

[0266] For example, AR Content Generation Unit 15 gives a non-illustrated learning model one of the operator's skills or the operator's physical condition in order to extract speed information from the learning model that represents an operating speed corresponding to one of the operator's skills or the operator's physical condition.

[0267] The learning model learned the working speed that corresponds to the operator's ability or physical condition, based on training data representing the working speed at the time of training.

[0268] The AR content generation unit 15 generates the AR content, which represents the mascot character that guides the execution content for performing the work at a working speed represented by speed information.

[0269] In the Fig. The work support device 2 shown in Figure 18 generates AR content by the AR content generation unit 15, which represents a mascot character, based on a bear as the AR content that represents the mascot character that guides the execution content of the work. However, this is only an example. Before generating the AR content that represents the mascot character that guides the execution content of the work, the AR content generation unit 15 can accept the selection of the AR content that represents a mascot character to be generated.

[0270] Specifically, the AR content generation unit 15 includes, for example, a user interface, and when a user operates the user interface to select AR content that represents a mascot character to be generated, the AR content generation unit 15 generates the AR content that represents the mascot character. Eighth embodiment.

[0271] In a work support device 2 described in an eighth embodiment, an AR content generation unit 16 generates AR content corresponding to the execution status of the work and additionally generates AR content representing the operations performed by a specialist for the work.

[0272] Fig. Figure 21 is a configuration diagram showing a work support system including the work support device 2 according to the eighth embodiment. Reference numerals in Fig. 21, who are with those in Fig. 1, Fig. 15 and Fig. The terms "18" and "identical" refer to identical or equivalent parts. Therefore, a detailed description of these parts is omitted.

[0273] Fig. Figure 22 is a hardware configuration diagram showing the hardware of the work support device 2 according to the eighth embodiment. Reference numerals in Fig. 22, who are with those in Fig. 2, Fig. 16 and Fig. The terms "19" and "identical" refer to identical or equivalent parts. Therefore, a detailed description of these parts is omitted.

[0274] The AR content generation unit 16 is implemented, for example, by an AR content generation circuit 26, which is located in Fig. 22 is shown.

[0275] The AR content generation unit 16 captures capture data from a capture data acquisition unit 11 and captures process information that represents the operations performed by the specialist for the work performed by an operator.

[0276] Similar to the ones in Fig. The AR content generation unit 12 shown generates the AR content generation unit 16 based on the capture data, which corresponds to the execution status of the work.

[0277] The AR content generation unit 16 records the processes performed by the skilled worker based on the process information.

[0278] The AR content generation unit 16 generates AR content that represents the activities performed by the specialist.

[0279] The AR content generation unit 16 outputs display data to a display data output unit 13, representing the AR content that corresponds to the execution status of the work, as well as display data of the AR content that represents the operations carried out by the specialist.

[0280] The in Fig. The work support device 2 shown in 21 is created by applying the AR content generation unit 16 to the area shown in Fig. 1. The work support device 2 shown is obtained. However, this is only an example. The in Fig. The work support device 2 shown in Figure 21 can be used by applying the AR content generation unit 16 to the area shown in Figure 21. Fig. 15 shown work support device 2 or the one in Fig. 18. Work support device 2 shown will be obtained.

[0281] In Fig. 21 It is assumed that the data acquisition unit 11, the AR content generation unit 16 and the display data output unit 13, which are components of the work support device 2, are implemented by special hardware that is in Fig. 22 is shown. That is, it is assumed that the work support device 2 is implemented by a data acquisition circuit 21, an AR content generation circuit 26 and a display data output circuit 23.

[0282] For example, each of the data acquisition circuit 21, AR content generation circuit 26 and display data output circuit 23 corresponds to a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA or a combination of these.

[0283] The components of the work support device 2 are not limited to those implemented by special hardware, but the work support device 2 can also be implemented by software, firmware or a combination of software and firmware.

[0284] In a case where the work support device 2 is implemented by software, firmware or the like, a program that causes a computer to execute a processing procedure performed at each of the data acquisition unit 11, the AR content generation unit 16 and the display data output unit 13 is in a Fig. 31 is stored in the memory 31 shown in 3. Subsequently, a [unclear] leads to Fig. 3. The processor 32 shown executes the programs stored in memory 31.

[0285] Furthermore, it illustrates Fig. 22 an example in which each of the constituent elements of the work support device 2 is implemented by dedicated hardware, and Fig. Figure 3 illustrates an example where the work support device 2 is implemented by software, firmware, or the like. However, this is only an example. Some components of the work support device 2 may be implemented by special hardware, while the remaining components may be implemented by software, firmware, or the like.

[0286] The following are the items from the in Fig. The processes carried out in the work support system shown in Figure 21 are explained. It should be noted that, according to the eighth embodiment, the work support system, with the exception of the AR content generation unit 16, is identical to the one shown in Figure 21. Fig. The work support system shown in Figure 1 is similar. For this reason, the processes performed by the AR content generation unit 16 are mainly explained here.

[0287] The AR content generation unit 16 captures the capture data from the capture data acquisition unit 11 and captures process information that represents the processes performed by the specialist for the work performed by the operator.

[0288] Examples of the activities performed by the specialist include, for example, a flow line at the time the work was performed by the specialist and the type of physical movement at the time the work was performed by the specialist.

[0289] Similar to the ones in Fig. The AR content generation unit 12 shown generates the AR content generation unit 16 based on the capture data, which corresponds to the execution status of the work.

[0290] The AR content generation unit 16 captures the operations performed by the skilled worker based on the operation information. For example, if the operation information represents a flow line at the time the skilled worker performs the work, the AR content generation unit 16 captures the flow line at the time of the work. Similarly, if the operation information represents the type of physical movement at the time of the work, the AR content generation unit 16 captures the type of physical movement at the time of the work.

[0291] As in Fig. As shown in 23, the AR content generation unit 16 generates the AR content that represents the activities performed by the specialist.

[0292] Fig. 23 is an explanatory illustration that provides an example of the AR content representing the activities performed by the specialist.

[0293] Fig. 23 shows AR content that represents a flow line at the time of work performed by a skilled worker, rather than AR content that represents the activities performed by the skilled worker.

[0294] The AR content generation unit 16 outputs display data to the display data output unit 13, representing the AR content that corresponds to the execution status of the work, as well as display data of the AR content that represents the operations carried out by the specialist.

[0295] The display data output unit 13 receives the acquisition data from the acquisition data acquisition unit 11.

[0296] In addition, the display data output unit 13 receives from the AR content generation unit 16 the AR content that corresponds to the execution status of the work and the AR content that represents the activities performed by the specialist.

[0297] The display data output unit 13 overlays the display data, which represents the individual types of AR content, with the image capture data, i.e. the acquisition data.

[0298] When overlaying the display data on the image capture data, the display data output unit 13 places the display data on top of the image capture data in such a way that the execution status of the work performed by the operator is not obscured by the individual types of AR content.

[0299] As in Fig. As shown in Figure 23, the display data output unit 13 overlays the image acquisition data with the display data so that the products transported on the conveyor belt are not obscured by the AR content.

[0300] The display data output unit 13 outputs the image acquisition data to a display device 3 after the display data has been superimposed.

[0301] The display device 3 acquires the image acquisition data after the display data from the display data output unit 13 is superimposed onto the work support device 2.

[0302] The display device 3 displays the AR content based on the image capture data after the display data has been superimposed.

[0303] For example, the in Fig. 23 AR content is displayed on the display device 3.

[0304] In the eighth embodiment mentioned above, the work support device 2 is configured such that the AR content generation unit 16 generates the AR content corresponding to the execution status of the work and, in addition, generates the AR content representing the activities performed by the specialist for the work. Accordingly, the work support device 2 enables the operator to check the execution status of the work and, furthermore, allows him to monitor the activities performed by the specialist.

[0305] It should be noted that the present disclosure permits any combination of embodiments, modifications of components of the embodiments, or the omission of components of the embodiments. COMMERCIAL APPLICABILITY

[0306] The present disclosure is suitable for a work support device, a work support method and a work support system. REFERENCE MARK LIST

[0307] 1: Sensor; 2: Work support device; 3: Display device; 4: Camera; 11: Capture data acquisition unit; 12, 14, 15, 16: AR content generation unit; 13: Display data output unit; 21: Capture data acquisition circuit; 22, 24, 25, 26: AR content generation circuit; 23: Display data output circuit; 31: Memory; 32: Processor QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] JP-2013-86959-A

[0005]

Claims

Work support device comprising: a data acquisition unit for acquiring data representing the performance status of work performed by an operator from a sensor to monitor the performance status of the work; an augmented reality (AR) content generation unit for generating AR content corresponding to the performance status of the work based on the data acquired by the data acquisition unit; and a display data output unit for outputting display data representing the AR content generated by the AR content generation unit. Work support device according to claim 1, wherein the sensor is an image acquisition sensor to capture an image of the execution status of the work, the data acquisition unit captures image acquisition data representing the execution status of the work, image acquisition data representing an image acquisition result of the image acquisition sensor, and the display data output unit overlays the captured image data with display data representing the AR content generated by the AR content generation unit and outputs the image acquisition data after overlaying the display data. Work support device according to claim 2, wherein the display data output unit overlays the display data representing the AR content onto the image acquisition data in such a way that the execution status of the work performed by the operator is not obscured by the AR content generated by the AR content generation unit. Work support device according to claim 1, wherein the AR content generation unit accepts a selection of AR content to be generated before generating the AR content according to the execution status of the work. Work support device according to claim 1, wherein the AR content generation unit calculates a completion rate of the work performed by the operator as the execution status of the work based on the capture data acquired by the capture data acquisition unit and generates the AR content according to the completion rate of the work. Work support device according to claim 1, wherein the AR content generation unit generates the AR content corresponding to a current season as the AR content corresponding to the execution status of the work. Work support device according to claim 1, wherein the AR content generation unit generates the AR content according to the execution status of the work and additionally generates the AR content according to a current time. Work support device according to claim 1, wherein the AR content generation unit generates the AR content according to the execution status of the work and additionally generates the AR content according to a current season. Work support device according to claim 1, wherein the AR content generation unit generates the AR content according to the execution status of the work and additionally generates the AR content according to the execution time of the work. Work support device according to claim 1, wherein the AR content generation unit generates the AR content according to the execution status of the work and additionally generates the AR content according to the current weather. Work support device according to claim 1, wherein the AR content generation unit generates the AR content corresponding to the execution status of the work and additionally generates the AR content corresponding to a cleaning status in a facility in which the work is performed. Work support device according to claim 1, wherein the AR content generation unit generates the AR content corresponding to the execution status of the work and additionally generates the AR content representing a mascot figure that guides the execution content of the work. Work support device according to claim 12, wherein the AR content generation unit adjusts a working speed, represented by the execution content guided by the mascot figure, depending on the operator's ability or physical condition. Work support device according to claim 1, wherein the AR content generation unit generates the AR content corresponding to the execution status of the work and additionally generates the AR content representing an operation performed by a skilled worker for the work. Work support methods, comprising: acquiring capture data representing the execution status of work performed by an operator from a sensor to monitor the execution status of the work, by a capture data acquisition unit; generating AR content corresponding to the execution status of the work, based on the capture data acquired by the capture data acquisition unit, by an augmented reality (AR) content generation unit; and outputting display data representing the AR content generated by the AR content generation unit, by a display data output unit. Work support system comprising: a sensor for monitoring the execution status of work performed by an operator; a data acquisition unit for acquiring data representing the execution status of the work from the sensor; an augmented reality (AR) content generation unit for generating AR content corresponding to the execution status of the work based on the data acquired by the data acquisition unit; a display data output unit for outputting display data representing the AR content generated by the AR content generation unit; and a display device for displaying the AR content based on the display data output by the display data output unit.

Images