Work support device, work support method, and work support system
The work support device addresses the challenge of monitoring work progress by using a sensing data acquisition unit, AR content generation unit, and display data output unit to provide operators with visual feedback on work status through Augmented Reality, enhancing their ability to assess and engage with their work.
Patent Information
- Application Number
- JP2024526467
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-10-12
- Publication Date
- 2025-05-23
- Estimated Expiration
- 2043-10-12
AI Technical Summary
Existing work support devices, such as the fork positioning support device, do not allow operators to effectively monitor the progress of pallet conveying work, limiting their ability to assess the actual situation of the work in progress.
A work support device that includes a sensing data acquisition unit to gather data from sensors monitoring the work status, an AR content generation unit to create Augmented Reality content based on this data, and a display data output unit to provide the AR content to a display device, allowing operators to visualize the work progress.
Enables operators to accurately check the progress of work, maintain concentration, and enhance their sense of accomplishment, while also providing a means to encourage a positive work environment through dynamic AR content.
Smart Images

Figure 0007682390000001 
Figure 0007682390000002 
Figure 0007682390000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to a work support device, a work support method, and a work support system.
Background Art
[0002] There is a work support device that supports work by an operator. As such a work support device, for example, Patent Document 1 discloses a fork positioning support device including a camera and an image display unit. The camera captures an image in front of the forklift and outputs image data showing the front image to the image display unit. The front imaging area by the camera is an area including a pallet carried by the forklift and the forks of the forklift. The image display unit displays the image shown by the image data output from the camera on the display.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In the fork positioning support device disclosed in Patent Document 1, although an operator driving the forklift can check the relative position between the pallet and the forks by looking at the display, there is a problem that it is impossible to check to what extent the pallet conveying work has progressed as the actual situation of the pallet conveying work.
[0005] The present disclosure has been made to solve the above problems, and an object thereof is to obtain a work support device that allows an operator to check the actual situation of the work.
Means for Solving the Problems
[0006] The work assistance device according to the present disclosure includes a sensing data acquisition unit that acquires sensing data indicating the status of work being performed from a sensor that monitors the status of work being performed by a worker, an AR content generation unit that generates AR (Augmented Reality) content corresponding to the status of work being performed based on the sensing data acquired by the sensing data acquisition unit, and a display data output unit that outputs display data indicating the AR content generated by the AR content generation unit. Effect of the Invention
[0007] According to the present disclosure, a worker can check the progress of work. [Brief description of the drawings]
[0008] [Figure 1] 1 is a configuration diagram showing a work support system including a work support device 2 according to a first embodiment. [Diagram 2] 1 is a hardware configuration diagram showing hardware of a work support device 2 according to a first embodiment. [Diagram 3] FIG. 1 is a hardware configuration diagram of a computer in the case where the work support device 2 is realized by software, firmware, or the like. [Figure 4] 4 is a flowchart showing a work supporting method which is a processing procedure of the work supporting device 2. [Diagram 5] FIG. 2 is an explanatory diagram showing products being transported by a belt conveyor. [Figure 6] FIG. 11 is an explanatory diagram showing an example of AR content corresponding to a task completion rate Acr. [Figure 7] FIG. 11 is an explanatory diagram showing an example of AR content corresponding to a task completion rate Acr. [Figure 8] FIG. 11 is an explanatory diagram showing an example of AR content corresponding to a task completion rate Acr. [Figure 9] FIG. 11 is an explanatory diagram showing an example of AR content corresponding to a task completion rate Acr. [Figure 10] 11 is an explanatory diagram showing an example of AR content indicating that the current time is within working hours. FIG. [Figure 11] FIG. 13 is an explanatory diagram showing an example of AR content indicating that the current time is within a break time. [Figure 12] FIG. 11 is an explanatory diagram showing AR content reminiscent of summer as an example of AR content corresponding to the current season. [Figure 13] FIG. 11 is an explanatory diagram showing an example of AR content corresponding to an execution time of an operation. [Figure 14] FIG. 11 is an explanatory diagram showing an example of AR content corresponding to the current weather. [Figure 15] FIG. 13 is a configuration diagram showing a work support system including a work support device 2 according to a sixth embodiment. [Figure 16] FIG. 13 is a hardware configuration diagram showing hardware of a work support device 2 according to a sixth embodiment. [Figure 17] FIG. 11 is an explanatory diagram showing an example of AR content indicating that dust has accumulated; [Figure 18] FIG. 13 is a configuration diagram showing a work support system including a work support device 2 according to a seventh embodiment. [Figure 19] FIG. 13 is a hardware configuration diagram showing hardware of a work support device 2 according to a seventh embodiment. [Figure 20] FIG. 11 is an explanatory diagram illustrating an example of AR content showing a character providing guidance on the content of work to be performed. [Figure 21] FIG. 13 is a configuration diagram showing a work support system including a work support device 2 according to an eighth embodiment. [Figure 22] FIG. 23 is a hardware configuration diagram showing hardware of a work support device 2 according to an eighth embodiment. [Diagram 23] FIG. 11 is an explanatory diagram showing an example of AR content showing the actions of a skilled craftsman. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] In order to describe the present disclosure in more detail, embodiments of the present disclosure will be described below with reference to the accompanying drawings.
[0010] Embodiment 1 FIG. 1 is a configuration diagram showing a work support system including a work support device 2 according to the first embodiment. FIG. 2 is a hardware configuration diagram showing the hardware of the work support device 2 according to the first embodiment. The work support system shown in FIG. 1 includes a sensor 1, a work support device 2, and a display device 3.
[0011] The sensor 1 is for example realized by a camera or a lidar device. The sensor 1 monitors the status of work being performed by a worker, and outputs sensing data indicating the status of work being performed to the work support device 2. The camera and the lidar device are each an imaging sensor that captures an image of the work being performed. In particular, the lidar device is a device that can irradiate a target object with a laser beam, receive the reflected light of the laser beam from the target object, and detect the shape of the target object based on the reflected light.
[0012] Examples of tasks performed by workers include a task of a worker receiving products transported by a conveyer belt, a task of sorting products transported by a conveyer belt, a task of a worker assembling products, a task of a worker assembling products by operating a robot, a task of a worker judging the quality of a product, a task of a worker judging the quality of a product by operating a robot, and a task of a worker transporting pallets by operating a forklift.
[0013] The status of work execution may be, for example, the completion rate of the work by the worker, the number of times the work is completed by the worker, the number of days the work is performed by the worker, the progress of the work by the worker, or the accuracy of the work by the worker. For example, if the task performed by the worker is a task of the worker receiving products, the completion rate of the task may be, for example, the ratio of the number of products received up to the current time to the target number of products received. Also, the number of times the task has been completed may be, for example, the number of products received up to the current time. For example, if the task performed by a worker is transporting pallets, the task completion rate may be the ratio of the number of pallet transports made up to the current time to the target number of pallet transports, and the number of times the task has been completed may be the number of pallet transports made up to the current time. For example, if the work performed by a worker is the work of assembling a product, the progress of the work may indicate, for example, the work elements that have been performed out of the multiple work elements required from the start of product assembly to the completion of the product.
[0014] The work support device 2 includes a sensing data acquisition unit 11, an AR content generation unit 12, and a display data output unit 13. The work support apparatus 2 generates AR (Augmented Reality) content corresponding to the progress of the work, and outputs display data indicating the AR content to the display device 3.
[0015] The display device 3 is realized by, for example, AR glasses, a tablet, or a smartphone. The display device 3 displays the AR content in accordance with the display data output from the work support device 2.
[0016] The sensing data acquiring unit 11 is realized by, for example, a sensing data acquiring circuit 21 shown in FIG. The sensing data acquisition unit 11 acquires sensing data indicating the implementation status of the work from the sensor 1. If the sensor 1 is an imaging sensor that captures the implementation status of the work, the sensing data acquisition unit 11 acquires imaging data indicating the imaging result of the imaging sensor as sensing data indicating the implementation status of the work. The sensing data acquisition unit 11 outputs the sensing data to the AR content generation unit 12 and the display data output unit 13, respectively.
[0017] The AR content generation unit 12 is realized by, for example, an AR content generation circuit 22 shown in FIG. The AR content generation unit 12 acquires the sensing data from the sensing data acquisition unit 11. The AR content generator 12 generates AR content corresponding to the progress of the work based on the sensing data. The AR content generation unit 12 outputs display data indicating the AR content to the display data output unit 13.
[0018] The display data output unit 13 is realized by, for example, a display data output circuit 23 shown in FIG. The display data output unit 13 acquires the sensing data from the sensing data acquisition unit 11, and acquires the display data indicating the AR content from the AR content generation unit 12. If the display device 3 is, for example, AR glasses and a worker wearing the AR glasses can view the status of work being performed with the naked eye through the AR glasses, the display data output unit 13 acquires only the display data indicating the AR content and outputs the display data to the display device 3.
[0019] If the worker wearing the AR glasses cannot see the progress of the work with the naked eye through the AR glasses, the display data output unit 13 acquires both the display data indicating the AR content and the sensing data. Even when the display device 3 is, for example, a tablet or a smartphone, the display data output unit 13 acquires both the display data indicating the AR content and the sensing data. The display data output unit 13 superimposes display data indicating the AR content on the imaging data, which is the sensing data, and outputs the imaging data after the display data has been superimposed to the display device 3.
[0020] 1, it is assumed that each of the components of the work support device 2, that is, a sensing data acquisition unit 11, an AR content generation unit 12, and a display data output unit 13, is realized by dedicated hardware as shown in Fig. 2. That is, it is assumed that the work support device 2 is realized by a sensing data acquisition circuit 21, an AR content generation circuit 22, and a display data output circuit 23. Each of the sensing data acquisition circuit 21, the AR content generation circuit 22, and the display data output circuit 23 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination of these.
[0021] The components of the work support device 2 are not limited to those realized by dedicated hardware, and the work support device 2 may be realized by software, firmware, or a combination of software and firmware. The software or firmware is stored as a program in the memory of a computer. The computer means hardware that executes the program, and includes, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a processor, or a DSP (Digital Signal Processor).
[0022] FIG. 3 is a hardware configuration diagram of a computer in the case where the work support device 2 is realized by software, firmware, or the like. When the work support device 2 is realized by software, firmware, or the like, a program for causing a computer to execute the respective processing procedures of the sensing data acquisition unit 11, the AR content generation unit 12, and the display data output unit 13 is stored in the memory 31. Then, a processor 32 of the computer executes the program stored in the memory 31.
[0023] 2 shows an example in which each of the components of the work support device 2 is realized by dedicated hardware, and Fig. 3 shows an example in which the work support device 2 is realized by software, firmware, etc. However, this is merely an example, and some of the components in the work support device 2 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.
[0024] Next, the operation of the work support system shown in FIG. 1 will be described. FIG. 4 is a flowchart showing a work support method which is a processing procedure of the work support device 2. The sensor 1 is installed, for example, in a helmet worn by a worker, in AR glasses worn by a worker, or on a wall or ceiling of a factory which is a facility where the work is performed. The sensor 1 monitors the status of work being performed by a worker, and outputs sensing data indicating the status of work being performed to the work support device 2. FIG. 5 is an explanatory diagram showing products being transported by a belt conveyor. An example will be described below in which the task performed by a worker is to receive products transported by a belt conveyor. Although the worker is not shown in FIG. 5, it is assumed that the worker is standing, for example, on the side of the conveyor belt or near the end of the conveyor belt.
[0025] The sensing data acquisition unit 11 acquires sensing data indicating the progress of the work from the sensor 1 (step ST1 in FIG. 4). For ease of explanation, it is assumed here that the sensor 1 is an imaging sensor that captures images of the work being carried out, and the sensing data acquisition unit 11 acquires imaging data indicative of the imaging results of the imaging sensor as sensing data indicative of the work being carried out. The sensing data acquisition unit 11 outputs the sensing data to the AR content generation unit 12 and the display data output unit 13, respectively.
[0026] The AR content generation unit 12 acquires the sensing data from the sensing data acquisition unit 11. The AR content generator 12 generates AR content corresponding to the progress of the work based on the sensing data (step ST2 in FIG. 4). The AR content generation unit 12 outputs display data indicating the AR content to the display data output unit 13. The process of generating AR content by the AR content generator 12 will be specifically described below.
[0027] The AR content generation unit 12 counts the number of times that the worker receives the product transported by the belt conveyer based on the sensing data. The process of counting the number of times that the worker receives the product based on the imaging data, which is the sensing data, is a known technique, and therefore a detailed description thereof will be omitted. If the target number of products to be received is Enum and the number of products received by the worker is Tnum, the AR content generation unit 12 calculates the task completion rate Acr as shown in the following formula (1). Acr = (Tnum / Enum) x 100% The AR content generator 12 generates AR content corresponding to the task completion rate Acr as AR content corresponding to the task progress status. The AR content generation process itself is a known technique, and therefore a detailed description thereof will be omitted.
[0028] Each of FIG. 6, FIG. 7, and FIG. 8 is an explanatory diagram showing an example of AR content corresponding to the task completion rate Acr. 6, 7, and 8 each show an example in which the AR content corresponding to the task completion rate Acr is tulips. Here, the higher the task completion rate Acr, the more tulips bloom. Figure 6 shows an example where the task completion rate Acr is low, so the tulips have not bloomed at all. Figure 7 shows an example in which the tulips have bloomed slightly due to a slight increase in the task completion rate Acr. FIG. 8 shows an example where the tulips are almost in full bloom because the task completion rate Acr is approaching 100%.
[0029] Here, the AR content corresponding to the task implementation status shows tulips whose flowering rate changes according to the completion rate Acr. However, this is merely an example, and the AR content generator 12 may generate AR content indicating the task completion rate Acr as the AR content corresponding to the task implementation status, for example, as shown in FIG. FIG. 9 is an explanatory diagram showing an example of AR content corresponding to the task completion rate Acr. FIG. 9 shows AR content corresponding to the task completion rate Acr, in which a number indicating the task completion rate Acr is surrounded by flowers.
[0030] The display data output unit 13 acquires sensing data from the sensing data acquisition unit 11, and acquires display data indicating AR content from the AR content generation unit 12. The display data output unit 13 superimposes display data indicating the AR content on the imaging data, which is the sensing data. When the display data output unit 13 superimposes the display data on the imaging data, the display data output unit 13 superimposes the display data on the imaging data so that the status of the work being performed by the worker is not obscured by the AR content. That is, as shown in Figs. 6 to 9, the display data output unit 13 superimposes the display data on the imaging data so that the products being transported by the belt conveyer are not obscured by the AR content. The display data output unit 13 outputs the imaging data after the display data superimposition to the display device 3 (step ST3 in FIG. 4).
[0031] The display device 3 acquires the imaging data after the display data has been superimposed from the display data output unit 13 of the work support device 2. The display device 3 displays the AR content in accordance with the imaging data after the display data has been superimposed. As a result, the display device 3 displays AR content such as that shown in any one of FIGS.
[0032] In the above-described first embodiment, the work support device 2 is configured to include a sensing data acquisition unit 11 that acquires sensing data indicating the status of work from a sensor 1 that monitors the status of work being performed by a worker, an AR content generation unit 12 that generates AR content corresponding to the status of work being performed based on the sensing data acquired by the sensing data acquisition unit 11, and a display data output unit 13 that outputs display data indicating the AR content generated by the AR content generation unit 12. Therefore, the work support device 2 allows the worker to check the status of work being performed. In addition, by displaying AR content corresponding to the status of work being performed, the effect of maintaining the worker's concentration, the effect of increasing the worker's sense of accomplishment, or the effect of encouraging the worker to change his or her mood can be obtained.
[0033] In the first embodiment, the work support device 2 is configured so that the AR content generation unit 12 calculates the task completion rate of the worker as the task execution status based on the sensing data acquired by the sensing data acquisition unit 11, and generates AR content corresponding to the task completion rate. Therefore, the work support device 2 allows the worker to check the task completion rate.
[0034] 1, the AR content generation unit 12 generates tulips whose flowering rate changes according to the task completion rate Acr as AR content corresponding to the task execution status. However, this is merely an example, and the AR content generation unit 12 may accept selection of the AR content to be generated before generating the AR content corresponding to the task execution status. Specifically, the AR content generation unit 12 has, for example, a user interface, and when the user operates the user interface to select, as the AR content to be generated, for example, a tulip whose flowering rate changes according to the task completion rate Acr, as shown in Figures 6 to 8, the AR content generation unit 12 generates a tulip whose flowering rate changes according to the task completion rate Acr. When a user operates the user interface to select, as the AR content to be generated, for example, AR content in which a number indicating the achievement rate Acr is surrounded by flowers, as shown in FIG. 9, the AR content generation unit 12 generates AR content in which the number indicating the achievement rate Acr is surrounded by flowers.
[0035] Furthermore, the AR content generation unit 12 may obtain the current season from either an internal calendar or an external calendar, and switch the AR content corresponding to the implementation status of the work depending on the current season. If the current season is spring, the AR content generator 12 generates, as AR content corresponding to the progress status of the work, for example, tulips whose flowering rate changes according to the completion rate Acr of the work, as shown in Figs. If the current season is summer, the AR content generator 12 generates, as AR content corresponding to the progress status of the task, for example, cherry blossoms whose flowering rate changes according to the completion rate Acr of the task. If the current season is autumn, the AR content generator 12 generates, as AR content corresponding to the progress of the task, for example, autumn leaves whose color changes according to the completion rate Acr of the task. If the current season is winter, the AR content generator 12 generates, as AR content corresponding to the progress status of the work, for example, snowfall in which the amount of snowfall changes according to the completion rate Acr of the work.
[0036] 1, the AR content generator 12 generates AR content corresponding to the completion rate Acr of a task as AR content corresponding to the implementation status of the task. However, this is merely an example, and the AR content generator 12 may generate AR content corresponding to, for example, the number of times a task has been completed by a worker, the number of days a task has been performed by a worker, the progress of the task by a worker, or the accuracy of the task by a worker as AR content corresponding to the implementation status of the task. When generating AR content corresponding to the progress of work, the AR content generation unit 12 can recognize the progress of the work by counting the number of work elements that have been performed among the multiple work elements required from the start of product assembly to the completion of the product.
[0037] In the work support device 2 shown in Fig. 1, the AR content generation unit 12 generates AR content corresponding to the work implementation status. In addition to generating AR content corresponding to the work implementation status, the AR content generation unit 12 may generate AR content indicating an ideal standing position of a worker. Information indicating the ideal standing position of a worker is stored, for example, in an internal memory of the AR content generation unit 12. An example of the AR content indicating the ideal standing position of a worker is an illustration of footprints indicating the ideal standing position of a worker.
[0038] Embodiment 2 In the second embodiment, a work support device 2 in which the AR content generator 12 generates AR content corresponding to the current time in addition to generating AR content corresponding to the progress status of work will be described.
[0039] The configuration of the work support device 2 according to embodiment 2 is similar to the configuration of the work support device 2 according to embodiment 1, and a configuration diagram showing a work support system including the work support device 2 according to embodiment 2 is shown in FIG. 1. The AR content generator 12 generates AR content corresponding to the current time in addition to generating AR content corresponding to the implementation status of the work. The AR content generation unit 12 outputs to the display data output unit 13 display data indicating AR content corresponding to the progress status of the work and display data indicating AR content corresponding to the current time.
[0040] Next, the operation of the work support system according to the embodiment 2 will be described. However, apart from the AR content generation unit 12, the system is the same as the work support system shown in Fig. 1. Therefore, here, the operation of the AR content generation unit 12 will be mainly described.
[0041] The AR content generation unit 12 acquires the sensing data from the sensing data acquisition unit 11. The AR content generator 12 generates AR content corresponding to the progress of the work based on the sensing data, similarly to the first embodiment.
[0042] The AR content generation unit 12 obtains the current time from either an internal clock or an external clock. The AR content generator 12 generates AR content corresponding to the current time. Hereinafter, the process of generating AR content corresponding to the current time by the AR content generation unit 12 will be specifically described.
[0043] If the current time is within working hours, for example, the AR content generator 12 generates AR content indicating that it is working hours, as shown in FIG. FIG. 10 is an explanatory diagram illustrating an example of AR content indicating that the current time is within working hours. If the current time is, for example, within a break time, the AR content generator 12 generates AR content indicating that it is a break time, as shown in FIG. FIG. 11 is an explanatory diagram illustrating an example of AR content indicating that the current time is within a break time. In FIG. 11, a coffee cup and a rice bowl are AR contents indicating that it is break time.
[0044] Here, the AR content generating unit 12 generates, as the AR content corresponding to the current time, either an AR content indicating that it is working time or an AR content indicating that it is a break time. However, this is merely an example, and the AR content generating unit 12 may generate, as the AR content corresponding to the current time, for example, any of an AR content indicating that it is morning, an AR content indicating that it is daytime, or an AR content indicating that it is night.
[0045] The display data output unit 13 acquires the sensing data from the sensing data acquisition unit 11 . Furthermore, the display data output unit 13 acquires, from the AR content generation unit 12, AR content corresponding to the implementation status of the task and AR content corresponding to the current time. The display data output unit 13 superimposes display data indicating each AR content on the imaging data, which is the sensing data. When the display data output unit 13 superimposes the display data on the imaging data, the display data output unit 13 superimposes the display data on the imaging data so that the status of the work being performed by the worker is not obscured by each AR content. That is, as shown in Figs. 10 and 11, the display data output unit 13 superimposes the display data on the imaging data so that the products being transported by the belt conveyer are not obscured by the AR content. The display data output unit 13 outputs the imaging data on which the display data has been superimposed to the display device 3.
[0046] The display device 3 acquires the imaging data after the display data has been superimposed from the display data output unit 13 of the work support device 2. The display device 3 displays the AR content in accordance with the imaging data after the display data has been superimposed. As a result, the display device 3 displays AR content such as that shown in any one of FIGS.
[0047] In the above-described second embodiment, the work support device 2 is configured so that the AR content generator 12 generates AR content corresponding to the current time in addition to generating AR content corresponding to the progress status of the work. Therefore, the work support device 2 allows the worker to check the progress status of the work as well as the time zone to which the current time belongs.
[0048] Embodiment 3 In the third embodiment, a work support device 2 in which the AR content generator 12 generates AR content corresponding to the current season in addition to generating AR content corresponding to the implementation status of work will be described.
[0049] The configuration of the work support device 2 according to embodiment 3 is similar to the configuration of the work support device 2 according to embodiment 1, and a configuration diagram showing a work support system including the work support device 2 according to embodiment 3 is shown in FIG. 1. The AR content generator 12 generates AR content corresponding to the current season in addition to generating AR content corresponding to the implementation status of the work. The AR content generation unit 12 outputs to the display data output unit 13 display data indicating AR content corresponding to the progress status of the work and display data indicating AR content corresponding to the current season.
[0050] Next, the operation of the work support system according to the third embodiment will be described. However, apart from the AR content generation unit 12, the system is the same as the work support system shown in Fig. 1. Therefore, here, the operation of the AR content generation unit 12 will be mainly described.
[0051] The AR content generation unit 12 acquires the sensing data from the sensing data acquisition unit 11. The AR content generator 12 generates AR content corresponding to the progress of the work based on the sensing data, similarly to the first embodiment.
[0052] The AR content generation unit 12 obtains the current season from either an internal calendar or an external calendar. The AR content generator 12 generates AR content corresponding to the current season. Hereinafter, the process of generating AR content corresponding to the current season by the AR content generation unit 12 will be specifically described.
[0053] If the current season is spring, the AR content generator 12 generates AR content that is reminiscent of spring. Examples of AR content that is reminiscent of spring include AR content showing cherry blossoms, AR content showing plum blossoms, and AR content showing bamboo shoots. If the current season is summer, the AR content generator 12 generates AR content that is reminiscent of summer. Examples of AR content that is reminiscent of summer include AR content that shows a watermelon, AR content that shows fireworks, and AR content that shows a beach. If the current season is autumn, the AR content generator 12 generates AR content that is reminiscent of autumn. Examples of AR content that is reminiscent of autumn include AR content showing autumn leaves, AR content showing chestnuts, and AR content showing Pacific saury. If the current season is winter, the AR content generator 12 generates AR content that is reminiscent of winter. Examples of AR content that is reminiscent of winter include AR content that shows a snowman, AR content that shows skiing, and AR content that shows a scarf. FIG. 12 is an explanatory diagram showing AR content reminiscent of summer as an example of AR content corresponding to the current season.
[0054] Here, the AR content generating unit 12 generates, as the AR content corresponding to the current season, any of AR content reminiscent of spring, AR content reminiscent of summer, AR content reminiscent of autumn, and AR content reminiscent of winter. However, this is merely an example, and the AR content generating unit 12 may generate, as the AR content corresponding to the current season, AR content reminiscent of each month from January to December, for example.
[0055] The display data output unit 13 acquires the sensing data from the sensing data acquisition unit 11 . Furthermore, the display data output unit 13 acquires, from the AR content generation unit 12, AR content corresponding to the implementation status of the work and AR content corresponding to the current season. The display data output unit 13 superimposes display data indicating each AR content on the imaging data, which is the sensing data. When the display data output unit 13 superimposes the display data on the imaging data, the display data output unit 13 superimposes the display data on the imaging data so that the status of the work being performed by the worker is not obscured by each AR content. That is, as shown in FIG. 12, the display data output unit 13 superimposes the display data on the imaging data so that the products being transported by the belt conveyer are not obscured by the AR content. The display data output unit 13 outputs the imaging data on which the display data has been superimposed to the display device 3.
[0056] The display device 3 acquires the imaging data after the display data has been superimposed from the display data output unit 13 of the work support device 2. The display device 3 displays the AR content in accordance with the imaging data after the display data has been superimposed. As a result, for example, AR content as shown in FIG.
[0057] In the above-described third embodiment, the work support device 2 is configured so that the AR content generator 12 generates AR content corresponding to the current season in addition to generating AR content corresponding to the work implementation status. Therefore, the work support device 2 allows the worker to check the current season in addition to checking the work implementation status.
[0058] Embodiment 4 In the fourth embodiment, a work support device 2 in which the AR content generator 12 generates AR content corresponding to the execution time of a work in addition to generating AR content corresponding to the execution status of the work will be described.
[0059] The configuration of the work support device 2 according to embodiment 4 is similar to the configuration of the work support device 2 according to embodiment 1, and a configuration diagram showing a work support system including the work support device 2 according to embodiment 4 is shown in FIG. 1. The AR content generator 12 generates AR content corresponding to the execution status of the work, and also generates AR content corresponding to the execution time of the work. The AR content generation unit 12 outputs to the display data output unit 13 display data indicating AR content corresponding to the progress status of the work and display data indicating AR content corresponding to the time when the work is performed.
[0060] Next, the operation of the work support system according to the fourth embodiment will be described. However, the system is the same as the work support system shown in Fig. 1 except for the AR content generation unit 12. Therefore, the operation of the AR content generation unit 12 will be mainly described here.
[0061] The AR content generation unit 12 acquires the sensing data from the sensing data acquisition unit 11. The AR content generator 12 generates AR content corresponding to the progress of the work based on the sensing data, similarly to the first embodiment.
[0062] The AR content generation unit 12 obtains the current time from either an internal clock or an external clock. The AR content generator 12 stores the time when the worker starts the work. The AR content generator 12 calculates the time from when the worker starts the task to the current time as the task execution time. The AR content generator 12 generates AR content corresponding to the execution time of the work, for example, as shown in FIG. FIG. 13 is an explanatory diagram illustrating an example of AR content corresponding to the execution time of a task.
[0063] The display data output unit 13 acquires the sensing data from the sensing data acquisition unit 11 . Furthermore, the display data output unit 13 acquires, from the AR content generation unit 12, AR content corresponding to the progress status of the task and AR content corresponding to the time for which the task is to be performed. The display data output unit 13 superimposes display data indicating each AR content on the imaging data, which is the sensing data. When the display data output unit 13 superimposes the display data on the imaging data, the display data output unit 13 superimposes the display data on the imaging data so that the status of the work being performed by the worker is not obscured by each AR content. That is, as shown in FIG. 13, the display data output unit 13 superimposes the display data on the imaging data so that the products being transported by the belt conveyer are not obscured by the AR content. The display data output unit 13 outputs the imaging data on which the display data has been superimposed to the display device 3.
[0064] The display device 3 acquires the imaging data after the display data has been superimposed from the display data output unit 13 of the work support device 2. The display device 3 displays the AR content in accordance with the imaging data after the display data has been superimposed. As a result, for example, AR content as shown in FIG.
[0065] In the above-described fourth embodiment, the work support device 2 is configured so that the AR content generator 12 generates AR content corresponding to the execution status of the work, and also generates AR content corresponding to the execution time of the work. Therefore, in the work support device 2, the worker can check the execution status of the work, and can check the execution time of the work.
[0066] Embodiment 5. In the fifth embodiment, a work support device 2 in which the AR content generator 12 generates AR content corresponding to the current weather in addition to generating AR content corresponding to the implementation status of work will be described.
[0067] The configuration of the work support device 2 according to embodiment 5 is similar to the configuration of the work support device 2 according to embodiment 1, and a configuration diagram showing a work support system including the work support device 2 according to embodiment 5 is shown in FIG. 1. The AR content generator 12 generates AR content corresponding to the current weather, in addition to generating AR content corresponding to the implementation status of the work. The AR content generation unit 12 outputs to the display data output unit 13 display data showing AR content corresponding to the implementation status of the work and display data showing AR content corresponding to the current weather.
[0068] Next, the operation of the work support system according to embodiment 5 will be described. However, apart from the AR content generation unit 12, the system is the same as the work support system shown in Fig. 1. Therefore, here, the operation of the AR content generation unit 12 will be mainly described.
[0069] The AR content generation unit 12 acquires the sensing data from the sensing data acquisition unit 11. The AR content generator 12 generates AR content corresponding to the progress of the work based on the sensing data, similarly to the first embodiment.
[0070] The AR content generator 12 acquires weather information indicating the current weather, for example, from a weather site (not shown). The AR content generator 12 generates AR content corresponding to the weather indicated by the weather information, for example, as shown in FIG. FIG. 14 is an explanatory diagram illustrating an example of AR content corresponding to the current weather. In the example of Fig. 14, AR content corresponding to the current weather is displayed against the background of a conveyor belt, etc. In the example of Fig. 14, the current weather is shown as blue sky with some clouds.
[0071] The display data output unit 13 acquires the sensing data from the sensing data acquisition unit 11 . Furthermore, the display data output unit 13 acquires, from the AR content generation unit 12, AR content corresponding to the implementation status of the work and AR content corresponding to the current weather. The display data output unit 13 superimposes display data indicating each AR content on the imaging data, which is the sensing data. When the display data output unit 13 superimposes the display data on the imaging data, the display data output unit 13 superimposes the display data on the imaging data so that the status of the work being performed by the worker is not obscured by each AR content. That is, as shown in FIG. 14, the display data output unit 13 superimposes the display data on the imaging data so that the products being transported by the belt conveyer are not obscured by the AR content. The display data output unit 13 outputs the imaging data on which the display data has been superimposed to the display device 3.
[0072] The display device 3 acquires the imaging data after the display data has been superimposed from the display data output unit 13 of the work support device 2. The display device 3 displays the AR content in accordance with the imaging data after the display data has been superimposed. As a result, for example, AR content as shown in FIG.
[0073] In the above-described fifth embodiment, the work support device 2 is configured so that the AR content generator 12 generates AR content corresponding to the current weather in addition to generating AR content corresponding to the work implementation status. Therefore, the work support device 2 allows the worker to check the current weather in addition to checking the work implementation status.
[0074] Embodiment 6 In the sixth embodiment, a work support device 2 in which the AR content generation unit 12 generates AR content corresponding to the progress status of work, as well as AR content corresponding to the cleaning status in the facility where the work is being performed, will be described.
[0075] Fig. 15 is a configuration diagram showing a work support system including a work support device 2 according to embodiment 6. In Fig. 15, the same reference numerals as in Fig. 1 indicate the same or corresponding parts, and detailed description thereof will be omitted. Fig. 16 is a hardware configuration diagram showing the hardware of a work support device 2 according to embodiment 6. In Fig. 16, the same reference numerals as in Fig. 2 denote the same or corresponding parts, and detailed description thereof will be omitted. The work support system shown in FIG. 15 includes a sensor 1, a camera 4, a work support device 2, and a display device 3. The camera 4 captures images of the inside of the facility where the work is being performed, and outputs captured data of the inside of the facility to the work support device 2. Locations captured within the facility include, for example, the area around the conveyor belt or the entrance and exit of the facility.
[0076] The AR content generation unit 14 is realized by, for example, an AR content generation circuit 24 shown in FIG. The AR content generation unit 14 acquires sensing data from the sensing data acquisition unit 11, and acquires photographed data of the inside of the facility from the camera 4. The AR content generator 14 generates AR content corresponding to the progress of the work based on the sensing data, similar to the AR content generator 12 shown in FIG. The AR content generation unit 14 determines whether or not garbage has accumulated within the facility based on the photographed data within the facility. The AR content generator 14 generates AR content corresponding to the cleaning status in the facility where the work is being performed. Specifically, if there is trash accumulated in the facility, the AR content generator 14 generates AR content indicating that trash has accumulated as the cleaning status of the facility where work is being performed. The AR content generation unit 14 outputs to the display data output unit 13 display data showing AR content corresponding to the implementation status of the work and display data showing AR content corresponding to the cleaning status within the facility.
[0077] 15, it is assumed that each of the components of the work support device 2, that is, the sensing data acquisition unit 11, the AR content generation unit 14, and the display data output unit 13, is realized by dedicated hardware as shown in Fig. 16. That is, it is assumed that the work support device 2 is realized by a sensing data acquisition circuit 21, an AR content generation circuit 24, and a display data output circuit 23. Each of the sensing data acquisition circuit 21, the AR content generation circuit 24, and the display data output circuit 23 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination of these.
[0078] The components of the work support device 2 are not limited to those realized by dedicated hardware, and the work support device 2 may be realized by software, firmware, or a combination of software and firmware. When the work support device 2 is realized by software, firmware, or the like, a program for causing a computer to execute the respective processing procedures of the sensing data acquisition unit 11, the AR content generation unit 14, and the display data output unit 13 is stored in a memory 31 shown in Fig. 3. Then, a processor 32 shown in Fig. 3 executes the program stored in the memory 31.
[0079] 16 shows an example in which each of the components of the work support device 2 is realized by dedicated hardware, while Fig. 3 shows an example in which the work support device 2 is realized by software, firmware, etc. However, this is merely an example, and some of the components in the work support device 2 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.
[0080] Next, the operation of the work support system shown in Fig. 15 will be described. However, other than the camera 4 and the AR content generation unit 14, the system is the same as the work support system shown in Fig. 1. Therefore, here, the operation of the camera 4 and the AR content generation unit 14 will be mainly described.
[0081] The camera 4 captures images of the inside of the facility where the work is being performed, and outputs the captured image data of the inside of the facility to the work support device 2. The AR content generation unit 14 acquires the sensing data from the sensing data acquisition unit 11. The AR content generator 14 generates AR content corresponding to the progress of the work based on the sensing data, similar to the AR content generator 12 shown in FIG.
[0082] The AR content generator 14 acquires photographed data of the inside of the facility from the camera 4. The AR content generation unit 14 determines whether or not garbage has accumulated within the facility based on the photographed data within the facility. The determination process of the AR content generation unit 14 will be specifically described below.
[0083] The AR content generator 14 acquires, from the camera 4, image capture data of the periphery of a belt conveyor, for example, as image capture data of the inside of the facility. An image showing the periphery of the belt conveyor when no dust has accumulated around the belt conveyor is stored in the internal memory or the like of the AR content generating unit 14. The AR content generation unit 14 compares an image represented by the photographing data of the periphery of the belt conveyor with an image representing the periphery of the belt conveyor when no dust has accumulated. If the degree of match between the two images is equal to or greater than a threshold, the AR content generation unit 14 determines that no dust has accumulated around the belt conveyor. If the degree of coincidence between the two images is less than a threshold, the AR content generation unit 14 determines that dust has accumulated around the belt conveyor. The threshold may be stored in an internal memory of the AR content generation unit 14, or may be provided from outside the work support device 2.
[0084] If there is garbage in the facility, the AR content generator 14 generates AR content showing that garbage has accumulated as a cleaning status of the facility where work is being performed, for example, as shown in Fig. 17. The process of generating the AR content showing that garbage has accumulated is a known technique, and therefore a detailed description thereof will be omitted. FIG. 17 is an explanatory diagram showing an example of AR content indicating that dust has accumulated. If no trash has accumulated in the facility, the AR content generator 14 generates AR content indicating that no trash has accumulated as the cleaning status of the facility where work is being performed. An example of AR content indicating that no trash has accumulated is a message indicating "no trash." Here, the AR content generating unit 14 generates AR content indicating that no trash has accumulated. However, this is merely an example, and if no trash has accumulated in the facility, the AR content generating unit 14 may not generate AR content corresponding to the cleaning status in the facility. The AR content generation unit 14 outputs, to the display data output unit 13, display data indicating AR content corresponding to the progress of the work. When the AR content generation unit 14 generates AR content corresponding to the cleaning status in the facility, the AR content generation unit 14 outputs display data indicating the AR content to the display data output unit 13.
[0085] The display data output unit 13 acquires the sensing data from the sensing data acquisition unit 11 . Furthermore, the display data output unit 13 acquires AR content corresponding to the implementation status of the work from the AR content generation unit 14. When AR content corresponding to the cleaning status in the facility is output from the AR content generation unit 14, the display data output unit 13 acquires the AR content. The display data output unit 13 superimposes display data indicating each AR content on the imaging data, which is the sensing data. When the display data output unit 13 superimposes the display data on the imaging data, the display data output unit 13 superimposes the display data on the imaging data so that the status of the work being performed by the worker is not obscured by each AR content. That is, as shown in FIG. 17, the display data output unit 13 superimposes the display data on the imaging data so that the products being transported by the belt conveyer are not obscured by the AR content. The display data output unit 13 outputs the imaging data on which the display data has been superimposed to the display device 3.
[0086] The display device 3 acquires the imaging data after the display data has been superimposed from the display data output unit 13 of the work support device 2. The display device 3 displays the AR content in accordance with the imaging data after the display data has been superimposed. As a result, for example, AR content as shown in FIG.
[0087] In the above-described sixth embodiment, the work support device 2 is configured so that the AR content generator 12 generates AR content corresponding to the implementation status of the work, and also generates AR content corresponding to the cleaning status in the facility where the work is being performed. Therefore, with the work support device 2, the worker can check the implementation status of the work, and the worker can check the cleaning status in the facility.
[0088] Embodiment 7 In the seventh embodiment, a work support device 2 in which the AR content generator 15 generates AR content corresponding to the progress status of work, and also generates AR content showing a character providing guidance on the progress of work, will be described.
[0089] Fig. 18 is a configuration diagram showing a work support system including a work support device 2 according to embodiment 7. In Fig. 18, the same reference numerals as in Fig. 1 and Fig. 15 indicate the same or corresponding parts, and detailed description thereof will be omitted. Fig. 19 is a hardware configuration diagram showing the hardware of a work support device 2 according to embodiment 7. In Fig. 19, the same reference numerals as in Fig. 2 and Fig. 16 indicate the same or corresponding parts, and detailed description thereof will be omitted.
[0090] The AR content generation unit 15 is realized by, for example, an AR content generation circuit 25 shown in FIG. The AR content generation unit 15 acquires the sensing data from the sensing data acquisition unit 11, and acquires work information indicating the content of the work being performed. The AR content generation unit 15 generates AR content corresponding to the progress of the work based on the sensing data, similar to the AR content generation unit 12 shown in FIG. The AR content generator 15 grasps the details of the work performed by the worker based on the work information. The AR content generator 15 generates AR content showing a character providing guidance on the content of the work to be performed. The AR content generation unit 15 outputs to the display data output unit 13 display data showing the AR content corresponding to the progress of the work and display data showing the AR content showing the character.
[0091] The work support device 2 shown in Fig. 18 is configured such that the AR content generation unit 15 is applied to the work support device 2 shown in Fig. 1. However, this is merely an example, and the AR content generation unit 15 may be applied to the work support device 2 shown in Fig. 15.
[0092] 18, it is assumed that the sensing data acquisition unit 11, the AR content generation unit 15, and the display data output unit 13, which are components of the work support device 2, are each realized by dedicated hardware as shown in Fig. 19. That is, it is assumed that the work support device 2 is realized by a sensing data acquisition circuit 21, an AR content generation circuit 25, and a display data output circuit 23. Each of the sensing data acquisition circuit 21, the AR content generation circuit 25, and the display data output circuit 23 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination of these.
[0093] The components of the work support device 2 are not limited to those realized by dedicated hardware, and the work support device 2 may be realized by software, firmware, or a combination of software and firmware. When the work support device 2 is realized by software, firmware, or the like, a program for causing a computer to execute the respective processing procedures of the sensing data acquisition unit 11, the AR content generation unit 15, and the display data output unit 13 is stored in a memory 31 shown in Fig. 3. Then, a processor 32 shown in Fig. 3 executes the program stored in the memory 31.
[0094] 19 shows an example in which each of the components of the work support device 2 is realized by dedicated hardware, and Fig. 3 shows an example in which the work support device 2 is realized by software, firmware, etc. However, this is merely an example, and some of the components in the work support device 2 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.
[0095] Next, the operation of the work support system shown in Fig. 18 will be described. However, apart from the AR content generation unit 15, the system is the same as the work support system shown in Fig. 1. Therefore, here, the operation of the AR content generation unit 15 will be mainly described.
[0096] The AR content generation unit 15 acquires the sensing data from the sensing data acquisition unit 11, and acquires work information indicating the content of the work being performed. The AR content generation unit 15 generates AR content corresponding to the progress of the work based on the sensing data, similar to the AR content generation unit 12 shown in FIG.
[0097] The AR content generator 15 grasps the details of the work performed by the worker based on the work information. The AR content generator 15 generates AR content showing a character providing guidance on the execution of work, as shown in FIG. FIG. 20 is an explanatory diagram showing an example of AR content showing a character providing guidance on the content of work to be performed. FIG. 20 shows an example in which the task execution content is "Please remove the lid in the green frame." The AR content generation unit 15 outputs to the display data output unit 13 display data showing the AR content corresponding to the progress of the work and display data showing the AR content showing the character.
[0098] The display data output unit 13 acquires the sensing data from the sensing data acquisition unit 11 . Furthermore, the display data output unit 13 acquires, from the AR content generation unit 15, AR content corresponding to the implementation status of the work and AR content showing a character. The display data output unit 13 superimposes display data indicating each AR content on the imaging data, which is the sensing data. When the display data output unit 13 superimposes the display data on the imaging data, the display data output unit 13 superimposes the display data on the imaging data so that the status of the work being performed by the worker is not obscured by each AR content. That is, as shown in FIG. 20, the display data output unit 13 superimposes the display data on the imaging data so that the products being transported by the belt conveyer are not obscured by the AR content. The display data output unit 13 outputs the imaging data on which the display data has been superimposed to the display device 3.
[0099] The display device 3 acquires the imaging data after the display data has been superimposed from the display data output unit 13 of the work support device 2. The display device 3 displays the AR content in accordance with the imaging data after the display data has been superimposed. As a result, for example, AR content as shown in FIG.
[0100] In the above-described seventh embodiment, the work support device 2 is configured so that the AR content generator 15 generates AR content corresponding to the progress of the work, and also generates AR content showing a character that guides the work. Therefore, in the work support device 2, the worker can check the progress of the work, and can check the work content.
[0101] 18, the AR content generating unit 15 generates AR content showing a character guiding the user on the content of the work. In this case, the AR content generating unit 15 may adjust the speed of the work shown by the content of the work guided by the character, depending on the skill of the worker or the physical condition of the worker. Specifically, if the task content is, for example, "tightening a screw," the AR content generation unit 15 adjusts the task speed of "tightening a screw" in accordance with either the worker's skill or the worker's physical condition. That is, the higher the worker's skill, the faster the task speed of tightening the screws will be determined by the AR content generation unit 15 to provide guidance such as "tighten the screw within xx seconds." Also, if the worker's physical condition is poor, the AR content generation unit 15 determines the task content to provide guidance such as "tighten the screw in about △ minutes" in order to slow down the task speed of tightening the screws.
[0102] The AR content generation unit 15, for example, provides either the worker's skill or the worker's physical condition to a learning model (not shown), and obtains speed information from the learning model indicating the work speed corresponding to either the worker's skill or the worker's physical condition. During learning, when the learning model is given teacher data indicating either the worker's skill or the worker's physical condition, and the work speed, it learns the work speed that corresponds to either the worker's skill or the worker's physical condition. The AR content generator 15 generates AR content showing a character providing guidance on the work to be performed at the work speed indicated by the speed information.
[0103] 18, the AR content generation unit 15 generates AR content showing a character with a bear motif as AR content showing a character guiding the user through the work. However, this is merely an example, and the AR content generation unit 15 may receive a selection of AR content showing a character to be generated before generating AR content showing a character guiding the user through the work. Specifically, the AR content generation unit 15 includes, for example, a user interface, and when the user operates the user interface to select AR content indicating a character to be generated, the AR content generation unit 15 generates the AR content indicating the character.
[0104] Embodiment 8 In the eighth embodiment, a work supporting device 2 in which the AR content generator 16 generates AR content corresponding to the execution status of work, and also generates AR content showing the actions of a skilled worker in the work, will be described.
[0105] Fig. 21 is a configuration diagram showing a work support system including a work support device 2 according to embodiment 8. In Fig. 21, the same reference numerals as those in Figs. 1, 15, and 18 indicate the same or corresponding parts, and detailed description thereof will be omitted. Fig. 22 is a hardware configuration diagram showing hardware of a work support device 2 according to embodiment 8. In Fig. 22, the same reference numerals as those in Fig. 2, Fig. 16, and Fig. 19 indicate the same or corresponding parts, and detailed description thereof will be omitted.
[0106] The AR content generation unit 16 is realized by, for example, an AR content generation circuit 26 shown in FIG. The AR content generation unit 16 acquires sensing data from the sensing data acquisition unit 11, and acquires motion information indicating the motion of the skilled worker with respect to the work performed by the worker. The AR content generator 16 generates AR content corresponding to the progress of the work based on the sensing data, similar to the AR content generator 12 shown in FIG. The AR content generator 16 grasps the motion of the skilled worker based on the motion information. The AR content generator 16 generates AR content showing the actions of the skilled worker. The AR content generation unit 16 outputs to the display data output unit 13 display data showing AR content corresponding to the execution status of the work and display data of AR content showing the action of the skilled worker.
[0107] The work support device 2 shown in Fig. 21 is configured such that the AR content generation unit 16 is applied to the work support device 2 shown in Fig. 1. However, this is merely an example, and the AR content generation unit 16 may be applied to the work support device 2 shown in Fig. 15 or the work support device 2 shown in Fig. 18.
[0108] 21, it is assumed that the sensing data acquisition unit 11, the AR content generation unit 16, and the display data output unit 13, which are components of the work support device 2, are each realized by dedicated hardware as shown in Fig. 22. That is, it is assumed that the work support device 2 is realized by a sensing data acquisition circuit 21, an AR content generation circuit 26, and a display data output circuit 23. Each of the sensing data acquisition circuit 21, the AR content generation circuit 26, and the display data output circuit 23 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination of these.
[0109] The components of the work support device 2 are not limited to those realized by dedicated hardware, and the work support device 2 may be realized by software, firmware, or a combination of software and firmware. When the work support device 2 is realized by software, firmware, or the like, a program for causing a computer to execute the respective processing procedures of the sensing data acquisition unit 11, the AR content generation unit 16, and the display data output unit 13 is stored in a memory 31 shown in Fig. 3. Then, a processor 32 shown in Fig. 3 executes the program stored in the memory 31.
[0110] 22 shows an example in which each of the components of the work support device 2 is realized by dedicated hardware, and Fig. 3 shows an example in which the work support device 2 is realized by software, firmware, etc. However, this is merely an example, and some of the components in the work support device 2 may be realized by dedicated hardware, and the remaining components may be realized by software, firmware, etc.
[0111] Next, the operation of the work support system shown in Fig. 21 will be described. However, apart from the AR content generation unit 16, the system is the same as the work support system shown in Fig. 1. Therefore, here, the operation of the AR content generation unit 16 will be mainly described.
[0112] The AR content generation unit 16 acquires sensing data from the sensing data acquisition unit 11, and acquires motion information indicating the motion of the skilled worker with respect to the work performed by the worker. The movements of a skilled worker include, for example, the movement line of a skilled worker when working, or the way a skilled worker moves his or her body when working. The AR content generator 16 generates AR content corresponding to the progress of the work based on the sensing data, similar to the AR content generator 12 shown in FIG.
[0113] The AR content generation unit 16 grasps the movements of the skilled worker based on the movement information. If the movement information indicates, for example, the movement line of the skilled worker while working, the AR content generation unit 16 grasps the movement line while working. If the movement information indicates, for example, how to move the body while working, the AR content generation unit 16 grasps how to move the body while working. The AR content generator 16 generates AR content showing the actions of a skilled worker, as shown in FIG. FIG. 23 is an explanatory diagram showing an example of AR content showing the actions of a skilled craftsman. In FIG. 23, AR content showing the movement line of a skilled worker during work is displayed as the AR content showing the action of the skilled worker. The AR content generation unit 16 outputs to the display data output unit 13 display data showing AR content corresponding to the execution status of the work and display data of AR content showing the action of the skilled worker.
[0114] The display data output unit 13 acquires the sensing data from the sensing data acquisition unit 11 . Furthermore, the display data output unit 13 acquires, from the AR content generation unit 16, AR content corresponding to the execution status of the work and AR content showing the action of the skilled worker. The display data output unit 13 superimposes display data indicating each AR content on the imaging data, which is the sensing data. When the display data output unit 13 superimposes the display data on the imaging data, the display data output unit 13 superimposes the display data on the imaging data so that the status of the work being performed by the worker is not obscured by each AR content. That is, as shown in FIG. 23, the display data output unit 13 superimposes the display data on the imaging data so that the products being transported by the belt conveyer are not obscured by the AR content. The display data output unit 13 outputs the imaging data on which the display data has been superimposed to the display device 3.
[0115] The display device 3 acquires the imaging data after the display data has been superimposed from the display data output unit 13 of the work support device 2. The display device 3 displays the AR content in accordance with the imaging data after the display data has been superimposed. As a result, for example, AR content as shown in FIG.
[0116] In the above-described eighth embodiment, the work support device 2 is configured so that the AR content generator 16 generates AR content that indicates the actions of a skilled worker in the work, in addition to generating AR content that corresponds to the progress status of the work. Therefore, with the work support device 2, the worker can check the progress status of the work, and can check the actions of the skilled worker.
[0117] In addition, the present disclosure allows free combination of the respective embodiments, modification of any of the components of each embodiment, or omission of any of the components of each embodiment. [Industrial Applicability]
[0118] The present disclosure is suitable for a work assistance device, a work assistance method, and a work assistance system. [Explanation of symbols]
[0119] REFERENCE SIGNS LIST 1 sensor, 2 work support device, 3 display device, 4 camera, 11 sensing data acquisition unit, 12, 14, 15, 16 AR content generation unit, 13 display data output unit, 21 sensing data acquisition circuit, 22, 24, 25, 26 AR content generation circuit, 23 display data output circuit, 31 memory, 32 processor.
Claims
1. a sensing data acquisition unit that acquires sensing data indicating a status of work being performed by a worker from a sensor that monitors the status of work being performed by the worker; an AR content generation unit that generates AR (Augmented Reality) content corresponding to an implementation status of the work based on the sensing data acquired by the sensing data acquisition unit; a display data output unit that outputs display data indicating the AR content generated by the AR content generation unit; Equipped with The AR content generation unit is A work support device characterized by calculating a completion rate of a task by the worker as a progress status of the task based on the sensing data acquired by the sensing data acquisition unit, and generating AR content corresponding to both the current season and the completion rate of the task.
2. the sensor is an image sensor that captures an image of the work being performed, The sensing data acquisition unit is acquiring imaging data indicative of an imaging result of the imaging sensor as sensing data indicative of an implementation status of the work; The display data output unit includes:
2. The work support device according to claim 1, wherein display data indicating the AR content generated by the AR content generation unit is superimposed on the imaging data, and the imaging data after the display data is superimposed is output.
3. The display data output unit includes: The work support device according to claim 2, characterized in that display data indicating the AR content generated by the AR content generation unit is superimposed on the imaging data so that the status of the work being performed by the worker is not obscured by the AR content generated by the AR content generation unit.
4. The AR content generation unit is 2. The work support device according to claim 1, further comprising: a selection of an AR content to be generated before generating the AR content corresponding to the implementation status of the work.
5. The AR content generation unit is 2. The work support device according to claim 1, further comprising: an AR content generating unit configured to generate AR content corresponding to a current time in addition to the AR content generating unit configured to generate AR content corresponding to the work status.
6. The AR content generation unit is 2. The work support device according to claim 1, further comprising: an AR content generating unit configured to generate AR content corresponding to a current season in addition to generating AR content corresponding to the work implementation status.
7. The AR content generation unit is 2. The work support device according to claim 1, further comprising: a display unit configured to display an AR content corresponding to a time when the work is being performed, in addition to displaying an AR content corresponding to a status of the work.
8. The AR content generation unit is 2. The work support device according to claim 1, further comprising: an AR content generating unit configured to generate AR content corresponding to a current weather condition in addition to the AR content generating unit configured to generate AR content corresponding to a work execution status.
9. The AR content generation unit is 2. The work support device according to claim 1, further comprising: a display unit configured to display, in addition to the display unit, an AR content corresponding to a cleaning status within a facility where the work is being performed;
10. The AR content generation unit is 2. The work support device according to claim 1, further comprising: an AR content generating unit configured to generate an AR content showing a character providing guidance on the work to be performed, in addition to generating an AR content corresponding to the work performance status.
11. The AR content generation unit is 11. The work support device according to claim 10, wherein the speed of the work indicated by the action content guided by the character is adjusted according to either the skill of the worker or the physical condition of the worker.
12. The AR content generation unit is 2. The work support device according to claim 1, further comprising: an AR content showing an action of a skilled worker for the work, in addition to generating an AR content corresponding to the execution status of the work.
13. the sensing data acquisition unit acquires sensing data indicating a status of work being performed by a worker from a sensor that monitors the status of work being performed by the worker; an AR content generation unit generates AR (Augmented Reality) content corresponding to an implementation status of the work based on the sensing data acquired by the sensing data acquisition unit; A display data output unit outputs display data indicating the AR content generated by the AR content generation unit. A work assistance method, comprising: The AR content generation unit is A work support method that calculates a completion rate of the work by the worker as a progress status of the work based on the sensing data acquired by the sensing data acquisition unit, and generates AR content corresponding to both the current season and the completion rate of the work.
14. A sensor that monitors the status of work being performed by a worker; a sensing data acquisition unit that acquires sensing data indicating an implementation status of the work from the sensor; an AR content generation unit that generates AR (Augmented Reality) content corresponding to an implementation status of the work based on the sensing data acquired by the sensing data acquisition unit; a display data output unit that outputs display data indicating the AR content generated by the AR content generation unit; a display device that displays AR content in accordance with the display data output from the display data output unit; Equipped with The AR content generation unit is A work support system that calculates a completion rate of the work by the worker as a progress status of the work based on the sensing data acquired by the sensing data acquisition unit, and generates AR content corresponding to both the current season and the completion rate of the work.
Citation Information
Patent Citations
Information processor, information processing method and information processing program
JP2007299370A
Information management device, information management method, and information management program
JP2016182248A
Information processing system and information display apparatus
JP2017041028A
Work support device and work support method
JP2018049421A
Arrangement assist system
JP2018181237A