Work analysis device, work analysis system, work analysis method, and program
Patent Information
- Application Number
- JP2024507324
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Filing Date
- 2024-09-02
- Publication Date
- 2024-11-08
- Estimated Expiration
- Not applicable · inactive patent
Abstract
Description
Work analysis device, work analysis system, work analysis method, and storage medium
[0001] The present invention relates to a work analysis device, a work analysis system, a work analysis method, and a storage medium.
[0002] Patent Document 1 describes a technology for generating and transmitting optimal movements for efficiently performing work. In the technology described in Patent Document 1, information related to a person's movements from the start to the end of a task is recorded as task data, the overall movement from the start to the end of the task is divided into multiple partial movements, the best partial movement is selected for each partial movement from multiple samples of the task data for the same task, and the best partial movements are synthesized.
[0003] Patent Document 2 describes a content creation system that creates training content for performing simulated work. In the technology described in Patent Document 2, three-dimensional work movements of a model worker performing work in a work procedure are acquired as measurement information, evaluation criteria information for the work in the work procedure is created based on the measurement information of the three-dimensional work movements, and training content is created and updated based on the measurement information and evaluation criteria information of the three-dimensional work movements and information on the three-dimensional shape of the equipment to be used for the work.
[0004] International Publication No. 2017 / 159562 Japanese Patent Application Laid-Open No. 2020-003707
[0005] While Patent Document 1 describes displaying a video replay of a worker's movements, and Patent Document 2 describes recording changes in movements, line of sight, and the like, the technologies described in Patent Documents 1 and 2 do not visualize changes in the worker's movements or line of sight (e.g., generate a trajectory). Therefore, the technologies described in Patent Documents 1 and 2 do not efficiently find the optimal procedure for performing multiple tasks. Therefore, an object of the present invention is to provide a work analysis device, a work analysis system, a work analysis method, and a storage medium that solve the above-mentioned problems.
[0006] According to a first aspect of the present invention, a work analysis apparatus includes an acquisition means for acquiring data indicating the actions of a user of a VR device performing a plurality of tasks in a virtual space, detected by the VR device, the user performing the plurality of tasks in the virtual space, and data indicating the gaze direction of the user of the VR device, detected by the VR device; a storage means for generating and storing time series data of the actions of the user of the VR device from the data indicating the actions of the user of the VR device performing the plurality of tasks in the virtual space acquired by the acquisition means, and for generating and storing time series data of the gaze direction of the user of the VR device from the data indicating the gaze direction of the user of the VR device acquired by the acquisition means; an analysis means for visualizing at least changes in the actions of the user of the VR device performing the plurality of tasks in the virtual space, based on the time series data of the actions of the user of the VR device stored in the storage means, and visualizing changes in the gaze direction of the user of the VR device based on the time series data of the gaze direction of the user of the VR device stored in the storage means; and an output means for outputting the results of the analysis by the analysis means.
[0007] According to a second aspect of the present invention, a work analysis system includes a VR device that presents a plurality of tasks of an assignment in a virtual space, and a work analysis device that analyzes the plurality of tasks performed by a user of the VR device, wherein the VR device detects the actions of the user of the VR device performing the plurality of tasks in the virtual space and the line of sight of the user of the VR device, and the work analysis device includes an acquisition means that acquires data indicating the actions of the user of the VR device performing the plurality of tasks in the virtual space detected by the VR device and data indicating the line of sight of the user of the VR device detected by the VR device, and the data indicating the user of the VR device performing the plurality of tasks in the virtual space acquired by the acquisition means. The system comprises a storage means for generating and storing time series data of the movements of the user of the VR device from data indicating the movements, and for generating and storing time series data of the gaze direction of the user of the VR device from data indicating the gaze direction of the user of the VR device acquired by the acquisition means; an analysis means for visualizing at least changes in the movements of the user of the VR device as they perform multiple tasks in a virtual space based on the time series data of the movements of the user of the VR device stored in the storage means, and for visualizing changes in the gaze direction of the user of the VR device based on the time series data of the gaze direction of the user of the VR device stored in the storage means; and an output means for outputting the results of the analysis by the analysis means.
[0008] According to a third aspect of the present invention, a task analysis method includes an acquisition step of acquiring data indicating the actions of a user of a VR device performing a plurality of tasks in a virtual space, the data being detected by the VR device, and data indicating the gaze direction of the user of the VR device; a storage step of generating and storing time series data of the actions of the user of the VR device from the data indicating the actions of the user of the VR device performing a plurality of tasks in the virtual space acquired in the acquisition step, and generating and storing time series data of the gaze direction of the user of the VR device from the data indicating the gaze direction of the user of the VR device acquired in the acquisition step; an analysis step of visualizing at least changes in the actions of the user of the VR device performing a plurality of tasks in the virtual space, based on the time series data of the actions of the user of the VR device stored in the storage step, and visualizing changes in the gaze direction of the user of the VR device based on the time series data of the gaze direction of the user of the VR device stored in the storage step; and an output step of outputting the results of the analysis in the analysis step.
[0009] According to a fourth aspect of the present invention, a storage medium for storing a program causes a computer to execute the following steps: an acquisition step of acquiring data indicating the actions of a user of a VR device performing multiple tasks in a virtual space, detected by the VR device, which presents multiple tasks of the assignment in a virtual space, and data indicating the gaze direction of the user of the VR device detected by the VR device; a storage step of generating and storing time series data of the actions of the user of the VR device from the data indicating the actions of the user of the VR device performing multiple tasks in the virtual space acquired in the acquisition step, and generating and storing time series data of the gaze direction of the user of the VR device from the data indicating the gaze direction of the user of the VR device acquired in the acquisition step; an analysis step of visualizing at least changes in the actions of the user of the VR device performing multiple tasks in the virtual space, based on the time series data of the actions of the user of the VR device stored in the storage step, and visualizing changes in the gaze direction of the user of the VR device based on the time series data of the gaze direction of the user of the VR device stored in the storage step; and an output step of outputting the results of the analysis in the analysis step.
[0010] According to the present invention, it is possible to provide a task analysis device, a task analysis system, a task analysis method, and a storage medium that can efficiently find the optimal procedure for performing a plurality of tasks.
[0011] 1 is a diagram showing an example of the work analysis system 1 of the first embodiment. FIG. 1 is a diagram showing an example of trajectories of the positions at which a user of a VR device 11 performs a plurality of tasks in a virtual space, generated by the analysis means 13D of the work analysis device 13. FIG. 2 is a diagram for explaining an example of extracting a trajectory that satisfies a predetermined condition from the plurality of trajectories shown in FIG. 2. FIG. 3 is a diagram for explaining an example of a second condition used to extract a trajectory from the plurality of trajectories shown in FIG. 2. FIG. 4 is a diagram for explaining an example of the results of an analysis performed by the analysis means 13D of the work analysis device 13. FIG. 5 is a diagram showing an example of a correct performance order indicated by information acquired by the acquisition means 13B of the work analysis device 13. FIG. 6 is a diagram showing an example of a determination result of whether the performance order of a plurality of tasks performed in a virtual space by a user of a VR device 11 matches the correct performance order. FIG. 7 is a diagram showing an example of a determination result of whether the performance order of a plurality of tasks performed in a virtual space by a user of a VR device 11 matches the correct performance order for each task performance position. FIG. 8 is a diagram showing an example of utilization of the tendency of the performance order of a plurality of tasks performed in a virtual space by a user of a VR device 11 and the compliance rate with the correct performance order. 1 is a diagram showing an example of a state in which the concentration level of a user (exemplary) of a VR device 11 having a visualized skill is compared with the concentration level of a user (others) of a VR device 11 not having the visualized skill; FIG. 2 is a diagram showing an example of a state in which the time series change in the concentration level of a user (exemplary) of a VR device 11 having a visualized skill is compared with the time series change in the concentration level of a user (others) of a VR device 11 not having the visualized skill; FIG. 3 is a diagram showing an example of a state in which the stress level of a user (exemplary) of a VR device 11 having a visualized skill is compared with the stress level of a user (others) of a VR device 11 not having the visualized skill; FIG. 4 is a diagram showing an example of a state in which the time series change in the stress level of a user (exemplary) of a VR device 11 having a visualized skill is compared with the time series change in the stress level of a user (others) of a VR device 11 not having the visualized skill. This figure shows an example of a state in which the stress level of a user (model) of a VR device 11 with skills is compared with the emotions of users (others) of a VR device 11 without skills.Fig. 1 is a sequence diagram for explaining an example of processing performed in the work analysis system 1 of the first embodiment. Fig. 2 is a diagram showing an example of the work analysis system 1 of the fourth embodiment. Fig. 3 is a diagram showing an example of the work analysis system 1 of the fifth embodiment. Fig. 4 is a diagram showing an example of the work analysis system 1 of the sixth embodiment. Fig. 5 is a diagram showing an example of the work analysis device 13 of the seventh embodiment.
[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of a work analysis device, a work analysis system, a work analysis method, and a storage medium according to the present invention will be described with reference to the accompanying drawings.
[0013] First Embodiment FIG. 1 is a diagram illustrating an example of an task analysis system 1 according to a first embodiment. In the example illustrated in FIG. 1, the task analysis system 1 is used, for example, for training a worker (specifically, a user (wearer) of a VR device 11, which will be described later) who will perform multiple tasks of a task. The task analysis system 1 includes a VR device 11, a biosensor 12, and a task analysis apparatus 13. The VR device 11 is, for example, a head-mounted display device such as that described in Japanese Patent No. 5464130. The VR device 11 includes a presentation unit 11A, a motion detection unit 11B, a gaze direction detection unit 11C, and a communication unit 11D. The presentation unit 11A is, for example, a display of the head-mounted display device. The presentation unit 11A presents, in a virtual space, multiple tasks of a task assigned to the user of the VR device 11.
[0014] The action detection means 11B is, for example, a controller of a head-mounted display device, a remote control (laser pointer), etc. The action detection means 11B detects actions of the user of the VR device 11 performing multiple tasks in a virtual space. Specifically, the action detection means 11B estimates the actions of the user of the VR device 11 performing multiple tasks in a virtual space based on input operations (e.g., button presses) by the user of the VR device 11 on, for example, a controller, a remote control (laser pointer), etc. For example, when the user of the VR device 11 points the controller, remote control (laser pointer), etc. at a task performance position in the virtual space and presses a button on the controller, remote control (laser pointer), etc., the action detection means 11B estimates that the user of the VR device 11 has performed the task.
[0015] The gaze direction detection means 11C detects the gaze direction of the user of the VR device 11. In the example shown in FIG. 1 , the gaze direction detection means 11C estimates the direction in which the user of the VR device 11 points using a controller, remote control (laser pointer), or the like as the gaze direction of the user of the VR device 11. In another example, the gaze direction detection means 11C may estimate the orientation of the VR device 11 as the gaze direction of the user of the VR device 11 by using an acceleration sensor (not shown) provided in the VR device 11, as in the technology described on the website indicated by the following URL: https: / / www.watch.impress.co.jp / headline / docs / extra / vr / 1060434.html In yet another example, the gaze direction detection means 11C may detect the gaze direction of the user of the VR device 11 by using eye tracking technology described on the website indicated by the following URL: https: / / www.tobiipro.com / ja / fields-of-use / vr-research / https: / / japan.cnet.com / article / 35148863 / https: / / www.vive.com / jp / product / vive-pro-eye / overview /
[0016] 1 , the communication means 11D communicates with the work analysis device 13 and the like. The communication means 11D transmits data indicating the actions of the user of the VR device 11 performing multiple tasks in a virtual space, detected by the action detection means 11B, to the work analysis device 13. The communication means 11D also transmits data indicating the gaze direction of the user of the VR device 11, detected by the gaze direction detection means 11C, to the work analysis device 13.
[0017] The biosensor 12 may be a wristband-type wearable device, such as those described in Japanese Patent No. 6911171 and the website indicated at the following URL: https: / / jpn.nec.com / embedded / products / emotion / index.html https: / / jpn.nec.com / manufacture / monozukuri / iot_mono / interview / 13_emotion-analytics.html The biosensor 12 includes, for example, a detection unit 12A and a communication unit 12B. The detection unit 12A detects biometric information (e.g., pulse rate, pulse cycle, etc.) of the user of the VR device 11 (more specifically, the user of the VR device 11 wearing the biosensor 12). The communication unit 12B communicates with the work analysis device 13 and the like. The communication unit 12B transmits the biometric information of the user of the VR device 11 detected by the detection unit 12A to the work analysis device 13.
[0018] The task analysis device 13 analyzes multiple tasks performed by a user of the VR device 11. In the task analysis system 1 of the first embodiment, the task analysis device 13 is located in the cloud. However, in task analysis systems 1 of other embodiments described below, the task analysis device 13 does not need to be located in the cloud. In the example shown in FIG. 1 , the task analysis device 13 includes a communication unit 13A, an acquisition unit 13B, a storage unit 13C, an analysis unit 13D, and an output unit 13E. The communication unit 13A communicates with the VR device 11, the biometric sensor 12, and the like. For example, the communication unit 13A receives data indicating the actions of the user of the VR device 11 performing multiple tasks in a virtual space and data indicating the line of sight of the user of the VR device 11, transmitted by the communication unit 11D of the VR device 11. The communication unit 13A also receives biometric information of the user of the VR device 11 transmitted by the communication unit 12B of the biometric sensor 12.
[0019] The acquisition means 13B acquires data received by the communication means 13A indicating the actions of the user of the VR device 11 performing multiple tasks in a virtual space, data indicating the gaze direction of the user of the VR device 11, and biometric information of the user of the VR device 11. In other words, the acquisition means 13B acquires data indicating the actions of the user of the VR device 11 performing multiple tasks in a virtual space detected by the action detection means 11B of the VR device 11, data indicating the gaze direction of the user of the VR device 11 detected by the gaze direction detection means 11C of the VR device 11, and biometric information of the user of the VR device 11 detected by the detection means 12A of the biometric sensor 12.
[0020] The storage means 13C generates and stores time-series data of the actions of the user of the VR device 11 from data (i.e., instantaneous data) indicating the actions of the user of the VR device 11 performing multiple tasks in a virtual space, which has been acquired by the acquisition means 13B. The storage means 13C also generates and stores time-series data of the gaze direction of the user of the VR device 11 from data (i.e., instantaneous data) indicating the gaze direction of the user of the VR device 11, which has been acquired by the acquisition means 13B. The storage means 13C also generates and stores time-series data of the biometric information of the user of the VR device 11 from the biometric information of the user of the VR device 11 (i.e., instantaneous data) acquired by the acquisition means 13B.
[0021] The analysis means 13D visualizes changes in the movements of the user of the VR device 11 as they perform multiple tasks in a virtual space, based on time-series data of the movements of the user of the VR device 11 stored in the storage means 13C. For example, the analysis means 13D generates a trajectory of the positions at which the user of the VR device 11 performs multiple tasks in a virtual space, based on the time-series data of the movements of the user of the VR device 11 stored in the storage means 13C. The output means 13E outputs the results of the analysis by the analysis means 13D (e.g., the trajectories of the positions at which the multiple tasks are performed, generated by the analysis means 13D).
[0022] Fig. 2 is a diagram showing an example of a trajectory of the positions at which multiple tasks are performed in a virtual space by users of VR devices 11, generated by the analysis means 13D of the task analysis apparatus 13. In the example shown in Fig. 2, the analysis means 13D generates trajectories of the positions at which multiple tasks are performed in a virtual space by each of the users of multiple VR devices 11. In other words, Fig. 2 shows multiple trajectories corresponding to the users of multiple VR devices 11.
[0023] In order for the analysis means 13D of the work analysis device 13 to generate multiple trajectories as shown in FIG. 2 , first, a first user of the VR device 11 performs multiple tasks in the virtual space, and the movement detection means 11B of the VR device 11 detects the movements of the first user of the VR device 11 performing the multiple tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the movements of the first user of the VR device 11 performing the multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11. The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the first user of the VR device 11 from the data indicating the movements of the first user of the VR device 11 performing the multiple tasks in the virtual space acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 generates trajectories of the positions at which the first user of the VR device 11 performs the multiple tasks in the virtual space, based on the time-series data of the movements of the first user of the VR device 11 stored in the storage means 13C.
[0024] After the first user of the VR device 11 performs multiple tasks in the virtual space, the second and subsequent users of the VR device 11 perform multiple tasks in the virtual space, and the movement detection means 11B of the VR device 11 detects the movements of the second and subsequent users of the VR device 11 performing the multiple tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the movements of the second and subsequent users of the VR device 11 performing the multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11. The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the second and subsequent users of the VR device 11 from the data indicating the movements of the second and subsequent users of the VR device 11 performing the multiple tasks in the virtual space, acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 generates a trajectory of the positions at which the second and subsequent users of the VR device 11 perform multiple tasks in the virtual space based on the time series data of the actions of the second and subsequent users of the VR device 11 stored in the memory means 13C.
[0025] As a result, multiple trajectories are generated as shown in Fig. 2. In the example shown in Fig. 2, the analysis means 13D of the task analysis device 13 compares the trajectory of the positions at which multiple tasks are performed in the virtual space by one user of the VR device 11 (i.e., one of the multiple trajectories shown in Fig. 2) with the trajectories of the positions at which multiple tasks are performed in the virtual space by another user of the VR device 11 (i.e., another of the multiple trajectories shown in Fig. 2). Therefore, in the examples shown in Figs. 1 and 2, the optimal procedure for performing multiple tasks can be efficiently found.
[0026] To more efficiently find the optimal procedure for performing multiple tasks, in one example of the task analysis system 1 of the first embodiment, a right-handed user of the VR device 11 performs multiple tasks in a virtual space, and the motion detection means 11B of the VR device 11 detects the motions of the right-handed user of the VR device 11 performing the multiple tasks in the virtual space. The acquisition means 13B of the task analysis apparatus 13 acquires data indicating the motions of the right-handed user of the VR device 11 performing the multiple tasks in the virtual space, detected by the motion detection means 11B of the VR device 11. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 is right-handed or left-handed (in this example, information that the user of the VR device 11 is right-handed). The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the right-handed user of the VR device 11 from data acquired by the acquisition means 13B indicating the movements of the right-handed user of the VR device 11 as they perform multiple tasks in the virtual space. The analysis means 13D of the work analysis device 13 generates trajectories of the positions at which the right-handed user of the VR device 11 performs multiple tasks in the virtual space, based on the time-series data of the movements of the right-handed user of the VR device 11 stored in the storage means 13C.
[0027] When a right-handed user of the VR device 11 is not performing multiple tasks in the virtual space, a left-handed user of the VR device 11 performs multiple tasks in the virtual space, and the movement detection means 11B of the VR device 11 detects the movements of the left-handed user of the VR device 11 performing multiple tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the movements of the left-handed user of the VR device 11 performing multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 is right-handed or left-handed (in this example, information that the user of the VR device 11 is left-handed). The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the left-handed user of the VR device 11 from data acquired by the acquisition means 13B indicating the movements of the left-handed user of the VR device 11 as they perform multiple tasks in the virtual space. The analysis means 13D of the work analysis device 13 generates trajectories of the positions at which the left-handed user of the VR device 11 performs multiple tasks in the virtual space, based on the time-series data of the movements of the left-handed user of the VR device 11 stored in the storage means 13C.
[0028] The analysis means 13D of the work analysis device 13 compares the trajectory of the positions at which multiple tasks are performed in the virtual space by a right-handed user of the VR device 11 with the trajectory of the positions at which multiple tasks are performed in the virtual space by a left-handed user of the VR device 11. As a result, the analysis means 13D can determine that the optimal procedure for a right-handed user of the VR device 11 to perform multiple tasks differs from the optimal procedure for a left-handed user of the VR device 11 to perform multiple tasks (in other words, that it is preferable to prepare different work manuals for right-handed workers and left-handed workers), etc.
[0029] In another example of the work analysis system 1 according to the first embodiment, to more efficiently find the optimal procedure for performing multiple tasks, a skilled user (exemplifier) of the VR device 11 performs multiple tasks in a virtual space, and the movement detection means 11B of the VR device 11 detects the movements of the skilled user of the VR device 11 performing the multiple tasks in the virtual space. The acquisition means 13B of the work analysis apparatus 13 acquires data indicating the movements of the skilled user of the VR device 11 performing the multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has the skill (in this example, information indicating that the user of the VR device 11 has the skill). The storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the movements of the skilled user of the VR device 11 from the data indicating the movements of the skilled user of the VR device 11 performing the multiple tasks in the virtual space acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 generates a trajectory of the positions at which a user of a VR device 11 with skills performs multiple tasks in a virtual space, based on time series data of the actions of the user of the VR device 11 with skills stored in the memory means 13C.
[0030] When a skilled user of the VR device 11 is not performing multiple tasks in the virtual space, a user of the VR device 11 (other person) who does not have the skills performs multiple tasks in the virtual space, and the movement detection means 11B of the VR device 11 detects the movements of the unskilled user of the VR device 11 performing multiple tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the movements of the unskilled user of the VR device 11 performing multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has skills (in this example, information indicating that the user of the VR device 11 does not have skills). The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the unskilled user of the VR device 11 from the data indicating the movements of the unskilled user of the VR device 11 performing multiple tasks in the virtual space acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 generates a trajectory of the positions at which a user of the VR device 11 without skills performs multiple tasks in a virtual space based on time series data of the actions of the user of the VR device 11 without skills stored in the memory means 13C.
[0031] The analysis means 13D of the work analysis device 13 compares the trajectory of the positions at which a skilled user of the VR device 11 performs multiple tasks in the virtual space with the trajectory of the positions at which a non-skilled user of the VR device 11 performs multiple tasks in the virtual space. Therefore, by using the analysis results by the analysis means 13D, it is possible to identify areas where guidance is needed for non-skilled users. In detail, Figure 2 shows the trajectory of the positions at which a skilled user of the VR device 11 performs multiple tasks in the virtual space with different line types from the trajectory of the positions at which a non-skilled user of the VR device 11 performs multiple tasks in the virtual space. As shown in Figure 2, by performing an analysis using the analysis means 13D of the work analysis device 13, it is possible to understand, for example, that the trajectory of the position at which a user of a VR device 11 with skills performs multiple tasks in a virtual space (the trajectory shown as "exemplar" in Figure 2) is significantly different from the trajectory of the position at which a user of a VR device 11 with no skills performs multiple tasks in a virtual space (the trajectory shown as "others" in Figure 2).
[0032] Fig. 3 is a diagram illustrating an example of extracting a trajectory satisfying a predetermined condition from the multiple trajectories shown in Fig. 2. In detail, Fig. 3(A) shows a state in which a trajectory of the position where each of multiple users of a VR device 11 with skills performs multiple tasks in a virtual space is extracted from the multiple trajectories shown in Fig. 2 (i.e., the trajectories of the positions where each of multiple users of a VR device 11 with skills performs multiple tasks in a virtual space, and the trajectories of the positions where each of multiple users of a VR device 11 with no skills performs multiple tasks in a virtual space), and which satisfies a first condition described below. Fig. 3(B) shows an enlarged portion of Fig. 3(A).
[0033] In the example shown in Figure 3, first, similar to the example shown in Figure 2, the analysis means 13D of the work analysis apparatus 13 generates trajectories of the positions where each of multiple users of the VR device 11 with skills performs multiple tasks in the virtual space (trajectories indicated by "exemplifier" in Figure 2). The analysis means 13D also generates trajectories of the positions where each of multiple users of the VR device 11 with no skills performs multiple tasks in the virtual space (trajectories indicated by "others" in Figure 2). Furthermore, the analysis means 13D extracts trajectories that satisfy the first condition from the trajectories of multiple users of the VR device 11 with skills (trajectories indicated by "exemplifier" in Figure 2), and visualizes them as shown in Figure 3(A). Trajectories that satisfy the first condition include a trajectory in which a user of a VR device 11 with skills first performs task DS1, and a trajectory in which a user of a VR device 11 with skills first performs task FC1 and then performs task DS1.
[0034] 3(A) , which satisfies the first condition, each of multiple users (exemplifiers) of the skilled VR device 11 performs multiple tasks in the virtual space, and the motion detection means 11B of the VR device 11 detects the motions of each of the multiple users of the skilled VR device 11 performing the multiple tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the motions of each of the multiple users of the skilled VR device 11 performing the multiple tasks in the virtual space, detected by the motion detection means 11B of the VR device 11. The storage means 13C of the work analysis device 13 generates and stores time-series data of the motions of each of the multiple users of the skilled VR device 11 from the data acquired by the acquisition means 13B indicating the motions of each of the multiple users of the skilled VR device 11 performing the multiple tasks in the virtual space.
[0035] The analysis means 13D of the work analysis device 13 generates trajectories of the positions where each of the skilled VR device 11 users performs multiple tasks in the virtual space based on the time-series data of the actions of each of the skilled VR device 11 users stored in the storage means 13C. Furthermore, the analysis means 13D extracts and visualizes trajectories (trajectories shown in FIGS. 3A and 3B) that satisfy the first condition described above from the trajectories of the skilled VR device 11 users (trajectories indicated by "exemplary" in FIG. 2 ). Specifically, the trajectories of the positions where each of the skilled VR device 11 users performs multiple tasks by the skilled VR device 11 user who first performs task DS1, and the trajectories of the positions where each of the skilled VR device 11 users performs task FC1 first and task DS1 second. In the example shown in FIG. 3B , the thicker the lines, the greater the number of applicable trajectories. In the example shown in FIG. 3, the tendency of the locus that satisfies the first condition described above can be grasped by using the analysis results by the analysis means 13D.
[0036] FIG. 4 is a diagram illustrating an example of the second condition used to extract a trajectory from the multiple trajectories shown in FIG. 2 . In the example shown in FIG. 4 , first, similar to the example shown in FIG. 2 , the analysis unit 13D of the work analysis device 13 generates trajectories of the positions where multiple users of the VR device 11 with skills perform multiple tasks in the virtual space (trajectories indicated by "exemplifier" in FIG. 2 ). The analysis unit 13D also generates trajectories of the positions where multiple users of the VR device 11 without skills perform multiple tasks in the virtual space (trajectories indicated by "other" in FIG. 2 ). Furthermore, the analysis unit 13D extracts trajectories that satisfy the second condition from the trajectories of multiple users of the VR device 11 with skills (trajectories indicated by "exemplifier" in FIG. 2 ), and visualizes them in a table format as shown in FIG. 4 . Trajectories that satisfy the second condition include a trajectory in which a skilled user of a VR device 11 first performs task DS1, then performs task DS2, then performs task PS1, and then performs task TR5, a trajectory in which a skilled user of a VR device 11 first performs task TR2, then performs task TR4, then performs task PS2, and then performs task TR6, and a trajectory in which a skilled user of a VR device 11 first performs task TR1, then performs task TR3, then performs task PS3, and then performs task TR7 or task TR8, respectively.
[0037] 4 , in order for the analysis means 13D of the work analysis device 13 to extract a trajectory that satisfies the second condition, each of multiple users (exemplifiers) of the skilled VR device 11 performs multiple tasks in the virtual space, and the movement detection means 11B of the VR device 11 detects the movements of each of the multiple users of the skilled VR device 11 performing the multiple tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the movements of each of the multiple users of the skilled VR device 11 performing the multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11. The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of each of the multiple users of the skilled VR device 11 from the data acquired by the acquisition means 13B indicating the movements of each of the multiple users of the skilled VR device 11 performing the multiple tasks in the virtual space.
[0038] The analysis means 13D of the work analysis device 13 generates a trajectory of the positions at which each of the multiple users of the VR device 11 with skills performs multiple tasks in a virtual space, based on time series data of the movements of each of the multiple users of the VR device 11 with skills stored in the memory means 13C. Furthermore, the analysis means 13D extracts trajectories that satisfy the second condition described above, that is, that the tendency of the order of task completion is the same, from the trajectories of multiple users of the VR device 11 with skills (trajectories indicated as "exemplars" in Figure 2) (more specifically, a trajectory in which a user of the VR device 11 with skills performs task DS1 first, task DS2 second, task PS1 third, and task TR5 fourth, a trajectory in which a user of the VR device 11 with skills performs task TR2 first, task TR4 second, task PS2 third, and task TR6 fourth, and a trajectory in which a user of the VR device 11 with skills performs task TR1 first, task TR3 second, task PS3 third, and task TR7 or task TR8 fourth), and groups and compiles the extracted trajectories into tabular data as shown in Figure 4. In the example shown in FIG. 4, by using the analysis results by the analysis means 13D, it is possible to group together trajectories that satisfy the second condition that the tendency of the order in which tasks are performed is the same.
[0039] 5 is a diagram illustrating an example of the results of an analysis performed by the analysis means 13D of the work analysis device 13. In the example shown in FIG. 5, a first user (first model) of the VR device 11 with skills performs multiple tasks in a virtual space, and the movement detection means 11B of the VR device 11 detects the movements of the first user of the VR device 11 performing the multiple tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the movements of the first user of the VR device 11 with skills, detected by the movement detection means 11B of the VR device 11, performing the multiple tasks in the virtual space. The acquisition means 13B also acquires information indicating whether the first user of the VR device 11 has the skill (in this example, information indicating that the first user of the VR device 11 has the skill). The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the first user of the VR device 11 with skills from data indicating the movements of the first user of the VR device 11 with skills performing multiple tasks in a virtual space, acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 generates a trajectory of the positions at which the first user of the VR device 11 with skills performs multiple tasks in a virtual space, based on the time-series data of the movements of the first user of the VR device 11 with skills stored in the storage means 13C.
[0040] When a first user of the VR device 11 having a skill is not performing multiple tasks in the virtual space, a second or subsequent user of the VR device 11 having a skill (second or subsequent modellers) performs multiple tasks in the virtual space, and the movement detection means 11B of the VR device 11 detects the movements of the second or subsequent user of the VR device 11 performing multiple tasks in the virtual space. The acquisition means 13B of the work analysis apparatus 13 acquires data indicating the movements of the second or subsequent user of the VR device 11 having a skill, detected by the movement detection means 11B of the VR device 11, performing multiple tasks in the virtual space. The acquisition means 13B also acquires information indicating whether the second or subsequent user of the VR device 11 has a skill (in this example, information that the second or subsequent user of the VR device 11 has a skill). The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the second and subsequent users of the skilled VR device 11 from data acquired by the acquisition means 13B indicating the movements of the second and subsequent users of the skilled VR device 11 as they perform multiple tasks in a virtual space. The analysis means 13D of the work analysis device 13 generates trajectories of the positions at which the second and subsequent users of the skilled VR device 11 perform multiple tasks in a virtual space, based on the time-series data of the movements of the second and subsequent users of the skilled VR device 11 stored in the storage means 13C.
[0041] In the example shown in Figure 5, the analysis means 13D analyzes that multiple users (first user and second and subsequent users) of the VR device 11 with skills performed tasks DS1, TR2, and TR1 as first tasks (first task group). The analysis means 13D also analyzes that multiple users of the VR device 11 with skills performed tasks DS2, TR4, and TR3 as second tasks (second task group). The analysis means 13D also analyzes that multiple users of the VR device 11 with skills performed tasks PS1, PS2, and PS3 as third tasks (third task group). The analysis means 13D also analyzes that multiple users of the VR device 11 with skills performed tasks TR5, TR6, TR7, and TR8 as fourth tasks (fourth task group). The analysis means 13D also analyzes that multiple users of the VR device 11 with skills performed tasks DS3, TR10, and TR9 as the fifth task (fifth task group). The analysis means 13D also analyzes that multiple users of the VR device 11 with skills performed tasks SP2, SP1, TR18, TR19, TR16, and TR17 as the sixth task (sixth task group).
[0042] The analysis means 13D analyzes that multiple users of the VR device 11 with skills performed tasks PL5, TR15, and DR3 as the seventh task (seventh task group). The analysis means 13D also analyzes that multiple users of the VR device 11 with skills performed at least one of multiple tasks, such as task SP4, task TR14, task PL4, task PS2, task PL3, and task PS1, as the eighth task (eighth task group). The analysis means 13D also analyzes that multiple users of the VR device 11 with skills performed tasks DL1, FS1, TR28, and TR30 as the ninth task (ninth task group). The analysis means 13D also analyzes that multiple users of the VR device 11 with skills performed tasks DL2, FS2, TR31, and TR32 as the tenth task (tenth task group). Furthermore, the analysis means 13D analyzes that multiple users of the VR device 11 with skills performed task DL3, task FS3, task TR33, task TR35, task TR43, task TR44, task TR41, task TR42, task TR29 and task TR34 as the 11th task (11th task group).
[0043] In detail, in the example shown in Figure 5, the analysis means 13D extracts the performance position of task DS1 from the trajectories of multiple users (first user and second and subsequent users) of the VR device 11 who have skills as the performance position of the first task in the trajectory that accounts for a predetermined percentage (e.g., 50%) or more, and extracts the performance position of any of tasks TR41, TR42, TR43, and TR44 as the performance position of the last task in the trajectory that accounts for a predetermined percentage (e.g., 50%) or more.
[0044] In the example shown in Figure 5, the acquisition means 13B of the work analysis device 13 does not acquire information indicating whether the user of the VR device 11 is right-handed or left-handed, but in other examples, the acquisition means 13B of the work analysis device 13 may acquire information indicating whether the user of the VR device 11 is right-handed or left-handed.
[0045] In this example, each of multiple skilled right-handed users of the VR device 11 performs multiple tasks in the virtual space, and the movement detection means 11B of the VR device 11 detects the movements of each of the multiple skilled right-handed users of the VR device 11 performing the multiple tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the movements of each of the multiple skilled right-handed users of the VR device 11 performing the multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11. The acquisition means 13B also acquires information indicating whether each of the multiple skilled users of the VR device 11 is right-handed (in this example, information that each of the multiple skilled users of the VR device 11 is right-handed). The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of each of the multiple skilled right-handed users of the VR device 11 from data indicating the movements of each of the multiple skilled right-handed users of the VR device 11 as they perform multiple tasks in a virtual space, as acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 generates trajectories of the positions at which each of the multiple skilled right-handed users of the VR device 11 performs multiple tasks in a virtual space, based on the time-series data of the movements of each of the multiple skilled right-handed users of the VR device 11 stored in the storage means 13C. Furthermore, the analysis means 13D extracts the positions at which the first task was performed and the positions at which the last task was performed from the trajectories of the multiple skilled right-handed users of the VR device 11 that account for a predetermined percentage (e.g., 50%) or more of the trajectories.
[0046] In this example, each of a plurality of skilled left-handed users of the VR device 11 performs a plurality of tasks in the virtual space, and the motion detection means 11B of the VR device 11 detects the motions of each of the skilled left-handed users of the VR device 11 performing the plurality of tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the motions of each of the skilled left-handed users of the VR device 11 performing the plurality of tasks in the virtual space, detected by the motion detection means 11B of the VR device 11. The acquisition means 13B also acquires information indicating whether each of the skilled users of the VR device 11 is left-handed (in this example, information that each of the skilled users of the VR device 11 is left-handed). The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of each of the multiple skilled left-handed users of the VR device 11 from data indicating the movements of each of the multiple skilled left-handed users of the VR device 11 as they perform multiple tasks in the virtual space, as acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 generates trajectories of the positions at which each of the multiple skilled left-handed users of the VR device 11 performs multiple tasks in the virtual space, based on the time-series data of the movements of each of the multiple skilled left-handed users of the VR device 11 stored in the storage means 13C. Furthermore, the analysis means 13D extracts the positions at which the first task was performed and the positions at which the last task was performed from the trajectories of the multiple skilled left-handed users of the VR device 11 that account for a predetermined percentage (e.g., 50%) or more of the trajectories. In other words, in this example, it is possible to distinguish and efficiently search for the optimal procedure for a skilled right-handed user of the VR device 11 and the optimal procedure for a skilled left-handed user of the VR device 11.
[0047] 5, the acquisition means 13B of the work analysis device 13 does not acquire information indicating the correct performance order, which is the correct performance order of multiple tasks for a pre-specified task, but in other examples, the acquisition means 13B of the work analysis device 13 may acquire information indicating the correct performance order. In this example, the storage means 13C of the work analysis device 13 stores the information indicating the correct performance order acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 determines whether the performance order of multiple tasks performed in the virtual space by the user of the VR device 11 matches the correct performance order.
[0048] Fig. 6 is a diagram showing an example of a correct performance order indicated by information acquired by the acquisition means 13B of the work analysis device 13. In the example shown on the far left of Fig. 6, the correct performance order for the four tasks (task DL1, task FS1, task TR28, and task TR30) included in the ninth task group shown in Fig. 5 is set to the order of task DL1 → task FS1 → task TR28 or task TR30. In the example shown second from the left in Fig. 6, the correct performance order for the four tasks (task DL2, task FS2, task TR31, and task TR32) included in the tenth task group shown in Fig. 5 is set to the order of task DL2 → task FS2 → task TR31 or task TR32. In the example shown third from the left in Figure 6, the correct order of performing the 10 tasks (task DL3, task FS3, task TR33, task TR35, task TR43, task TR44, task TR41, task TR42, task TR29 and task TR34) included in the 11th task group shown in Figure 5 is set to one of the following orders: task DL3 → task FS3 → task TR33, task TR35, task TR43, task TR44, task TR41, task TR42, task TR29 and task TR34.
[0049] In the example shown third from the right in Fig. 6, the correct performance order for the three tasks (task DS1, task TR2, and task TR1) included in the first task group shown in Fig. 5 is set to task DS1 → task TR1 or task TR2. In the example shown second from the right in Fig. 6, the correct performance order for the three tasks (task DS2, task TR4, and task TR3) included in the second task group shown in Fig. 5 is set to task DS2 → task TR3 or task TR4. In the example shown on the far right in Fig. 6, the correct performance order for the three tasks (task DS3, task TR10, and task TR9) included in the fifth task group shown in Fig. 5 is set to task DS3 → task TR9 or task TR10.
[0050] In the example shown in FIG. 6, the acquisition means 13B of the work analysis device 13 acquires information indicating the correct execution order of the tasks from task DL1 onwards (the order of task DL1 → task FS1 → task TR28 or task TR30) among the multiple tasks of the assignment (the multiple tasks included in the first to eleventh task groups shown in FIG. 5), information indicating the correct execution order of the tasks from task DL2 onwards (the order of task DL2 → task FS2 → task TR31 or task TR32), and information indicating the correct execution order of the tasks from task DL3 onwards (task DL3 → task FS3 → task TR The information indicating the correct order of tasks from task DS1 onwards (the order of task DS1 → task TR1 or task TR2) is obtained. The information indicating the correct order of tasks from task DS2 onwards (the order of task DS2 → task TR3 or task TR4) is obtained. The information indicating the correct order of tasks from task DS3 onwards (the order of task DS3 → task TR9 or task TR10) is obtained.
[0051] The storage means 13C of the work analysis device 13 stores information indicating the correct performance order (the order of task DL1 → task FS1 → task TR28 or task TR30) acquired by the acquisition means 13B, information indicating the correct performance order (the order of task DL2 → task FS2 → task TR31 or task TR32), information indicating the correct performance order (the order of task DL3 → task FS3 → any of task TR33, task TR35, task TR43, task TR44, task TR41, task TR42, task TR29 and task TR34), information indicating the correct performance order (the order of task DS1 → task TR1 or task TR2), information indicating the correct performance order (the order of task DS2 → task TR3 or task TR4), and information indicating the correct performance order (the order of task DS3 → task TR9 or task TR10).
[0052] The analysis means 13D of the task analysis apparatus 13 determines whether the order in which the user of the VR device 11 performs task DL1 and subsequent tasks in the virtual space matches the correct order (task DL1 → task FS1 → task TR28 or task TR30). The analysis means 13D also determines whether the order in which the user of the VR device 11 performs task DL2 and subsequent tasks in the virtual space matches the correct order (task DL2 → task FS2 → task TR31 or task TR32). The analysis means 13D also determines whether the order in which the user of the VR device 11 performs task DL3 and subsequent tasks in the virtual space matches the correct order (task DL3 → task FS3 → task TR33, task TR35, task TR43, task TR44, task TR41, task TR42, task TR29, or task TR34).
[0053] The analysis means 13D determines whether the order in which the user of the VR device 11 performs multiple tasks from task DS1 onwards in the virtual space matches the correct order (task DS1 → task TR1 or task TR2). The analysis means 13D also determines whether the order in which the user of the VR device 11 performs multiple tasks from task DS2 onwards in the virtual space matches the correct order (task DS2 → task TR3 or task TR4). The analysis means 13D also determines whether the order in which the user of the VR device 11 performs multiple tasks from task DS3 onwards in the virtual space matches the correct order (task DS3 → task TR9 or task TR10). In other words, in the example shown in FIG. 6 , the analysis results by the analysis means 13D can be used to determine whether the correct order is being observed in each of the multiple task groups.
[0054] 7 is a diagram showing an example of the results of a determination as to whether the order in which a plurality of tasks performed in a virtual space by a user of a VR device 11 matches the correct order of tasks. In detail, FIG. 7 shows the results of a determination as to whether the order in which each of 22 skilled users of a VR device 11 (shown as "exemplary" in FIG. 7) performs a plurality of tasks in a virtual space matches the correct order of tasks, and the results of a determination as to whether the order in which each of 10 unskilled users of a VR device 11 (shown as "others" in FIG. 7) performs a plurality of tasks in a virtual space matches the correct order of tasks.
[0055] 7 , to obtain the determination result shown in FIG. 7 , the acquisition means 13B of the work analysis device 13 acquires information indicating whether the user of the VR device 11 has a skill, and acquires data indicating the actions of the user of the VR device 11 who has the skill detected by the VR device 11, performing multiple tasks in a virtual space. The storage means 13C of the work analysis device 13 generates and stores time-series data of the actions of the user of the VR device 11 who has the skill from the data indicating the actions of the user of the VR device 11 who has the skill performing multiple tasks in a virtual space acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 determines whether the order in which the user of the VR device 11 who has the skill performs multiple tasks in the virtual space matches the correct order of performance. 7, the adherence rates for the correct execution order are obtained for each of the 22 users of the VR device 11 who have the skills indicated by ID "0001," ID "0002," ID "0003," ID "0004," ID "0005," ID "0006," ID "0007," ID "0015," ID "0016," ID "0017," ID "0018," ID "0020," ID "0021," ID "0029," ID "0030," ID "0031," ID "0032," ID "0033," ID "0034," and ID "1001." The average adherence rate for the correct execution order for the 22 users of the VR device 11 who have the skills is 89%.
[0056] Furthermore, the acquisition means 13B of the work analysis device 13 acquires information indicating whether the user of the VR device 11 has skills, and acquires data indicating the actions of the unskilled VR device 11 user performing multiple tasks in the virtual space, as detected by the VR device 11. The storage means 13C of the work analysis device 13 generates and stores time-series data of the actions of the unskilled VR device 11 user from the data indicating the actions of the unskilled VR device 11 user performing multiple tasks in the virtual space acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 determines whether the order in which the unskilled VR device 11 user performs multiple tasks in the virtual space matches the correct order of performance. 7, the adherence rate of the correct execution order for each of the 10 users of the VR device 11 without skills, indicated by ID "1002", ID "1003", ID "1004", ID "1005", ID "1006", ID "1007", ID "1008", ID "1009", ID "1010", and ID "1011", is obtained. The average adherence rate of the correct execution order for the 10 users of the VR device 11 without skills is 23%.
[0057] The analysis means 13D compares the result of the determination as to whether the order in which a plurality of tasks performed in the virtual space by a skilled user of the VR device 11 matches the correct order with the result of the determination as to whether the order in which a plurality of tasks performed in the virtual space by a user of the VR device 11 who does not have skills matches the correct order. The analysis means 13D generates a comparison result indicating that the average rate of adherence to the correct order for the 22 skilled users of the VR device 11 is 3.87 times the average rate of adherence to the correct order for the 10 unskilled users of the VR device 11.
[0058] In the example shown in Figure 7, the acquisition means 13B of the work analysis device 13 does not acquire information indicating whether the user of the VR device 11 is right-handed or left-handed, but in other examples, the acquisition means 13B of the work analysis device 13 may acquire information indicating whether the user of the VR device 11 is right-handed or left-handed.
[0059] In this example, the acquisition means 13B of the work analysis device 13 acquires information indicating whether the user of the VR device 11 is right-handed or left-handed, and acquires data indicating the movements of the right-handed VR device 11 user performing multiple tasks in the virtual space, as detected by the VR device 11. The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the right-handed VR device 11 user from the data indicating the movements of the right-handed VR device 11 user performing multiple tasks in the virtual space acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 determines whether the order in which the right-handed VR device 11 user performs the multiple tasks in the virtual space matches the correct order of performance.
[0060] The acquisition means 13B also acquires information indicating whether the user of the VR device 11 is right-handed or left-handed, and acquires data indicating the movements of the left-handed user of the VR device 11 as they perform multiple tasks in the virtual space, as detected by the VR device 11. The storage means 13C generates and stores time-series data of the movements of the left-handed user of the VR device 11 from the data indicating the movements of the left-handed user of the VR device 11 as they perform multiple tasks in the virtual space acquired by the acquisition means 13B. The analysis means 13D determines whether the order in which the left-handed user of the VR device 11 performs the multiple tasks in the virtual space matches the correct order. Furthermore, the analysis means 13D compares the result of the determination of whether the order in which the right-handed user of the VR device 11 performs the multiple tasks in the virtual space matches the correct order with the result of the determination of whether the order in which the left-handed user of the VR device 11 performs the multiple tasks in the virtual space matches the correct order.
[0061] 8 is a diagram showing an example of the results of determining, for each work performance position, whether the order in which a user of the VR device 11 performs a plurality of tasks in a virtual space matches the correct order of tasks. In detail, FIG. 8 compares the results of determining, for each work performance position, whether the order in which a user of the VR device 11 with skills performs a plurality of tasks in a virtual space matches the correct order of tasks, with the results of determining, for each work performance position, whether the order in which a user of the VR device 11 without skills performs a plurality of tasks in a virtual space matches the correct order of tasks.
[0062] In the example shown on the far left of Figure 8, the analysis means 13D of the task analysis apparatus 13 determines whether the order in which multiple skilled VR device 11 users (shown as "exemplars" in Figure 8) perform the tasks starting with task DL1 in the virtual space matches the correct order (task DL1 → task FS1 → task TR28 or task TR30), and obtains a determination result indicating that the order in which approximately 78% of skilled VR device 11 users perform the tasks starting with task DL1 in the virtual space matches the correct order. The analysis means 13D also determines whether the order in which unskilled VR device 11 users (shown as "others" in Figure 8) perform the tasks starting with task DL1 in the virtual space matches the correct order, and obtains a determination result indicating that the order in which approximately 10% of unskilled VR device 11 users perform the tasks starting with task DL1 in the virtual space matches the correct order.
[0063] 8 , the analysis means 13D determines whether the order in which multiple tasks from task DL2 onward performed in the virtual space by multiple skilled users of the VR device 11 matches the correct order (task DL2 → task FS2 → task TR31 or task TR32), and obtains a determination result indicating that the order in which the multiple tasks from task DL2 onward performed in the virtual space by approximately 96% of skilled users of the VR device 11 matches the correct order. Furthermore, the analysis means 13D determines whether the order in which multiple tasks from task DL2 onward performed in the virtual space by multiple unskilled users of the VR device 11 matches the correct order, and obtains a determination result indicating that the order in which the multiple tasks from task DL2 onward performed in the virtual space by approximately 20% of unskilled users of the VR device 11 match the correct order.
[0064] In the example shown third from the left in Figure 8, the analysis means 13D determines whether the order in which multiple tasks from task DL3 onwards are performed in the virtual space by multiple users of the VR device 11 with skills matches the correct order of performance (any of the following orders: task DL3 → task FS3 → task TR33, task TR35, task TR43, task TR44, task TR41, task TR42, task TR29 and task TR34), and obtains a determination result that the order in which multiple tasks from task DL3 onwards are performed in the virtual space by approximately 82% of users of the VR device 11 with skills matches the correct order of performance. In addition, the analysis means 13D determines whether the order in which multiple tasks from task DL3 onwards are performed in the virtual space by multiple users of the VR device 11 who do not have skills matches the correct order of performance, and obtains a determination result that the order in which multiple tasks from task DL2 onwards are performed in the virtual space by approximately 10% of users of the VR device 11 who do not have skills matches the correct order of performance.
[0065] 8 , the analysis means 13D determines whether the order in which tasks from task DS1 onward performed in the virtual space by multiple skilled users of the VR device 11 matches the correct order (task DS1 → task TR1 or task TR2), and obtains a determination result indicating that the order in which tasks from task DS1 onward performed in the virtual space by approximately 96% of skilled users of the VR device 11 matches the correct order. Furthermore, the analysis means 13D determines whether the order in which tasks from task DS1 onward performed in the virtual space by multiple unskilled users of the VR device 11 matches the correct order, and obtains a determination result indicating that the order in which tasks from task DS1 onward performed in the virtual space by approximately 30% of unskilled users of the VR device 11 matches the correct order.
[0066] 8 , the analysis means 13D determines whether the order in which tasks from task DS2 onward performed in the virtual space by multiple skilled users of the VR device 11 matches the correct order (task DS2 → task TR3 or task TR4), and obtains a determination result indicating that the order in which tasks from task DS2 onward performed in the virtual space by approximately 91% of skilled users of the VR device 11 matches the correct order. Furthermore, the analysis means 13D determines whether the order in which tasks from task DS2 onward performed in the virtual space by multiple unskilled users of the VR device 11 matches the correct order, and obtains a determination result indicating that the order in which tasks from task DS2 onward performed in the virtual space by approximately 50% of unskilled users of the VR device 11 matches the correct order.
[0067] 8 , the analysis means 13D determines whether the order in which tasks from task DS3 onward performed in the virtual space by multiple skilled users of the VR device 11 matches the correct order (task DS3 → task TR9 or task TR10), and obtains a determination result indicating that the order in which tasks from task DS3 onward performed in the virtual space by approximately 96% of skilled users of the VR device 11 matches the correct order. Furthermore, the analysis means 13D determines whether the order in which tasks from task DS3 onward performed in the virtual space by multiple unskilled users of the VR device 11 matches the correct order, and obtains a determination result indicating that the order in which tasks from task DS3 onward performed in the virtual space by approximately 20% of unskilled users of the VR device 11 matches the correct order.
[0068] In other words, in the example shown in Figure 8, the analysis means 13D determines whether the order in which multiple tasks are performed in the virtual space by the user of the VR device 11 matches the correct order for each task performance location (i.e., for each of the tasks from task DL1 onwards, the tasks from task DL2 onwards, the tasks from task DL3 onwards, the tasks from task DS1 onwards, the tasks from task DS2 onwards, and the tasks from task DS3 onwards).
[0069] In detail, in the example shown in FIG. 8 , the acquisition means 13B acquires information indicating whether the user of the VR device 11 has a skill, and acquires data indicating the actions of the user of the VR device 11 who has the skill detected by the VR device 11, performing multiple tasks in a virtual space. The storage means 13C generates and stores time-series data of the actions of the user of the VR device 11 who has the skill from the data indicating the actions of the user of the VR device 11 who has the skill performing multiple tasks in a virtual space acquired by the acquisition means 13B. The analysis means determines, for each task performance position, whether the performance order of the multiple tasks performed by the user of the VR device 11 who has the skill matches the correct performance order. Furthermore, the acquisition means 13B acquires information indicating whether the user of the VR device 11 has a skill, and acquires data indicating the actions of the user of the VR device 11 who does not have the skill detected by the VR device 11, performing multiple tasks in a virtual space. The storage means 13C generates and stores time-series data of the actions of the user of the VR device 11 who does not have skills from data acquired by the acquisition means 13B indicating the actions of the user of the VR device 11 who does not have skills performing multiple tasks in the virtual space. The analysis means 13D determines whether the order in which the user of the VR device 11 who does not have skills performs multiple tasks in the virtual space matches the correct order of tasks for each task performance position.
[0070] Furthermore, as shown in Fig. 8, the analysis means 13D compares, for each task performance position, the determination result of whether the order in which a skilled user of the VR device 11 performs a plurality of tasks in the virtual space matches the correct performance order with the determination result of whether the order in which a skilled user of the VR device 11 performs a plurality of tasks in the virtual space matches the correct performance order. As a result, in the example shown in Fig. 8, the analysis means 13D obtains an analysis result indicating that, even for a skilled user of the VR device 11, the rate of compliance with the correct performance order is low for the task performance positions from task DL1 onwards and the task performance positions from task DL3 onwards.
[0071] In the example shown in Figure 8, the acquisition means 13B of the work analysis device 13 does not acquire information indicating whether the user of the VR device 11 is right-handed or left-handed, but in other examples, the acquisition means 13B of the work analysis device 13 may acquire information indicating whether the user of the VR device 11 is right-handed or left-handed.
[0072] In this example, the acquisition means 13B of the work analysis device 13 acquires information indicating whether the user of the VR device 11 is right-handed or left-handed, and acquires data indicating the movements of the right-handed user of the VR device 11, detected by the VR device 11, as they perform multiple tasks in the virtual space. The storage means 13C generates and stores time-series data of the movements of the right-handed user of the VR device 11 from the data indicating the movements of the right-handed user of the VR device 11 performing multiple tasks in the virtual space acquired by the acquisition means 13B. The analysis means 13D determines, for each task performance position, whether the order in which the right-handed user of the VR device 11 performs multiple tasks in the virtual space matches the correct performance order. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 is right-handed or left-handed, and acquires data indicating the movements of the left-handed user of the VR device 11, detected by the VR device 11, as they perform multiple tasks in the virtual space. The storage means 13C generates and stores time-series data of the actions of the left-handed user of the VR device 11 from data acquired by the acquisition means 13B indicating the actions of the left-handed user of the VR device 11 performing multiple tasks in the virtual space. The analysis means 13D determines, for each task performance position, whether the performance order of the multiple tasks performed by the left-handed user of the VR device 11 in the virtual space matches the correct performance order.
[0073] 9 is a diagram showing an example of utilizing the tendency of the order in which multiple tasks are performed in a virtual space by users of the VR device 11 and the rate of adherence to the correct order. In the example shown in Fig. 9, the analysis means 13D of the work analysis apparatus 13 determines whether the order in which multiple tasks are performed in a virtual space by each of multiple users of the VR device 11 matches the correct order.
[0074] Specifically, as in the example shown in Figure 8, the analysis means 13D determines whether the order in which the user of the VR device 11 performs multiple tasks in the virtual space matches the correct order (the order of task DL1 → task FS1 → task TR28 or task TR30), determines whether the order in which the user of the VR device 11 performs multiple tasks in the virtual space matches the correct order (the order of task DL2 → task FS2 → task TR31 or task TR32), and determines whether the order in which the user of the VR device 11 performs multiple tasks in the virtual space matches the correct order (the order of task DL3 → task FS3 → any of task TR33, task TR35, task TR43, task TR44, task TR41, task TR42, task TR29 and task TR34). In addition, as in the example shown in Figure 8, the analysis means 13D determines whether the order in which the user of the VR device 11 performs multiple tasks in the virtual space matches the correct order (task DS1 → task TR1 or task TR2), determines whether the order in which the user of the VR device 11 performs multiple tasks in the virtual space matches the correct order (task DS2 → task TR3 or task TR4), and determines whether the order in which the user of the VR device 11 performs multiple tasks in the virtual space matches the correct order (task DS3 → task TR9 or task TR10).
[0075] Furthermore, the analysis means 13D extracts, from among the multiple tasks of the assignment, tasks that are more likely than a predetermined threshold value to be performed by each of the multiple users of the VR device 11 in a different order from the correct order (i.e., tasks with a low rate of compliance with the order of execution). In detail, in the example shown in Fig. 9, the analysis means 13D extracts, from among the multiple tasks of the assignment shown in Fig. 5, tasks from task DL1 onwards (indicated by "Check!" in Fig. 9) and tasks from task DL3 onwards (indicated by "Check!" in Fig. 9) as tasks that are more likely than a predetermined threshold value (e.g., 10%) to be performed by a skilled user of the VR device 11 in a different order from the correct order of execution (i.e., tasks with a low rate of compliance with the order of execution), By presenting to an unskilled person (for example, a user of the VR device 11 who has no skills) the correct order of performing tasks from task DL1 onwards, the correct order of performing tasks from task DL2 onwards, the correct order of performing tasks from task DL3 onwards, the correct order of performing tasks from task DS1 onwards, the correct order of performing tasks from task DS2 onwards, and the correct order of performing tasks from task DS3 onwards, it is expected that the skills of the unskilled person will improve. Furthermore, by clearly indicating in the work manual tasks with a low rate of compliance with the order of performance as areas requiring attention, it is expected that the rate of compliance with the order of performance will improve.
[0076] In the example shown in Figure 9, the acquisition means 13B of the work analysis device 13 does not acquire information indicating whether the user of the VR device 11 is right-handed or left-handed, but in other examples, the acquisition means 13B of the work analysis device 13 may acquire information indicating whether the user of the VR device 11 is right-handed or left-handed.
[0077] In this example, the acquisition means 13B of the work analysis device 13 acquires information indicating whether the user of the VR device 11 is right-handed or left-handed, and acquires data indicating the movements of the right-handed VR device 11 user performing multiple tasks in a virtual space, as detected by the VR device 11. The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the right-handed VR device 11 user from the data indicating the movements of the right-handed VR device 11 user performing multiple tasks in a virtual space acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 determines whether the order in which each of the multiple right-handed VR device 11 users performs the multiple tasks in the virtual space matches the correct order. Furthermore, the analysis means 13D extracts tasks from the multiple tasks of the assignment that are more likely than a predetermined threshold to be performed in a different order from the correct order by each of the multiple right-handed VR device 11 users (i.e., tasks with a low rate of compliance with the order). The acquisition means 13B also acquires information indicating whether the user of the VR device 11 is right-handed or left-handed, and acquires data indicating the movements of the left-handed VR device 11 user, detected by the VR device 11, performing multiple tasks in the virtual space. The storage means 13C generates and stores time-series data of the movements of the left-handed VR device 11 user from the data indicating the movements of the left-handed VR device 11 user performing multiple tasks in the virtual space acquired by the acquisition means 13B. The analysis means 13D determines whether the order in which each of the multiple left-handed VR device 11 users performs the multiple tasks in the virtual space matches the correct order. Furthermore, the analysis means 13D extracts, from the multiple tasks of the assignment, tasks that are more likely than a predetermined threshold to be performed in a different order from the correct order by each of the multiple left-handed VR device 11 users (i.e., tasks with a low rate of compliance with the order).
[0078] In this example, by comparing tasks for which right-handed users of the VR device 11 have a low rate of compliance with the order of completion with tasks for which left-handed users of the VR device 11 have a low rate of compliance with the order of completion, it is possible to suggest, for example, differentiating the work manual for right-handed users of the VR device 11 from the work manual for left-handed users of the VR device 11.
[0079] 1 , the analysis means 13D of the work analysis apparatus 13 visualizes changes in the gaze direction of the user of the VR device 11 based on time-series data of the gaze direction of the user of the VR device 11 stored in the storage means 13C. For example, the analysis means 13D generates a trajectory of the gaze direction of the user of the VR device 11 based on the time-series data of the gaze direction of the user of the VR device 11 stored in the storage means 13C. The output means 13E outputs the results of the analysis by the analysis means 13D (e.g., the trajectory of the gaze direction of the user of the VR device 11 generated by the analysis means 13D).
[0080] The analysis means 13D generates a trajectory of the gaze direction of each of the users of the multiple VR devices 11, similar to the example shown in FIG. 2 . In order for the analysis means 13D to generate a trajectory of the gaze direction of the users of the multiple VR devices 11, similar to the example shown in FIG. 2 , first, a first user of the VR device 11 performs multiple tasks in a virtual space, and the gaze direction detection means 11C of the VR device 11 detects the gaze direction of the first user of the VR device 11. The acquisition means 13B acquires data indicating the gaze direction of the first user of the VR device 11 detected by the gaze direction detection means 11C of the VR device 11. The storage means 13C generates and stores time-series data of the gaze direction of the first user of the VR device 11 from the data indicating the gaze direction of the first user of the VR device 11 acquired by the acquisition means 13B. The analysis means 13D generates a trajectory of the gaze direction of the first user of the VR device 11 based on the time-series data of the gaze direction of the first user of the VR device 11 stored in the storage means 13C.
[0081] After the first user of the VR device 11 performs multiple tasks in the virtual space, the second and subsequent users of the VR device 11 perform multiple tasks in the virtual space, and the gaze direction detection means 11C of the VR device 11 detects the gaze directions of the second and subsequent users of the VR device 11. The acquisition means 13B acquires data indicating the gaze directions of the second and subsequent users of the VR device 11 detected by the gaze direction detection means 11C of the VR device 11. The storage means 13C generates and stores time-series data of the gaze directions of the second and subsequent users of the VR device 11 from the data indicating the gaze directions of the second and subsequent users of the VR device 11 acquired by the acquisition means 13B. The analysis means 13D generates trajectories of the gaze directions of the second and subsequent users of the VR device 11 based on the time-series data of the gaze directions of the second and subsequent users of the VR device 11 stored in the storage means 13C.
[0082] As a result, trajectories of the gaze directions of multiple users of the VR device 11 are generated, similar to the multiple trajectories of the positions where multiple tasks are performed shown in Fig. 2. The analysis means 13D compares the trajectory of the gaze direction of one user of the VR device 11 with the trajectories of the gaze direction of another user of the VR device 11. Therefore, in the example shown in Fig. 1, by analyzing the trajectories of the gaze directions of multiple users of the VR device 11, it is possible to efficiently find the optimal procedure for performing multiple tasks.
[0083] In the example shown in FIG. 1 , the analysis means 13D analyzes whether or not the user of the VR device 11 has overlooked the position where a task is to be performed by the user of the VR device 11 by using the trajectory of the gaze direction of one of the users of the VR device 11. Specifically, the acquisition means 13B acquires information indicating multiple tasks of a task that the user of the VR device 11 needs to perform in the virtual space. The information indicating multiple tasks of a task that the user of the VR device 11 needs to perform in the virtual space is, for example, data indicating multiple tasks of a task presented in the virtual space by the presentation means 11A of the VR device 11. The analysis means 13D extracts, from the multiple tasks of the task indicated by the information acquired by the acquisition means 13B, tasks that the user of the VR device 11 did not perform in the virtual space (i.e., tasks of a task where the gaze direction of the user of the VR device 11 was not directed toward the performance position) as tasks overlooked by the user of the VR device 11. Therefore, in the example shown in FIG. 1 , the tasks overlooked by the user of the VR device 11 can be fed back to the user of the VR device 11, etc.
[0084] To more efficiently find the optimal procedure for performing multiple tasks, in one example of the task analysis system 1 of the first embodiment, a right-handed user of the VR device 11 performs multiple tasks in a virtual space, and the gaze direction detection means 11C of the VR device 11 detects the gaze direction of the right-handed user of the VR device 11. The acquisition means 13B of the task analysis apparatus 13 acquires information indicating whether the user of the VR device 11 is right-handed or left-handed (in this example, information that the user of the VR device 11 is right-handed). The acquisition means 13B also acquires data indicating the gaze direction of the right-handed user of the VR device 11, detected by the gaze direction detection means 11C of the VR device 11. The analysis means 13D of the work analysis device 13 extracts, from among the multiple tasks of the assignment indicated by the information acquired by the acquisition means 13B, tasks that the right-handed user of the VR device 11 did not perform in the virtual space as tasks that were overlooked by the right-handed user of the VR device 11.
[0085] When a right-handed user of the VR device 11 is not performing multiple tasks in the virtual space, a left-handed user of the VR device 11 is performing multiple tasks in the virtual space, and the gaze direction detection means 11C of the VR device 11 detects the gaze direction of the left-handed user of the VR device 11. The acquisition means 13B of the task analysis device 13 acquires information indicating whether the user of the VR device 11 is right-handed or left-handed (in this example, information that the user of the VR device 11 is left-handed). The acquisition means 13B also acquires data indicating the gaze direction of the left-handed user of the VR device 11, detected by the gaze direction detection means 11C of the VR device 11. The analysis means 13D of the task analysis device 13 extracts, from the multiple tasks of the assignment indicated by the information acquired by the acquisition means 13B, tasks that the left-handed user of the VR device 11 did not perform in the virtual space as tasks overlooked by the left-handed user of the VR device 11.
[0086] The analysis means 13D of the task analysis apparatus 13 compares tasks overlooked by right-handed users of the VR device 11 with tasks overlooked by left-handed users of the VR device 11. Therefore, the analysis means 13D can distinguish between tasks that are likely to be overlooked by right-handed users of the VR device 11 and tasks that are likely to be overlooked by left-handed users of the VR device 11.
[0087] 1 , the analysis means 13D extracts timings when the gaze of the user of the VR device 11 is not directed toward the position where the user of the VR device 11 is performing a task in the virtual space, based on time-series data of the actions of the user of the VR device 11 and time-series data of the gaze direction of the user of the VR device 11, which are stored in the storage means 13C. In other words, the analysis means 13D extracts tasks that the user of the VR device 11 performed without overlooking them, but performed while looking away from the user of the VR device 11. Therefore, the looking-away tasks extracted by the analysis means 13D can be fed back to the user of the VR device 11, etc.
[0088] To more efficiently find the optimal procedure for performing multiple tasks, in one example of the task analysis system 1 of the first embodiment, a right-handed user of the VR device 11 performs multiple tasks in a virtual space, the motion detection means 11B of the VR device 11 detects the motions of the right-handed user of the VR device 11 performing the multiple tasks in the virtual space, and the gaze direction detection means 11C of the VR device 11 detects the gaze direction of the right-handed user of the VR device 11. The acquisition means 13B of the task analysis apparatus 13 acquires information indicating whether the user of the VR device 11 is right-handed or left-handed (in this example, information that the user of the VR device 11 is right-handed). Furthermore, the acquisition means 13B acquires data indicating the movements of a right-handed user of the VR device 11 performing multiple tasks in a virtual space, detected by the movement detection means 11B of the VR device 11, and data indicating the gaze direction of the right-handed user of the VR device 11, detected by the gaze direction detection means 11C of the VR device 11. The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the right-handed user of the VR device 11 from the data indicating the movements of the right-handed user of the VR device 11 performing multiple tasks in a virtual space, acquired by the acquisition means 13B. Furthermore, the storage means 13C generates and stores time-series data of the gaze direction of the right-handed user of the VR device 11 from the data indicating the gaze direction of the right-handed user of the VR device 11, acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 extracts the timing when the gaze of the right-handed user of the VR device 11 is not directed toward the position where the work being performed in the virtual space by the right-handed user of the VR device 11 is being performed, based on the time series data of the movements of the right-handed user of the VR device 11 and the time series data of the gaze direction of the right-handed user of the VR device 11 stored in the memory means 13C.
[0089] When a right-handed user of the VR device 11 is not performing multiple tasks in the virtual space, a left-handed user of the VR device 11 performs multiple tasks in the virtual space, and the action detection means 11B of the VR device 11 detects the actions of the left-handed user of the VR device 11 performing multiple tasks in the virtual space, and the gaze direction detection means 11C of the VR device 11 detects the gaze direction of the left-handed user of the VR device 11. The acquisition means 13B of the work analysis apparatus 13 acquires information indicating whether the user of the VR device 11 is right-handed or left-handed (in this example, information that the user of the VR device 11 is left-handed). Furthermore, the acquisition means 13B acquires data indicating the movements of the left-handed user of the VR device 11 performing multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11, and data indicating the gaze direction of the left-handed user of the VR device 11, detected by the gaze direction detection means 11C of the VR device 11. The storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the movements of the left-handed user of the VR device 11 from the data indicating the movements of the left-handed user of the VR device 11 performing multiple tasks in the virtual space, acquired by the acquisition means 13B. Furthermore, the storage means 13C generates and stores time-series data of the gaze direction of the left-handed user of the VR device 11 from the data indicating the gaze direction of the left-handed user of the VR device 11, acquired by the acquisition means 13B. The analysis means 13D of the work analysis apparatus 13 extracts timings when the gaze of the left-handed user of the VR device 11 is not directed toward the position where the work is being performed in the virtual space by the left-handed user of the VR device 11, based on time-series data of the movements of the left-handed user of the VR device 11 and time-series data of the gaze direction of the left-handed user of the VR device 11, which are stored in the storage means 13C. Therefore, the right-handedness and left-handedness tendencies extracted by the analysis means 13D can be fed back to the user of the VR device 11, etc.
[0090] In another example of the work analysis system 1 according to the first embodiment, to more efficiently find the optimal procedure for performing multiple tasks, a skilled user of the VR device 11 performs multiple tasks in a virtual space, and the movement detection means 11B of the VR device 11 detects the movements of the skilled user of the VR device 11 performing the multiple tasks in the virtual space. The acquisition means 13B of the work analysis apparatus 13 acquires data indicating the movements of the skilled user of the VR device 11 performing the multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has the skill (in this example, information indicating that the user of the VR device 11 has the skill). The storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the movements of the skilled user of the VR device 11 from the data indicating the movements of the skilled user of the VR device 11 performing the multiple tasks in the virtual space acquired by the acquisition means 13B.
[0091] When a skilled user of the VR device 11 is not performing multiple tasks in the virtual space, a non-skilled user of the VR device 11 performs multiple tasks in the virtual space, and the movement detection means 11B of the VR device 11 detects the movements of the non-skilled user of the VR device 11 performing multiple tasks in the virtual space. The acquisition means 13B of the work analysis device 13 acquires data indicating the movements of the non-skilled user of the VR device 11 performing multiple tasks in the virtual space, detected by the movement detection means 11B of the VR device 11. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has skills (in this example, information indicating that the user of the VR device 11 does not have skills). The storage means 13C of the work analysis device 13 generates and stores time-series data of the movements of the non-skilled user of the VR device 11 from the data indicating the movements of the non-skilled user of the VR device 11 performing multiple tasks in the virtual space acquired by the acquisition means 13B.
[0092] The analysis means 13D of the work analysis apparatus 13 compares the time series data of the movements of the user of the VR device 11 who has the skill stored in the storage means 13C with the time series data of the movements of the user of the VR device 11 who does not have the skill stored in the storage means 13C. Therefore, the skill-specific trends obtained from the analysis results by the analysis means 13D (i.e., the comparison results between the movements of the user of the VR device 11 who has the skill and the movements of the user of the VR device 11 who does not have the skill) can be fed back to the user of the VR device 11, etc.
[0093] In another example of the work analysis system 1 according to the first embodiment, in order to more efficiently find the optimal procedure for performing multiple tasks, a skilled user of a VR device 11 performs multiple tasks in a virtual space, and the gaze direction detection means 11C of the VR device 11 detects the gaze direction of the skilled user of the VR device 11. The acquisition means 13B of the work analysis apparatus 13 acquires data indicating the gaze direction of the skilled user of the VR device 11 detected by the gaze direction detection means 11C of the VR device 11. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information indicating that the user of the VR device 11 has a skill). The storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the gaze direction of the skilled user of the VR device 11 from the data indicating the gaze direction of the skilled user of the VR device 11 acquired by the acquisition means 13B.
[0094] When a skilled user of the VR device 11 is not performing multiple tasks in the virtual space, a user of the unskilled VR device 11 is performing multiple tasks in the virtual space, and the gaze direction detection means 11C of the VR device 11 detects the gaze direction of the unskilled user of the VR device 11. The acquisition means 13B of the work analysis device 13 acquires data indicating the gaze direction of the unskilled user of the VR device 11 detected by the gaze direction detection means 11C of the VR device 11. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information indicating that the user of the VR device 11 does not have a skill). The storage means 13C of the work analysis device 13 generates and stores time-series data of the gaze direction of the unskilled user of the VR device 11 from the data indicating the gaze direction of the unskilled user of the VR device 11 acquired by the acquisition means 13B.
[0095] The analysis means 13D of the work analysis apparatus 13 compares the time series data of the gaze direction of the user of the VR device 11 who has the skill stored in the storage means 13C with the time series data of the gaze direction of the user of the VR device 11 who does not have the skill stored in the storage means 13C. Therefore, the skill-specific trends obtained from the analysis results by the analysis means 13D (i.e., the comparison results between the gaze direction of the user of the VR device 11 who has the skill and the gaze direction of the user of the VR device 11 who does not have the skill) can be fed back to the user of the VR device 11, etc.
[0096] In other words, in this example, the points where there are large statistical differences between the time series data of the gaze direction of a user of a VR device 11 whose work results do not meet the criteria (for example, a user of a VR device 11 with no skills) and the time series data of the gaze direction of a user of a VR device 11 whose work results meet the criteria (for example, a user of a VR device 11 with no skills) are extracted and output.
[0097] In another example of the work analysis system 1 according to the first embodiment, in order to more efficiently find the optimal procedure for performing multiple tasks, a skilled user of the VR device 11 performs multiple tasks in a virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the skilled user of the VR device 11. The acquisition means 13B of the work analysis apparatus 13 acquires the biometric information of the skilled user of the VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information that the user of the VR device 11 has a skill). The storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the skilled user of the VR device 11's biometric information from the skilled user of the VR device 11 acquired by the acquisition means 13B.
[0098] When a skilled user of the VR device 11 is not performing multiple tasks in the virtual space, a user of the unskilled VR device 11 performs multiple tasks in the virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the user of the unskilled VR device 11. The acquisition means 13B of the work analysis device 13 acquires the biometric information of the user of the unskilled VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information indicating that the user of the VR device 11 does not have a skill). The storage means 13C of the work analysis device 13 generates and stores time-series data of the biometric information of the user of the VR device 11 who has no skill from the biometric information of the user of the unskilled VR device 11 acquired by the acquisition means 13B.
[0099] The analysis means 13D of the work analysis apparatus 13 compares the time series data of biometric information of users of VR devices 11 who have skills stored in the storage means 13C with the time series data of biometric information of users of VR devices 11 who do not have skills stored in the storage means 13C. Therefore, the skill-specific trends obtained from the analysis results by the analysis means 13D (i.e., the comparison results between the biometric information of users of VR devices 11 who have skills and the biometric information of users of VR devices 11 who do not have skills) can be fed back to the users of the VR devices 11, etc.
[0100] The analysis means 13D estimates the concentration level of the user of the VR device 11 from the biometric information of the user of the VR device 11 detected by the detection means 12A of the biometric sensor 12 by using the technology described on the website indicated by the following URL: https: / / jpn.nec.com / embedded / products / emotion / case.html https: / / www.necmp.co.jp / advanced_services / achievement / kickoff.html
[0101] In addition, the analysis means 13D visualizes the concentration level of the user of the VR device 11, as in the technique described on the website indicated by the above URL.
[0102] To more efficiently find the optimal procedure for performing multiple tasks, in one example of the task analysis system 1 of the first embodiment, a skilled user of a VR device 11 performs multiple tasks in a virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the skilled user of the VR device 11. The acquisition means 13B of the task analysis apparatus 13 acquires the biometric information of the skilled user of the VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information that the user of the VR device 11 has a skill). The analysis means 13D of the task analysis apparatus 13 estimates and visualizes the concentration level of the skilled user of the VR device 11 from the biometric information of the skilled user of the VR device 11 acquired by the acquisition means 13B.
[0103] When a skilled user of the VR device 11 is not performing multiple tasks in the virtual space, a user of the unskilled VR device 11 performs multiple tasks in the virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the user of the unskilled VR device 11. The acquisition means 13B of the work analysis device 13 acquires the biometric information of the user of the unskilled VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information indicating that the user of the VR device 11 has no skill). The analysis means 13D of the work analysis device 13 estimates and visualizes the concentration level of the user of the unskilled VR device 11 from the biometric information of the user of the unskilled VR device 11 acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 compares the concentration level of a user of a VR device 11 that has the visualized skill with the concentration level of a user of a VR device 11 that does not have the visualized skill.
[0104] 10 is a diagram illustrating an example of a state in which the concentration level of a user (exemplifier) of a VR device 11 with a visualized skill is compared with the concentration level of a user (others) of a VR device 11 without the visualized skill. In the example shown in FIG. 10, the analysis means 13D of the work analysis apparatus 13 visualizes an average concentration level of 62.9% for a user of a VR device 11 with a skill (shown as "exemplifier" in FIG. 10) during a period in which the user of a VR device 11 with a skill is performing the multiple tasks shown in FIG. 5 in the virtual space. Furthermore, the analysis means 13D visualizes an average concentration level of 60.3% for a user of a VR device 11 without the skill (shown as "others" in FIG. 10) during a period in which the user of a VR device 11 without the skill is performing the multiple tasks shown in FIG. 5 in the virtual space.
[0105] 1 , a user of a VR device 11 performs multiple tasks in a virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the user of the VR device 11. The acquisition means 13B of the work analysis device 13 acquires the biometric information of the user of the VR device 11 detected by the detection means 12A of the biosensor 12. The storage means 13C of the work analysis device 13 generates and stores time-series data of the biometric information of the user of the VR device 11 from the biometric information of the user of the VR device 11 acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 estimates and analyzes time-series changes in the concentration level of the user of the VR device 11 from the time-series data of the biometric information of the user of the VR device 11 stored in the storage means 13C.
[0106] To more efficiently find the optimal procedure for performing multiple tasks, in one example of the work analysis system 1 of the first embodiment, a skilled user of a VR device 11 performs multiple tasks in a virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the skilled user of the VR device 11. The acquisition means 13B of the work analysis apparatus 13 acquires the biometric information of the skilled user of the VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information that the user of the VR device 11 has a skill). The storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the skilled user of the VR device 11's biometric information from the skilled user of the VR device 11's biometric information acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 estimates and visualizes the time series changes in the concentration level of a user of a VR device 11 with a skill from the time series data of the biometric information of the user of the VR device 11 with the skill stored in the memory means 13C.
[0107] When a skilled user of the VR device 11 is not performing multiple tasks in the virtual space, a user of the unskilled VR device 11 performs multiple tasks in the virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the user of the unskilled VR device 11. The acquisition means 13B of the work analysis device 13 acquires the biometric information of the user of the unskilled VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information indicating that the user of the VR device 11 does not have a skill). The storage means 13C of the work analysis device 13 generates and stores time-series data of the biometric information of the user of the VR device 11 who has no skill from the biometric information of the user of the unskilled VR device 11 acquired by the acquisition means 13B. The analysis means 13D of the work analysis apparatus 13 estimates and visualizes time-series changes in the concentration level of the user of the VR device 11 who does not have the skill from time-series data of the biometric information of the user of the VR device 11 who does not have the skill stored in the storage means 13C. The analysis means 13D also compares the visualized time-series changes in the concentration level of the user of the VR device 11 who has the skill with the visualized time-series changes in the concentration level of the user of the VR device 11 who does not have the skill.
[0108] FIG. 11 is a diagram illustrating an example of a comparison between the time series change in the concentration level of a user (exemplifier) of a VR device 11 with a visualized skill and the time series change in the concentration level of a user (others) of a VR device 11 without the visualized skill. In FIG. 11 , the vertical axis represents the concentration level of the user of the VR device 11 with the skill and the user of the VR device 11 without the skill, and the horizontal axis represents the cumulative time (elapsed time) from the start of training to perform the multiple tasks shown in FIG. 5 in the virtual space. In the example shown in FIG. 11 , the analysis means 13D of the work analysis apparatus 13 visualizes the time series change in the concentration level of the user of the VR device 11 with the skill (shown as "exemplifier" in FIG. 11 ) during the period in which the user of the VR device 11 with the skill performs the multiple tasks shown in FIG. 5 in the virtual space. In addition, the analysis means 13D visualizes the time series changes in the concentration level of a user of the VR device 11 who does not have skills (shown as ``Other'' in Figure 11) during a period when the user of the VR device 11 who does not have skills is performing multiple tasks shown in Figure 5 in the virtual space.
[0109] In the example shown in Fig. 11, it can be seen that the concentration level of a skilled user (exemplifier) of the VR device 11 remains at a high value. In addition, in the example shown in Fig. 11, the analysis results shown in Fig. 11 can be fed back to a user of the VR device 11 without skills after training, allowing the user to see the difference between the time series change in the concentration level of a user of the VR device 11 without skills and the time series change in the concentration level of a user of the VR device 11 with skills.
[0110] In addition, in the example shown in Figure 11, the emotion analysis results (i.e., time series changes in concentration level) of a user of the VR device 11 who performed work using a procedure close to the optimal procedure (a user of the VR device 11 who has skills) may be output as an exemplary emotion pattern.
[0111] In the example shown in FIG. 1, the analysis means 13D of the work analysis apparatus 13 estimates the stress level of the user of the VR device 11 from the biometric information of the user of the VR device 11 detected by the detection means 12A of the biosensor 12 by using the technology described on the website indicated by the following URL: https: / / jpn.nec.com / manufacture / monozukuri / iot_mono / interview / 13_emotion-analytics.html
[0112] In addition, the analysis means 13D visualizes the stress level of the user of the VR device 11, as in the technology described on the website indicated by the above URL.
[0113] To more efficiently find the optimal procedure for performing multiple tasks, in one example of the task analysis system 1 of the first embodiment, a skilled user of a VR device 11 performs multiple tasks in a virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the skilled user of the VR device 11. The acquisition means 13B of the task analysis apparatus 13 acquires the biometric information of the skilled user of the VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information indicating that the user of the VR device 11 has a skill). The analysis means 13D of the task analysis apparatus 13 estimates and visualizes the stress level of the skilled user of the VR device 11 from the biometric information of the skilled user of the VR device 11 acquired by the acquisition means 13B.
[0114] When a skilled user of the VR device 11 is not performing multiple tasks in the virtual space, a user of the VR device 11 without skills performs multiple tasks in the virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the user of the VR device 11 without skills. The acquisition means 13B of the work analysis device 13 acquires the biometric information of the user of the VR device 11 without skills detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information indicating that the user of the VR device 11 does not have a skill). The analysis means 13D of the work analysis device 13 estimates and visualizes the stress level of the user of the VR device 11 without skills from the biometric information of the user of the VR device 11 without skills acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 compares the stress level of a user of a VR device 11 that has the visualized skill with the stress level of a user of a VR device 11 that does not have the visualized skill.
[0115] 12 is a diagram illustrating an example of a state in which the stress level of a user (exemplifier) of a VR device 11 with a visualized skill is compared with the stress level of a user (others) of a VR device 11 without the visualized skill. In the example shown in FIG. 12, the analysis means 13D of the work analysis apparatus 13 visualizes an average stress level of 50.7% for the user of the VR device 11 with the skill (shown as "exemplifier" in FIG. 12) during a period in which the user of the VR device 11 with the skill performs the multiple tasks shown in FIG. 5 in the virtual space. Furthermore, the analysis means 13D visualizes an average stress level of 60.3% for the user of the VR device 11 without the skill (shown as "others" in FIG. 12) during a period in which the user of the VR device 11 without the skill performs the multiple tasks shown in FIG. 5 in the virtual space.
[0116] 1 , a user of a VR device 11 performs multiple tasks in a virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the user of the VR device 11. The acquisition means 13B of the work analysis device 13 acquires the biometric information of the user of the VR device 11 detected by the detection means 12A of the biosensor 12. The storage means 13C of the work analysis device 13 generates and stores time-series data of the biometric information of the user of the VR device 11 from the biometric information of the user of the VR device 11 acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 estimates and analyzes time-series changes in the stress level of the user of the VR device 11 from the time-series data of the biometric information of the user of the VR device 11 stored in the storage means 13C.
[0117] To more efficiently find the optimal procedure for performing multiple tasks, in one example of the work analysis system 1 of the first embodiment, a skilled user of a VR device 11 performs multiple tasks in a virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the skilled user of the VR device 11. The acquisition means 13B of the work analysis apparatus 13 acquires the biometric information of the skilled user of the VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information that the user of the VR device 11 has a skill). The storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the skilled user of the VR device 11's biometric information from the skilled user of the VR device 11's biometric information acquired by the acquisition means 13B. The analysis means 13D of the work analysis device 13 estimates and visualizes the time series changes in the stress level of a user of a VR device 11 with a skill from the time series data of the user's biometric information stored in the memory means 13C.
[0118] When a skilled user of the VR device 11 is not performing multiple tasks in the virtual space, a user of the unskilled VR device 11 performs multiple tasks in the virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the user of the unskilled VR device 11. The acquisition means 13B of the work analysis device 13 acquires the biometric information of the user of the unskilled VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information indicating that the user of the VR device 11 does not have a skill). The storage means 13C of the work analysis device 13 generates and stores time-series data of the biometric information of the user of the VR device 11 who has no skill from the biometric information of the user of the unskilled VR device 11 acquired by the acquisition means 13B. The analysis means 13D of the work analysis apparatus 13 estimates and visualizes time-series changes in the stress level of a user of a VR device 11 without skills from time-series data of the biometric information of the user of the VR device 11 without skills stored in the storage means 13C. The analysis means 13D also compares the visualized time-series changes in the stress level of a user of a VR device 11 with skills with the visualized time-series changes in the stress level of a user of a VR device 11 without skills.
[0119] FIG. 13 is a diagram illustrating an example of a comparison between the time series change in stress level of a user (exemplifier) of a VR device 11 with a visualized skill and the time series change in stress level of a user (others) of a VR device 11 without the visualized skill. In FIG. 13 , the vertical axis represents the stress level of the user of the VR device 11 with a skill and the user of the VR device 11 without the skill, and the horizontal axis represents the cumulative time (elapsed time) from the start of training to perform the multiple tasks shown in FIG. 5 in the virtual space. In the example shown in FIG. 13 , the analysis means 13D of the work analysis apparatus 13 visualizes the time series change in stress level of the user of the VR device 11 with a skill (shown as "exemplifier" in FIG. 13 ) during the period in which the user of the VR device 11 with a skill performs the multiple tasks shown in FIG. 5 in the virtual space. In addition, the analysis means 13D visualizes the time series changes in the stress level of a user of the VR device 11 who does not have skills (shown as ``Other'' in Figure 13) during the period when the user of the VR device 11 who does not have skills is performing multiple tasks shown in Figure 5 in the virtual space.
[0120] In the example shown in Figure 13, it can be seen that the stress level of a user (model) of a VR device 11 with skills is stable (i.e., the fluctuation range (time series change) in the up and down direction in Figure 13 is small) and remains at a low value. In addition, in the example shown in Figure 13, the analysis results shown in Figure 13 can be fed back to a user of a VR device 11 without skills after training, allowing the user to understand the difference between the time series change in stress level of a user of a VR device 11 without skills and the time series change in stress level of a user of a VR device 11 with skills.
[0121] 1 , the analysis means 13D of the work analysis apparatus 13 uses the technology described on the website, etc., indicated by the URL below to analyze the emotions of the user of the VR device 11 from the biometric information of the user of the VR device 11 detected by the detection means 12A of the biometric sensor 12. For example, the analysis means 13D analyzes the heart rate variability of the user of the VR device 11, bifurcates the emotional index, and classifies the emotions into four quadrants (happy, angry (stress, irritation), relaxed, sad) by expressing arousal (arousal) as positive / negative and emotional valence (valence) as pleasant / unpleasant. https: / / jpn.nec.com / techrep / journal / g19 / n01 / 190109.html https: / / jpn.nec.com / manufacture / monozukuri / iot_mono / interview / 13_emotion-analytics.html https: / / jpn.nec.com / embedded / products / emotion / index.html https: / / jpn.nec.com / press / 201806 / 20180611_01.html
[0122] To more efficiently find the optimal procedure for performing multiple tasks, in one example of the task analysis system 1 of the first embodiment, a skilled user of a VR device 11 performs multiple tasks in a virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the skilled user of the VR device 11. The acquisition means 13B of the task analysis apparatus 13 acquires the biometric information of the skilled user of the VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information that the user of the VR device 11 has a skill). The analysis means 13D of the task analysis apparatus 13 analyzes the emotions of the skilled user of the VR device 11 from the biometric information of the skilled user of the VR device 11 acquired by the acquisition means 13B.
[0123] When a skilled user of the VR device 11 is not performing multiple tasks in the virtual space, a user of the unskilled VR device 11 performs multiple tasks in the virtual space, and the detection means 12A of the biosensor 12 detects biometric information of the user of the unskilled VR device 11. The acquisition means 13B of the work analysis device 13 acquires the biometric information of the user of the unskilled VR device 11 detected by the detection means 12A of the biosensor 12. The acquisition means 13B also acquires information indicating whether the user of the VR device 11 has a skill (in this example, information indicating that the user of the VR device 11 has no skill). The analysis means 13D of the work analysis device 13 analyzes the emotions of the user of the unskilled VR device 11 from the biometric information of the user of the unskilled VR device 11 acquired by the acquisition means 13B. The analysis means 13D of the work analysis apparatus 13 compares the emotions of users of the VR devices 11 who have skills with the emotions of users of the VR devices 11 who do not have skills. For example, the analysis means 13D compares the emotions of users of the VR devices 11 who have skills with the emotions of users of the VR devices 11 who do not have skills using the classification results of the four quadrants described above.
[0124] That is, in this example, the optimal work procedure is analyzed based on the emotion analysis results of the user of the VR device 11 as well.
[0125] 14 is a diagram showing an example of a state in which the stress level of a skilled user of a VR device 11 (exemplifier) is compared with the emotions of unskilled users of a VR device 11 (others). In the example shown in Fig. 14, the analysis means 13D of the work analysis apparatus 13 compares the emotions of a skilled user of a VR device 11 (shown as "exemplifier" in Fig. 14) during a period in which the skilled user of a VR device 11 is performing the multiple tasks shown in Fig. 5 in the virtual space with the emotions of an unskilled user of a VR device 11 (shown as "others" in Fig. 14) during a period in which the unskilled user of a VR device 11 is performing the multiple tasks shown in Fig. 5 in the virtual space.
[0126] To more efficiently find the optimal procedure for performing multiple tasks, in one example of the task analysis system 1 of the first embodiment, a user of a VR device 11 performs multiple tasks in a virtual space, and the motion detection means 11B of the VR device 11 detects the motions of the user of the VR device 11 performing the multiple tasks in the virtual space, while the detection means 12A of the biosensor 12 detects biometric information of the user of the VR device 11. The acquisition means 13B of the task analysis apparatus 13 acquires data indicating the motions of the user of the VR device 11 performing the multiple tasks in the virtual space, detected by the motion detection means 11B of the VR device 11, and acquires the biometric information of the user of the VR device 11 detected by the detection means 12A of the biosensor 12. The storage means 13C of the work analysis device 13 generates and stores time series data of the movements of the user of the VR device 11 from data acquired by the acquisition means 13B indicating the movements of the user of the VR device 11 as they perform multiple tasks in a virtual space, and also generates and stores time series data of the biometric information of the user of the VR device 11 from the biometric information of the user of the VR device 11 acquired by the acquisition means 13B.
[0127] The analysis means 13D of the work analysis apparatus 13 determines whether the user of the VR device 11 has failed in any of the multiple tasks being performed in the virtual space, based on the time-series data of the movements of the user of the VR device 11 stored in the storage means 13C. When the user of the VR device 11 has failed in any of the multiple tasks being performed in the virtual space (more specifically, when the analysis means 13D determines that the user of the VR device 11 has failed in any of the multiple tasks being performed in the virtual space), the analysis means 13D extracts a change in the biometric information of the user of the VR device 11 (more specifically, information indicating emotions among the biometric information) at the time when the user of the VR device 11 failed in any of the multiple tasks being performed in the virtual space, based on the time-series data of the biometric information of the user of the VR device 11 and the time-series data of the movements of the user of the VR device 11 stored in the storage means 13C. Furthermore, when the user of the VR device 11 succeeds in one of the multiple tasks being performed in the virtual space (more specifically, when the analysis means 13D determines that the user of the VR device 11 has succeeded in one of the multiple tasks being performed in the virtual space), the analysis means 13D extracts changes in the biometric information of the user of the VR device 11 (more specifically, information indicating emotions among the biometric information) at the time when the user of the VR device 11 succeeded in one of the multiple tasks being performed in the virtual space, based on the time series data of the biometric information of the user of the VR device 11 stored in the storage means 13C and the time series data of the movements of the user of the VR device 11.
[0128] 15 is a sequence diagram illustrating an example of processing performed in the work analysis system 1 according to the first embodiment. In the example shown in FIG. 15, in step S1, the presentation unit 11A of the VR device 11 presents, in a virtual space, a plurality of tasks that constitute an assignment assigned to the user of the VR device 11.
[0129] Next, in step S2, the action detection means 11B of the VR device 11 detects actions of the user of the VR device 11 performing multiple tasks in the virtual space. Next, in step S3, the communication means 11D of the VR device 11 transmits data indicating the actions of the user of the VR device 11 performing multiple tasks in the virtual space detected in step S2 to the work analysis device 13. Next, in step S4, the acquisition means 13B of the work analysis device 13 acquires the data indicating the actions of the user of the VR device 11 performing multiple tasks in the virtual space received in step S3. Next, in step S5, the storage means 13C of the work analysis device 13 generates and stores time-series data of the actions of the user of the VR device 11 from the data indicating the actions of the user of the VR device 11 performing multiple tasks in the virtual space acquired in step S4.
[0130] Furthermore, in step S6, the gaze direction detection means 11C of the VR device 11 detects the gaze direction of the user of the VR device 11 who is performing the multiple tasks of the assignment. Next, in step S7, the communication means 11D of the VR device 11 transmits data indicating the gaze direction of the user of the VR device 11 detected in step S6 to the work analysis apparatus 13. Next, in step S8, the acquisition means 13B of the work analysis apparatus 13 acquires the data indicating the gaze direction of the user of the VR device 11 received in step S7. Next, in step S9, the storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the gaze direction of the user of the VR device 11 from the data indicating the gaze direction of the user of the VR device 11 acquired in step S8.
[0131] Furthermore, in step S10, the detection means 12A of the biosensor 12 detects biometric information of the user of the VR device 11 who is performing multiple tasks of the assignment. Next, in step S11, the communication means 12B of the biosensor 12 transmits the biometric information of the user of the VR device 11 detected in step S10 to the work analysis apparatus 13. Next, in step S12, the acquisition means 13B of the work analysis apparatus 13 acquires the biometric information of the user of the VR device 11 received in step S11. Next, in step S13, the storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the biometric information of the user of the VR device 11 from the biometric information of the user of the VR device 11 acquired in step S12.
[0132] Next, in step S14, the analysis means 13D of the work analysis device 13 visualizes changes in the movements of the user of the VR device 11 as they perform multiple tasks in the virtual space, based on the time-series data of the movements of the user of the VR device 11 stored in step S5. Also in step S14, the analysis means 13D of the work analysis device 13 visualizes changes in the gaze direction of the user of the VR device 11, based on the time-series data of the gaze direction of the user of the VR device 11 stored in step S9. Furthermore, in step S14, the analysis means 13D of the work analysis device 13 estimates and analyzes time-series changes in the emotions of the user of the VR device 11 from the time-series data of the biometric information of the user of the VR device 11 stored in step S13. Next, in step S15, the output means 13E of the work analysis device 13 outputs the results of the analysis in step S14.
[0133] According to the work analysis system 1 of the first embodiment, when a goal is defined but the optimal work procedure for achieving that goal has not been determined, it is possible to efficiently search for the optimal work procedure.
[0134] Second Embodiment A second embodiment of the work analysis device, work analysis system, work analysis method, and storage medium of the present invention will be described below. The work analysis system 1 of the second embodiment is configured similarly to the work analysis system 1 of the first embodiment described above, except for the points described below. Therefore, the work analysis system 1 of the second embodiment can achieve the same effects as the work analysis system 1 of the first embodiment described above, except for the points described below.
[0135] The work analysis system 1 of the second embodiment is configured similarly to the work analysis system 1 of the first embodiment shown in Fig. 1. As described above, in the work analysis system 1 of the first embodiment, the work analysis device 13 is located in the cloud. On the other hand, in the work analysis system 1 of the second embodiment, for example, a smartphone used by a user of the VR device 11 functions as the work analysis device 13.
[0136] <Third Embodiment> A third embodiment of the work analysis device, work analysis system, work analysis method, and storage medium of the present invention will be described below. The work analysis system 1 of the third embodiment is configured similarly to the work analysis system 1 of the first embodiment described above, except for the points described below. Therefore, the work analysis system 1 of the third embodiment can achieve the same effects as the work analysis system 1 of the first embodiment described above, except for the points described below.
[0137] The task analysis system 1 of the third embodiment is configured similarly to the task analysis system 1 of the first embodiment shown in Fig. 1. As described above, in the task analysis system 1 of the first embodiment, the task analysis device 13 is located in the cloud. On the other hand, in the task analysis system 1 of the third embodiment, a terminal device (e.g., a personal computer) used by, for example, a user of the VR device 11 functions as the task analysis device 13.
[0138] <Fourth embodiment> A fourth embodiment of the work analysis device, work analysis system, work analysis method, and storage medium of the present invention will be described below. The work analysis system 1 of the fourth embodiment is configured similarly to the work analysis system 1 of the first embodiment described above, except for the points described below. Therefore, the work analysis system 1 of the fourth embodiment can achieve the same effects as the work analysis system 1 of the first embodiment described above, except for the points described below.
[0139] Fig. 16 is a diagram showing an example of an task analysis system 1 according to the fourth embodiment. In the example shown in Fig. 16, the task analysis system 1 includes a VR device 11 and a biosensor 12. The VR device 11 includes a presentation unit 11A, a motion detection unit 11B, a gaze direction detection unit 11C, a communication unit 11D, and an task analysis apparatus 13. In other words, the task analysis apparatus 13 is built into the VR device 11.
[0140] 16 , the communication means 11D communicates with the biosensor 12 and the like. The communication means 12B of the biosensor 12 communicates with the VR device 11 and the like. The communication means 12B transmits biometric information of the user of the VR device 11 detected by the detection means 12A to the VR device 11. The work analysis apparatus 13 includes an acquisition means 13B, a storage means 13C, an analysis means 13D, and an output means 13E. The acquisition means 13B acquires data indicating the actions of the user of the VR device 11 performing multiple tasks in a virtual space, detected by the action detection means 11B of the VR device 11, data indicating the gaze direction of the user of the VR device 11, detected by the gaze direction detection means 11C of the VR device 11, and the biometric information of the user of the VR device 11 received by the communication means 11D of the VR device 11.
[0141] Fifth Embodiment A fifth embodiment of the work analysis device, work analysis system, work analysis method, and storage medium of the present invention will be described below. The work analysis system 1 of the fifth embodiment is configured similarly to the work analysis system 1 of the first embodiment described above, except for the points described below. Therefore, the work analysis system 1 of the fifth embodiment can achieve the same effects as the work analysis system 1 of the first embodiment described above, except for the points described below.
[0142] Fig. 17 is a diagram showing an example of an operation analysis system 1 according to the fifth embodiment. In the example shown in Fig. 17, a VR device 11 includes a presentation unit 11A, a motion detection unit 11B, a gaze direction detection unit 11C, a communication unit 11D, and a posture estimation unit 11E. The posture estimation unit 11E estimates the posture of the user of the VR device 11 by using, for example, the technology described on the website indicated by the URL below. https: / / jpn.nec.com / techrep / journal / g16 / n02 / 160207.html http: / / mikilab.doshisha.ac.jp / research / master_thesis / 2019 / 03_kfujimoto.pdf https: / / www.ieice.org / publications / ken / summary.php?contribution_id=KJ00009553185 http: / / conference.vrsj.org / ac2020 / program / doc / 1C1-2_PR0064.pdf
[0143] 17 , the communication means 11D transmits data indicating the posture of the user of the VR device 11 estimated by the posture estimation means 11E to the work analysis apparatus 13. The communication means 13A of the work analysis apparatus 13 receives the data indicating the posture of the user of the VR device 11 transmitted by the communication means 11D of the VR device 11. The acquisition means 13B of the work analysis apparatus 13 acquires the data indicating the posture of the user of the VR device 11 received by the communication means 13A. In other words, the acquisition means 13B acquires data indicating the posture of the user of the VR device 11 detected by the posture estimation means 11E of the VR device 11. The storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the posture of the user of the VR device 11 from the data indicating the posture of the user of the VR device 11 acquired by the acquisition means 13B (i.e., instantaneous data). The analysis means 13D of the work analysis apparatus 13 analyzes the posture of the user of the VR device 11 based on the time-series data of the posture of the user of the VR device 11 stored in the storage means 13C. The analysis means 13D analyzes, for example, the posture of the user of the VR device 11 while the user of the VR device 11 is performing a predetermined task.
[0144] Sixth Embodiment A sixth embodiment of the work analysis device, work analysis system, work analysis method, and storage medium of the present invention will be described below. The work analysis system 1 of the sixth embodiment is configured similarly to the work analysis system 1 of the first embodiment described above, except for the points described below. Therefore, the work analysis system 1 of the sixth embodiment can achieve the same effects as the work analysis system 1 of the first embodiment described above, except for the points described below.
[0145] Fig. 18 is a diagram showing an example of an operation analysis system 1 according to the sixth embodiment. In the example shown in Fig. 18, a VR device 11 includes a presentation unit 11A, a motion detection unit 11B, a gaze direction detection unit 11C, a communication unit 11D, and an utterance estimation unit 11F. The utterance estimation unit 11F estimates the utterance of the user of the VR device 11 by using, for example, the technology described on the website indicated by the following URL: https: / / jpn.nec.com / techrep / journal / g12 / n03 / pdf / 120326.pdf https: / / jpn.nec.com / ir / pdf / library / 090629 / 090629_04.pdf https: / / jpn.nec.com / techrep / journal / g10 / n01 / pdf / 100112.pdf https: / / jpn.nec.com / techrep / journal / g14 / n01 / pdf / 140118.pdf http: / / www.nec.co.jp / press / ja / 0809 / 2502.html
[0146] 18 , the communication means 11D transmits data indicating the utterance of the user of the VR device 11 estimated by the utterance estimation means 11F to the work analysis apparatus 13. The communication means 13A of the work analysis apparatus 13 receives the data indicating the utterance of the user of the VR device 11 transmitted by the communication means 11D of the VR device 11. The acquisition means 13B of the work analysis apparatus 13 acquires the data indicating the utterance of the user of the VR device 11 received by the communication means 13A. In other words, the acquisition means 13B acquires data indicating the utterance of the user of the VR device 11 detected by the utterance estimation means 11F of the VR device 11. The storage means 13C of the work analysis apparatus 13 generates and stores time-series data of the utterance of the user of the VR device 11 from the data indicating the utterance of the user of the VR device 11 acquired by the acquisition means 13B (i.e., instantaneous data). The analysis means 13D of the work analysis apparatus 13 analyzes the speech of the user of the VR device 11 based on the time-series data of the speech of the user of the VR device 11 stored in the storage means 13C.
[0147] Seventh Embodiment A seventh embodiment of the work analysis device, work analysis system, work analysis method, and storage medium of the present invention will now be described.
[0148] FIG. 19 is a diagram illustrating an example of an task analysis device 13 according to the seventh embodiment. In the example illustrated in FIG. 19 , the task analysis device 13 includes an acquisition unit 13B, a storage unit 13C, an analysis unit 13D, and an output unit 13E. The acquisition unit 13B acquires data indicating the actions of a user of the VR device 11 performing multiple tasks in the virtual space, detected by the VR device 11, which presents multiple tasks of the assignment in a virtual space, and data indicating the gaze direction of the user of the VR device 11, detected by the VR device 11. The storage unit 13C generates and stores time-series data of the actions of the user of the VR device 11 from the data indicating the actions of the user of the VR device 11 performing the multiple tasks in the virtual space, acquired by the acquisition unit 13B, and also generates and stores time-series data of the gaze direction of the user of the VR device 11 from the data indicating the gaze direction of the user of the VR device 11 acquired by the acquisition unit 13B. The analysis means 13D visualizes changes in the movements of the user of the VR device 11 as he or she performs multiple tasks in a virtual space, based at least on time-series data of the movements of the user of the VR device 11 stored in the storage means 13C, and visualizes changes in the gaze direction of the user of the VR device 11, based on time-series data of the gaze direction of the user of the VR device 11 stored in the storage means 13C. The output means 13E outputs the results of the analysis by the analysis means 13D.
[0149] The above-mentioned work analysis device 13 has an internal computer system. Each process of the above-mentioned work analysis system 1 is stored in the form of a program on a computer-readable recording medium, and the above processes are performed by the computer reading and executing this program. Here, computer-readable recording medium refers to a magnetic disk, magneto-optical disk, CD-ROM, DVD-ROM, semiconductor memory, etc. Alternatively, the computer program may be distributed to a computer via a communication line, and the computer that receives the program may execute the program.
[0150] In addition, all or part of the functions of each unit of the work analysis device 13 in the above-described embodiment may be realized by recording a program for implementing those functions on a computer-readable recording medium and loading and executing the program on the recording medium into a computer system. Note that the term "computer system" as used herein includes hardware such as an OS and peripheral devices. It also includes a WWW system equipped with a website provision environment (or display environment). Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into computer systems. Furthermore, "computer-readable recording medium" also includes devices that retain programs for a certain period of time, such as volatile memory (RAM) within computer systems that function as servers or clients when a program is transmitted via a network such as the Internet or a communication line such as a telephone line.
[0151] The program may also be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may also be a program that realizes part of the aforementioned functions. Furthermore, the program may be a so-called differential file (differential program) that can realize the aforementioned functions in combination with a program already stored in the computer system.
[0152] In addition, the components in the above-described embodiments can be replaced with well-known components as appropriate without departing from the spirit of the present invention. Furthermore, the technical scope of the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention.
[0153] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.
[0154] (Supplementary Note 1) A task analysis apparatus comprising: an acquisition means for acquiring data indicating the movements of a user of a VR device performing a plurality of tasks in a virtual space, detected by the VR device, the user of the VR device performing the plurality of tasks in the virtual space, and data indicating the gaze direction of the user of the VR device detected by the VR device; a storage means for generating and storing time series data of the movements of the user of the VR device from the data indicating the movements of the user of the VR device performing the plurality of tasks in the virtual space acquired by the acquisition means, and for generating and storing time series data of the gaze direction of the user of the VR device from the data indicating the gaze direction of the user of the VR device acquired by the acquisition means; an analysis means for visualizing at least changes in the movements of the user of the VR device performing the plurality of tasks in the virtual space, based on the time series data of the movements of the user of the VR device stored in the storage means, and visualizing changes in the gaze direction of the user of the VR device based on the time series data of the gaze direction of the user of the VR device stored in the storage means; and an output means for outputting the results of the analysis by the analysis means.
[0155] (Appendix 2) The work analysis device described in Appendix 1, wherein the analysis means generates a trajectory of the positions at which the user of the VR device performs multiple tasks in a virtual space based on time series data of the user's movements of the VR device stored in the storage means.
[0156] (Supplementary Note 3) The acquisition means acquires data indicating the actions of one user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating the actions of another user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and the storage means generates and stores time-series data of the actions of the one user of the VR device from the data indicating the actions of the one user of the VR device performing a plurality of tasks in a virtual space, acquired by the acquisition means, and stores time-series data of the actions of the other user of the VR device from the data indicating the actions of the other user of the VR device performing a plurality of tasks in a virtual space, acquired by the acquisition means. and generating and storing time series data of the movements of a user of the VR device, the analysis means generating a trajectory of the positions at which a plurality of tasks are performed in the virtual space by the one user of the VR device based on the time series data of the movements of the one user of the VR device stored in the storage means, generating a trajectory of the positions at which a plurality of tasks are performed in the virtual space by the other users of the VR device based on the time series data of the movements of the other users of the VR device stored in the storage means, and comparing the trajectory of the positions at which a plurality of tasks are performed in the virtual space by the one user of the VR device with the trajectory of the positions at which a plurality of tasks are performed in the virtual space by the other users of the VR device.
[0157] (Supplementary Note 4) The acquisition means acquires information indicating whether the user of the VR device is right-handed or left-handed, and the acquisition means acquires data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating the actions of the left-handed user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and the storage means generates and stores time-series data of the actions of the right-handed user of the VR device from the data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space, acquired by the acquisition means, and stores the time-series data of the actions of the left-handed user of the VR device performing a plurality of tasks in a virtual space, acquired by the acquisition means. The work analysis device described in Appendix 2, wherein time series data of the movements of a left-handed user of the VR device is generated from data indicating the movements and stored, and the analysis means generates a trajectory of the positions at which multiple tasks are performed in the virtual space by the right-handed user of the VR device based on the time series data of the movements of the right-handed user of the VR device stored in the storage means, generates a trajectory of the positions at which multiple tasks are performed in the virtual space by the left-handed user of the VR device based on the time series data of the movements of the left-handed user of the VR device stored in the storage means, and compares the trajectory of the positions at which multiple tasks are performed in the virtual space by the right-handed user of the VR device with the trajectory of the positions at which multiple tasks are performed in the virtual space by the left-handed user of the VR device.
[0158] (Supplementary Note 5) The acquisition means acquires information indicating whether or not a user of the VR device has a skill, data indicating actions of a user of the VR device who has the skill detected by the VR device to perform a plurality of tasks in a virtual space, and data indicating actions of a user of the VR device who does not have the skill detected by the VR device to perform a plurality of tasks in a virtual space, and the storage means generates and stores time-series data of actions of the user of the VR device who has the skill from the data indicating actions of a user of the VR device who has the skill to perform a plurality of tasks in a virtual space acquired by the acquisition means, and stores the time-series data of actions of the user of the VR device who does not have the skill from the data indicating actions of a user of the VR device who does not have the skill to perform a plurality of tasks in a virtual space acquired by the acquisition means. and the analysis means generates and stores time series data of the movements of the VR device user who has the skill, based on the time series data of the movements of the VR device user who has the skill stored in the storage means, generates a trajectory of the positions at which multiple tasks are performed in the virtual space by the VR device user who does not have the skill, based on the time series data of the movements of the VR device user who does not have the skill stored in the storage means, and compares the trajectory of the positions at which multiple tasks are performed in the virtual space by the VR device user who has the skill with the trajectory of the positions at which multiple tasks are performed in the virtual space by the VR device user who does not have the skill.
[0159] (Supplementary Note 6) The work analysis device described in Supplementary Note 5, wherein the acquisition means acquires data indicating the actions of each of a plurality of users of the VR device who have the skill detected by the VR device to perform a plurality of tasks in a virtual space, the storage means generates and stores time series data of the actions of each of the plurality of users of the VR device who have the skill from the data indicating the actions of each of the plurality of users of the VR device who have the skill to perform a plurality of tasks in a virtual space, and the analysis means generates a trajectory of the performance positions of the plurality of tasks performed in the virtual space by each of the plurality of users of the VR device who have the skill based on the time series data of the actions of each of the plurality of users of the VR device who have the skill stored in the storage means, and extracts and visualizes a trajectory that satisfies a first condition from the trajectories of the plurality of users of the VR device who have the skill.
[0160] (Supplementary Note 7) The work analysis device described in Supplementary Note 5, wherein the acquisition means acquires data indicating the actions of each of a plurality of users of the VR device who have the skill detected by the VR device to perform a plurality of tasks in a virtual space, the storage means generates and stores time series data of the actions of each of the plurality of users of the VR device who have the skill from the data indicating the actions of each of the plurality of users of the VR device who have the skill to perform a plurality of tasks in a virtual space acquired by the acquisition means, and the analysis means generates a trajectory of the performance position of a plurality of tasks performed in a virtual space by each of the plurality of users of the VR device who have the skill based on the time series data of the actions of each of the plurality of users of the VR device who have the skill stored in the storage means, and extracts trajectories from the trajectories of the plurality of users of the VR device who have the skill that satisfy a second condition that the tendency of the task performance order is the same, and groups and summarizes the trajectories into tabular data.
[0161] (Supplementary Note 8) The work analysis device described in Supplementary Note 5, wherein the acquisition means acquires data indicating the actions of each of a plurality of users of the VR device who have the skill detected by the VR device, performing a plurality of tasks in a virtual space; the storage means generates and stores time series data of the actions of each of the plurality of users of the VR device who have the skill from the data indicating the actions of each of the plurality of users of the VR device who have the skill, performing a plurality of tasks in a virtual space, acquired by the acquisition means; the analysis means generates a trajectory of the performance positions of the plurality of tasks performed in the virtual space by each of the plurality of users of the VR device who have the skill, based on the time series data of the actions of each of the plurality of users of the VR device who have the skill stored in the storage means; and extracts the performance positions of the first task and the last task in a predetermined percentage or more of the trajectories of the plurality of users of the VR device who have the skill.
[0162] (Supplementary Note 9) The acquisition means acquires information indicating whether the user of the VR device is right-handed or left-handed, data indicating the actions of each of the multiple right-handed users of the VR device who have the skill detected by the VR device to perform a plurality of tasks in a virtual space, and data indicating the actions of each of the multiple left-handed users of the VR device who have the skill detected by the VR device to perform a plurality of tasks in a virtual space, and the storage means generates and stores time-series data of the actions of each of the multiple right-handed users of the VR device who have the skill from the data indicating the actions of each of the multiple right-handed users of the VR device who have the skill to perform a plurality of tasks in a virtual space acquired by the acquisition means, and the analysis means generates a trajectory of the position at which a plurality of tasks are performed in the virtual space by each of the plurality of right-handed users of the VR device and skilled based on the time series data of the movements of each of the plurality of right-handed users of the VR device and skilled, which is stored in the storage means; and generates a trajectory of the position at which a plurality of tasks are performed in the virtual space by each of the plurality of left-handed users of the VR device and skilled, based on the time series data of the movements of each of the plurality of left-handed users of the VR device and skilled, which is stored in the storage means; and extracts the position at which a first task is performed and the position at which a last task is performed in the trajectory of at least a predetermined percentage from the trajectories of the plurality of right-handed users of the VR device and skilled, and extracts the position at which a first task is performed and the position at which a last task is performed in the trajectory of at least a predetermined percentage from the trajectories of the plurality of left-handed users of the VR device and skilled.
[0163] (Appendix 10) The work analysis device described in Appendix 1, wherein the acquisition means acquires information indicating a correct performance order, which is the correct performance order of multiple tasks of a pre-specified task, the storage means stores the information indicating the correct performance order acquired by the acquisition means, and the analysis means determines whether the performance order of multiple tasks performed by a user of the VR device in a virtual space matches the correct performance order.
[0164] (Supplementary Note 11) The acquisition means acquires information indicating whether or not a user of the VR device has a skill, data indicating actions of a user of the VR device who has the skill detected by the VR device to perform a plurality of tasks in a virtual space, and data indicating actions of a user of the VR device who does not have the skill detected by the VR device to perform a plurality of tasks in a virtual space, and the storage means generates and stores time-series data of actions of a user of the VR device who has the skill from the data indicating actions of a user of the VR device who has the skill acquired by the acquisition means to perform a plurality of tasks in a virtual space, and stores time-series data of actions of a user of the VR device who does not have the skill acquired by the acquisition means to perform a plurality of tasks in a virtual space. The work analysis device described in Appendix 10, wherein time series data of the actions of the user of the VR device who does not have skills is generated from data indicating the actions to be performed and stored, and the analysis means determines whether the order in which the user of the VR device who has skills performs multiple tasks in the virtual space matches the correct order of performance, determines whether the order in which the user of the VR device who does not have skills performs multiple tasks in the virtual space matches the correct order of performance, and compares the determination result of whether the order in which the user of the VR device who has skills performs multiple tasks in the virtual space matches the correct order of performance with the determination result of whether the order in which the user of the VR device who does not have skills performs multiple tasks in the virtual space matches the correct order of performance.
[0165] (Supplementary Note 12) The acquisition means acquires information indicating whether the user of the VR device is right-handed or left-handed, data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating the actions of the left-handed user of the VR device performing a plurality of tasks in a virtual space, and the storage means generates and stores time-series data of the actions of the right-handed user of the VR device from the data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space acquired by the acquisition means, and stores the time-series data of the actions of the left-handed user of the VR device performing a plurality of tasks in a virtual space acquired by the acquisition means. and generating and storing time-series data of the movements of a left-handed user of the VR device from data indicating the movements of the left-handed user of the VR device to perform a task, and wherein the analysis means determines whether the order in which the right-handed user of the VR device performs a plurality of tasks in the virtual space matches the correct order of performance, determines whether the order in which the left-handed user of the VR device performs a plurality of tasks in the virtual space matches the correct order of performance, and compares the determination result of whether the order in which the right-handed user of the VR device performs a plurality of tasks in the virtual space matches the correct order of performance with the determination result of whether the order in which the left-handed user of the VR device performs a plurality of tasks in the virtual space matches the correct order of performance.
[0166] (Appendix 13) The acquisition means acquires information indicating a first correct performance order, which is the correct performance order of tasks from the first task onwards among the multiple tasks of the assignment, and information indicating a second correct performance order, which is the correct performance order of tasks from the second task onwards; the storage means stores the information indicating the first correct performance order and the information indicating the second correct performance order acquired by the acquisition means; and the analysis means determines whether the performance order of the multiple tasks from the first task onwards performed by the user of the VR device in the virtual space matches the first correct performance order, and determines whether the performance order of the multiple tasks from the second task onwards performed by the user of the VR device in the virtual space matches the second correct performance order. This is a work analysis device as described in Appendix 1.
[0167] (Appendix 14) The work analysis device described in Appendix 10, wherein the analysis means determines whether the order in which multiple tasks performed by the user of the VR device in the virtual space matches the correct order of tasks for each task performance position.
[0168] (Supplementary Note 15) The acquisition means acquires information indicating whether the user of the VR device is right-handed or left-handed, data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating the actions of the left-handed user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and the storage means stores time-series data of the actions of the right-handed user of the VR device from the data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space, acquired by the acquisition means. the analysis means generates and stores time series data of the movements of the left-handed user of the VR device from data indicating the movements of the left-handed user of the VR device as they perform a plurality of tasks in the virtual space, the analysis means determines for each task performance position whether the order in which the right-handed user of the VR device performs the plurality of tasks in the virtual space matches the correct performance order, and determines for each task performance position whether the order in which the left-handed user of the VR device performs the plurality of tasks in the virtual space matches the correct performance order.
[0169] (Supplementary Note 16) The acquisition means acquires information indicating whether or not a user of the VR device has a skill, data indicating actions of a user of the VR device who has the skill detected by the VR device to perform a plurality of tasks in a virtual space, and data indicating actions of a user of the VR device who does not have the skill detected by the VR device to perform a plurality of tasks in a virtual space, and the storage means generates and stores time-series data of actions of a user of the VR device who has the skill from the data indicating actions of a user of the VR device who has the skill to perform a plurality of tasks in a virtual space acquired by the acquisition means, and The work analysis device described in Appendix 14, wherein time series data of the movements of a user of the VR device who does not have skills is generated and stored, and the analysis means determines, for each work performance position, whether the order in which a plurality of tasks performed in the virtual space by a user of the VR device who has skills matches the correct performance order, determines, for each work performance position, whether the order in which a plurality of tasks performed in the virtual space by a user of the VR device who does not have skills matches the correct performance order, and compares, for each work performance position, the determination result of whether the order in which a plurality of tasks performed in the virtual space by a user of the VR device who has skills matches the correct performance order with the determination result of whether the order in which a plurality of tasks performed in the virtual space by a user of the VR device who does not have skills matches the correct performance order.
[0170] (Appendix 17) The analysis means of the work analysis device described in Appendix 10 determines whether the order in which multiple tasks are performed in the virtual space by each of the multiple users of the VR device matches the correct order of tasks, and extracts tasks from the multiple tasks of the assignment that are more likely to be performed by each of the multiple users of the VR device in an order different from the correct order of tasks than a predetermined threshold.
[0171] (Supplementary Note 18) The acquisition means acquires information indicating whether the user of the VR device is right-handed or left-handed, data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating the actions of the left-handed user of the VR device performing a plurality of tasks in a virtual space, and the storage means generates and stores time-series data of the actions of the right-handed user of the VR device from the data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space, acquired by the acquisition means, and stores time-series data of the actions of the left-handed user of the VR device from the data indicating the actions of the left-handed user of the VR device performing a plurality of tasks in a virtual space, acquired by the acquisition means. the analysis means generates and stores time-series data of the movements of left-handed users of the VR device, and determines whether the order in which multiple tasks are performed in the virtual space by each of the multiple right-handed users of the VR device matches the correct order of tasks, extracts tasks from the multiple tasks that are more likely to be performed in an order different from the correct order by each of the multiple right-handed users of the VR device than the predetermined threshold, determines whether the order in which multiple tasks are performed in the virtual space by each of the multiple left-handed users of the VR device matches the correct order of tasks, and extracts tasks from the multiple tasks that are more likely to be performed in an order different from the correct order by each of the multiple left-handed users of the VR device than the predetermined threshold.
[0172] (Appendix 19) The work analysis device described in Appendix 1, wherein the analysis means generates a trajectory of the gaze direction of the user of the VR device based on time series data of the gaze direction of the user of the VR device stored in the memory means.
[0173] (Appendix 20) The work analysis device described in Appendix 1, wherein the acquisition means acquires information indicating multiple tasks of a task that the user of the VR device needs to complete in a virtual space, and the analysis means extracts, from the multiple tasks of the task indicated by the information acquired by the acquisition means, tasks that the user of the VR device did not complete in the virtual space as tasks that were overlooked by the user of the VR device.
[0174] (Appendix 21) The work analysis device described in Appendix 20, wherein the acquisition means acquires information indicating whether the user of the VR device is right-handed or left-handed, and the analysis means extracts, from among the multiple tasks of the task indicated by the information acquired by the acquisition means, tasks that the right-handed user of the VR device did not perform in the virtual space as tasks that were overlooked by the right-handed user of the VR device, and extracts, from among the multiple tasks of the task indicated by the information acquired by the acquisition means, tasks that the left-handed user of the VR device did not perform in the virtual space as tasks that were overlooked by the left-handed user of the VR device.
[0175] (Appendix 22) The work analysis device described in Appendix 1, wherein the analysis means extracts timings when the gaze of the user of the VR device is not directed toward the position where the work being performed in the virtual space by the user of the VR device is being performed based on time series data of the movements of the user of the VR device and time series data of the gaze direction of the user of the VR device stored in the memory means.
[0176] (Supplementary Note 23) The acquisition means acquires information indicating whether the user of the VR device is right-handed or left-handed, data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space, data detected by the VR device indicating the actions of the left-handed user of the VR device performing a plurality of tasks in a virtual space, data indicating the line of sight of the right-handed user of the VR device detected by the VR device, and data indicating the line of sight of the left-handed user of the VR device detected by the VR device, and the storage means generates and stores time-series data of the actions of the right-handed user of the VR device from the data indicating the actions of the right-handed user of the VR device performing a plurality of tasks in a virtual space acquired by the acquisition means, and generates and stores time-series data of the line of sight of the right-handed user of the VR device from the data indicating the line of sight of the right-handed user of the VR device acquired by the acquisition means, and stores time-series data of the line of sight of the right-handed user of the VR device acquired by the acquisition means, The storage means generates and stores time series data of the movements of a left-handed user of the VR device from data indicating the movements of the left-handed user performing a plurality of tasks in a virtual space, and generates and stores time series data of the gaze direction of the left-handed user of the VR device from data indicating the gaze direction of the left-handed user of the VR device acquired by the acquisition means, and the analysis means analyzes the movement of the right-handed user of the VR device based on the time series data of the movements of the right-handed user of the VR device and the time series data of the gaze direction of the right-handed user of the VR device stored in the storage means. The work analysis device described in Appendix 22 extracts timings when the line of sight of a right-handed user of a device is not directed toward a position where a task is to be performed in a virtual space by a right-handed user of the VR device, and extracts timings when the line of sight of a left-handed user of the VR device is not directed toward a position where a task is to be performed in a virtual space by a left-handed user of the VR device based on time series data of the movements of a left-handed user of the VR device and time series data of the line of sight of the left-handed user of the VR device stored in the storage means.
[0177] (Supplementary Note 24) The work analysis device described in Supplementary Note 1, wherein the acquisition means acquires information indicating whether a user of the VR device has a skill, data showing movements of a user of the VR device with the skill detected by the VR device to perform multiple tasks in a virtual space, and data showing movements of a user of the VR device without the skill detected by the VR device to perform multiple tasks in a virtual space; the storage means generates and stores time series data of movements of the user of the VR device with the skill from the data showing movements of the user of the VR device with the skill to perform multiple tasks in a virtual space acquired by the acquisition means, and generates and stores time series data of movements of the user of the VR device without the skill from the data showing movements of the user of the VR device without the skill to perform multiple tasks in a virtual space acquired by the acquisition means; and the analysis means compares the time series data of movements of the user of the VR device with the skill stored in the storage means with the time series data of movements of the user of the VR device without the skill.
[0178] (Supplementary Note 25) The work analysis device described in Supplementary Note 24, wherein the acquisition means acquires data indicating the gaze direction of a user of the VR device who has a skill detected by the VR device and data indicating the gaze direction of a user of the VR device who does not have a skill detected by the VR device; the storage means generates and stores time series data of the gaze direction of the user of the VR device who has a skill from the data indicating the gaze direction of the user of the VR device who has a skill acquired by the acquisition means, and generates and stores time series data of the gaze direction of the user of the VR device who does not have a skill from the data indicating the gaze direction of the user of the VR device who does not have a skill acquired by the acquisition means; and the analysis means compares the time series data of the gaze direction of the user of the VR device who has a skill stored in the storage means with the time series data of the gaze direction of the user of the VR device who does not have a skill.
[0179] (Supplementary Note 26) The work analysis device described in Supplementary Note 1 or Supplementary Note 25, wherein the acquisition means acquires biometric information of a user of the VR device with a skill detected by a biometric sensor and biometric information of a user of the VR device without a skill by the biometric sensor, the storage means generates and stores time series data of the biometric information of the user of the VR device with a skill from the biometric information of the user of the VR device with a skill acquired by the acquisition means, and generates and stores time series data of the biometric information of the user of the VR device without a skill from the biometric information of the user of the VR device without a skill acquired by the acquisition means, and the analysis means compares the time series data of the biometric information of the user of the VR device with a skill stored in the storage means with the time series data of the biometric information of the user of the VR device without a skill.
[0180] (Appendix 27) The work analysis device described in Appendix 26, wherein the analysis means estimates the concentration level of the user of the VR device from the biometric information of the user of the VR device detected by the biometric sensor.
[0181] (Appendix 28) The work analysis device described in Appendix 27, wherein the analysis means visualizes the concentration level of the user of the VR device.
[0182] (Supplementary Note 29) The work analysis device described in Supplementary Note 28, wherein the acquisition means acquires information indicating whether or not a user of the VR device has a skill, biometric information of the user of the VR device who has the skill detected by the biometric sensor, and biometric information of the user of the VR device who does not have the skill detected by the biometric sensor, and the analysis means estimates and visualizes the concentration level of the user of the VR device who has the skill from the biometric information of the user of the VR device who has the skill acquired by the acquisition means, estimates and visualizes the concentration level of the user of the VR device who does not have the skill from the biometric information of the user of the VR device who does not have the skill acquired by the acquisition means, and compares the visualized concentration level of the user of the VR device who has the skill with the visualized concentration level of the user of the VR device who does not have the skill.
[0183] (Appendix 30) The work analysis device described in Appendix 1, wherein the acquisition means acquires biometric information of the user of the VR device detected by a biometric sensor, the storage means generates and stores time series data of the biometric information of the user of the VR device from the biometric information of the user of the VR device acquired by the acquisition means, and the analysis means estimates and analyzes time series changes in the concentration level of the user of the VR device from the time series data of the biometric information of the user of the VR device stored in the storage means.
[0184] (Supplementary Note 31) The acquisition means acquires information indicating whether or not a user of the VR device has a skill, biometric information of the user of the VR device who has a skill detected by the biometric sensor, and biometric information of the user of the VR device who does not have a skill detected by the biometric sensor, and the storage means generates and stores time-series data of the biometric information of the user of the VR device who has a skill from the biometric information of the user of the VR device who has a skill acquired by the acquisition means, and stores the time-series data of the biometric information of the user of the VR device who does not have a skill from the biometric information of the user of the VR device who does not have a skill acquired by the acquisition means. and the analysis means estimates and visualizes time series changes in the concentration of a user of the VR device who has a skill from the time series data of biometric information of the user of the VR device who has the skill stored in the storage means, estimates and visualizes time series changes in the concentration of a user of the VR device who does not have the skill from the time series data of biometric information of the user of the VR device who does not have the skill stored in the storage means, and compares the visualized time series changes in the concentration of the user of the VR device who has the skill with the visualized time series changes in the concentration of the user of the VR device who does not have the skill.
[0185] (Appendix 32) The work analysis device described in Appendix 26, wherein the analysis means estimates the stress level of the user of the VR device from the biometric information of the user of the VR device detected by the biometric sensor.
[0186] (Appendix 33) The work analysis device described in Appendix 32, wherein the analysis means visualizes the stress level of the user of the VR device.
[0187] (Appendix 34) The work analysis device described in Appendix 33, wherein the acquisition means acquires information indicating whether or not a user of the VR device has a skill, biometric information of the user of the VR device who has the skill detected by the biometric sensor, and biometric information of the user of the VR device who does not have the skill detected by the biometric sensor, and the analysis means estimates and visualizes the stress level of the user of the VR device who has the skill from the biometric information of the user of the VR device who has the skill acquired by the acquisition means, estimates and visualizes the stress level of the user of the VR device who does not have the skill from the biometric information of the user of the VR device who does not have the skill acquired by the acquisition means, and compares the visualized stress level of the user of the VR device who has the skill with the stress level of the user of the VR device who does not have the visualized skill.
[0188] (Appendix 35) The work analysis device described in Appendix 1, wherein the acquisition means acquires biometric information of the user of the VR device detected by a biometric sensor, the storage means generates and stores time series data of the biometric information of the user of the VR device from the biometric information of the user of the VR device acquired by the acquisition means, and the analysis means estimates and analyzes time series changes in the stress level of the user of the VR device from the time series data of the biometric information of the user of the VR device stored in the storage means.
[0189] (Supplementary Note 36) The acquisition means acquires information indicating whether or not a user of the VR device has a skill, biometric information of the user of the VR device who has a skill detected by the biometric sensor, and biometric information of the user of the VR device who does not have a skill detected by the biometric sensor, and the storage means generates and stores time series data of the biometric information of the user of the VR device who has a skill from the biometric information of the user of the VR device who has a skill acquired by the acquisition means, and stores time series data of the biometric information of the user of the VR device who does not have a skill from the biometric information of the user of the VR device who does not have a skill acquired by the acquisition means. The work analysis device described in Appendix 35, wherein the analysis means generates and stores data, and the analysis means estimates and visualizes time series changes in stress level of a user of the VR device who has a skill from time series data of biometric information of the user of the VR device who has the skill stored in the storage means, estimates and visualizes time series changes in stress level of a user of the VR device who does not have the skill from time series data of biometric information of the user of the VR device who does not have the skill stored in the storage means, and compares the visualized time series changes in stress level of the user of the VR device who has the skill with the visualized time series changes in stress level of the user of the VR device who does not have the skill.
[0190] (Appendix 37) The work analysis device described in Appendix 1, wherein the analysis means analyzes the emotions of the user of the VR device from biometric information of the user of the VR device detected by a biometric sensor.
[0191] (Appendix 38) The work analysis device described in Appendix 37, wherein the acquisition means acquires information indicating whether the user of the VR device has a skill, biometric information of the user of the VR device who has a skill detected by the biometric sensor, and biometric information of the user of the VR device who does not have a skill detected by the biometric sensor, and the analysis means analyzes the emotions of the user of the VR device who has a skill from the biometric information of the user of the VR device who has a skill acquired by the acquisition means, analyzes the emotions of the user of the VR device who does not have a skill from the biometric information of the user of the VR device who does not have a skill acquired by the acquisition means, and compares the emotions of the user of the VR device who has a skill with the emotions of the user of the VR device who does not have a skill.
[0192] (Appendix 39) The work analysis device described in Appendix 1, wherein the acquisition means acquires biometric information of the user of the VR device detected by a biometric sensor, the storage means generates and stores time series data of the biometric information of the user of the VR device from the biometric information of the user of the VR device acquired by the acquisition means, and the analysis means determines whether the user of the VR device has failed in any of a plurality of tasks being performed in a virtual space based on the time series data of the movements of the user of the VR device stored in the storage means, and if the user of the VR device has failed in any of the plurality of tasks being performed in the virtual space, extracts a change in the biometric information of the user of the VR device at the time when the user of the VR device failed in any of the plurality of tasks being performed in the virtual space based on the time series data of the biometric information of the user of the VR device stored in the storage means and the time series data of the movements of the user of the VR device stored in the storage means.
[0193] (Supplementary Note 40) The work analysis device described in Supplementary Note 1, wherein the acquisition means acquires biometric information of the user of the VR device detected by a biometric sensor, the storage means generates and stores time series data of the biometric information of the user of the VR device from the biometric information of the user of the VR device acquired by the acquisition means, and the analysis means determines whether the user of the VR device has succeeded in any of a plurality of tasks being performed in a virtual space based on the time series data of the movements of the user of the VR device stored in the storage means, and if the user of the VR device has succeeded in any of the plurality of tasks being performed in the virtual space, extracts a change in the biometric information of the user of the VR device at the time when the user of the VR device succeeded in any of the plurality of tasks being performed in the virtual space based on the time series data of the biometric information of the user of the VR device stored in the storage means and the time series data of the movements of the user of the VR device stored in the storage means.
[0194] (Supplementary Note 41) A system includes a VR device that presents a plurality of tasks of a task in a virtual space, and a task analysis device that analyzes the plurality of tasks performed by a user of the VR device, wherein the VR device detects the actions of the user of the VR device performing the plurality of tasks in the virtual space and the line of sight of the user of the VR device, and the task analysis device includes an acquisition means that acquires data indicating the actions of the user of the VR device performing the plurality of tasks in the virtual space detected by the VR device and data indicating the line of sight of the user of the VR device detected by the VR device, and an acquisition means that acquires the data indicating the actions of the user of the VR device performing the plurality of tasks in the virtual space acquired by the acquisition means. a storage means for generating and storing time series data of the movements of a user of a VR device, and generating and storing time series data of the gaze direction of the user of the VR device from data indicating the gaze direction of the user of the VR device acquired by the acquisition means; an analysis means for visualizing changes in the movements of the user of the VR device as they perform multiple tasks in a virtual space, based on the time series data of the movements of the user of the VR device stored in the storage means, and visualizing changes in the gaze direction of the user of the VR device, based on the time series data of the gaze direction of the user of the VR device stored in the storage means; and an output means for outputting the results of the analysis by the analysis means.
[0195] (Appendix 42) A task analysis method comprising: an acquisition step of acquiring data indicating the actions of a user of a VR device performing a plurality of tasks in a virtual space, the data being detected by the VR device; and data indicating the gaze direction of the user of the VR device, the data being detected by the VR device; a storage step of generating and storing time series data of the actions of the user of the VR device from the data indicating the actions of the user of the VR device performing a plurality of tasks in the virtual space acquired in the acquisition step, and generating and storing time series data of the gaze direction of the user of the VR device from the data indicating the gaze direction of the user of the VR device acquired in the acquisition step; an analysis step of visualizing at least changes in the actions of the user of the VR device performing a plurality of tasks in the virtual space, based on the time series data of the actions of the user of the VR device stored in the storage step, and visualizing changes in the gaze direction of the user of the VR device based on the time series data of the gaze direction of the user of the VR device stored in the storage step; and an output step of outputting results of the analysis in the analysis step.
[0196] (Appendix 43) A storage medium storing a program for causing a computer to execute the following steps: an acquisition step of acquiring data indicating the actions of a user of a VR device performing multiple tasks in a virtual space, detected by the VR device, which presents multiple tasks of the assignment in a virtual space, and data indicating the gaze direction of the user of the VR device detected by the VR device; a storage step of generating and storing time series data of the actions of the user of the VR device from the data indicating the actions of the user of the VR device performing multiple tasks in the virtual space acquired in the acquisition step, and generating and storing time series data of the gaze direction of the user of the VR device from the data indicating the gaze direction of the user of the VR device acquired in the acquisition step; an analysis step of visualizing at least changes in the actions of the user of the VR device performing multiple tasks in a virtual space, based on the time series data of the actions of the user of the VR device stored in the storage step, and visualizing changes in the gaze direction of the user of the VR device based on the time series data of the gaze direction of the user of the VR device stored in the storage step; and an output step of outputting the results of the analysis in the analysis step.
[0197] The work analysis device, work analysis system, work analysis method, and storage medium of the present invention are applicable to training in which a plurality of tasks are performed in a virtual space using a VR device.
[0198] REFERENCE SIGNS LIST 1 Work analysis system 11 VR device 11A Presentation means 11B Movement detection means 11C Gaze direction detection means 11D Communication means 11E Posture estimation means 11F Speech estimation means 12 Biometric sensor 12A Detection means 12B Communication means 13 Work analysis device 13A Communication means 13B Acquisition means 13C Storage means 13D Analysis means 13E Output means
Claims
1. an acquisition means for acquiring data indicating the actions of a user of a VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating the line of sight of the user of the VR device, detected by the VR device; a storage means for generating and storing time series data of the actions of the user of the VR device from data indicating the actions of the user of the VR device performing a plurality of tasks in a virtual space, the data being acquired by the acquisition means, and for generating and storing time series data of the line of sight of the user of the VR device from data indicating the line of sight of the user of the VR device, the data being acquired by the acquisition means; analysis means for visualizing changes in the actions of the user of the VR device performing a plurality of tasks in a virtual space based on time-series data of the actions of the user of the VR device stored in the storage means, and for visualizing changes in the line of sight of the user of the VR device based on time-series data of the line of sight of the user of the VR device stored in the storage means; and an output means for outputting the results of the analysis by the analysis means. Work analysis device.
2. The analysis means generates a trajectory of a position where a user of the VR device performs a plurality of tasks in a virtual space based on time-series data of the user's actions stored in the storage means. The work analysis device according to claim 1 .
3. the acquiring means acquires data indicating actions of one user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating actions of another user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device; The storage means generates and stores time series data of the actions of one user of the VR device from data acquired by the acquisition means indicating the actions of the one user of the VR device performing a plurality of tasks in a virtual space, and generates and stores time series data of the actions of another user of the VR device from data acquired by the acquisition means indicating the actions of the other user of the VR device performing a plurality of tasks in a virtual space, The analysis means generating a trajectory of a position where a user of the VR device performs a plurality of tasks in a virtual space based on time-series data of the actions of the user of the VR device stored in the storage means; generating a trajectory of a position where the other user of the VR device performs a plurality of tasks in a virtual space based on time-series data of the actions of the other user of the VR device stored in the storage means; comparing a trajectory of a position where a user of the VR device performs a plurality of tasks in a virtual space with a trajectory of a position where another user of the VR device performs a plurality of tasks in a virtual space; The work analysis device according to claim 2 .
4. the acquiring means acquires information indicating whether the user of the VR device is right-handed or left-handed; the acquiring means acquires data indicating actions of a right-handed user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating actions of a left-handed user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device; The storage means generates and stores time series data of the movements of a right-handed user of the VR device from data acquired by the acquisition means showing the movements of the right-handed user of the VR device performing a plurality of tasks in a virtual space, and also generates and stores time series data of the movements of a left-handed user of the VR device from data acquired by the acquisition means showing the movements of the left-handed user of the VR device performing a plurality of tasks in a virtual space, The analysis means generating a trajectory of a position where a right-handed user of the VR device performs a plurality of tasks in a virtual space based on time-series data of the actions of the right-handed user of the VR device stored in the storage means; generating a trajectory of a position where a left-handed user of the VR device performs a plurality of tasks in a virtual space based on time-series data of the actions of the left-handed user of the VR device stored in the storage means; A trajectory of a position where a right-handed user of the VR device performs a plurality of tasks in a virtual space is compared with a trajectory of a position where a left-handed user of the VR device performs a plurality of tasks in a virtual space. The work analysis device according to claim 2 .
5. The acquisition means acquires information indicating whether or not a user of the VR device has a skill, data indicating actions of a user of the VR device who has the skill detected by the VR device performing a plurality of tasks in a virtual space, and data indicating actions of a user of the VR device who does not have the skill detected by the VR device performing a plurality of tasks in a virtual space, The storage means generates and stores time series data of the movements of the user of the VR device who has the skill from data indicating the movements of the user of the VR device who has the skill acquired by the acquisition means as he performs a plurality of tasks in a virtual space, and generates and stores time series data of the movements of the user of the VR device who does not have the skill from data indicating the movements of the user of the VR device who does not have the skill as he performs a plurality of tasks in a virtual space, The analysis means generating a trajectory of a position where a user of the VR device having a skill performs a plurality of tasks in a virtual space based on time-series data of the actions of the user of the VR device having the skill stored in the storage means; generating a trajectory of a position where a user of the VR device without skills performs a plurality of tasks in a virtual space based on time-series data of the actions of the user of the VR device without skills stored in the storage means; A trajectory of a position where a skilled user of the VR device performs a plurality of tasks in a virtual space is compared with a trajectory of a position where an unskilled user of the VR device performs a plurality of tasks in a virtual space. The work analysis device according to claim 2 .
6. the acquisition means acquires data indicating actions of a plurality of users of the VR device who have the skills detected by the VR device, performing a plurality of tasks in a virtual space; the storage means generates and stores time-series data of the actions of each of the plurality of users of the VR device who have the skill from data indicating the actions of each of the plurality of users of the VR device who have the skill acquired by the acquisition means to perform a plurality of tasks in a virtual space; The analysis means generating a trajectory of a position where each of the plurality of users of the VR device having a skill performs a plurality of tasks in a virtual space based on time series data of the actions of each of the plurality of users of the VR device having a skill stored in the storage means; extracting and visualizing trajectories that satisfy a first condition from trajectories of a plurality of users of the VR device who have skills; The work analysis device according to claim 5 .
7. the acquisition means acquires data indicating actions of a plurality of users of the VR device who have the skills detected by the VR device, performing a plurality of tasks in a virtual space; the storage means generates and stores time-series data of the actions of each of the plurality of users of the VR device who have the skill from data indicating the actions of each of the plurality of users of the VR device who have the skill acquired by the acquisition means to perform a plurality of tasks in a virtual space; The analysis means generating a trajectory of a position where each of the plurality of users of the VR device having a skill performs a plurality of tasks in a virtual space based on time series data of the actions of each of the plurality of users of the VR device having a skill stored in the storage means; extracting trajectories that satisfy a second condition that the order of performing tasks is the same from the trajectories of the multiple users of the VR device who have the skill, and grouping and compiling the trajectories into tabular data; The work analysis device according to claim 5 .
8. a VR device that presents a plurality of tasks of a task in a virtual space; and a task analysis device that analyzes the plurality of tasks performed by a user of the VR device; the VR device detects the actions of a user of the VR device performing a plurality of tasks in a virtual space and the line of sight of the user of the VR device; The work analysis device an acquisition means for acquiring data indicating actions of a user of the VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating a line of sight direction of the user of the VR device, detected by the VR device; a storage means for generating and storing time series data of the actions of the user of the VR device from data indicating the actions of the user of the VR device performing a plurality of tasks in a virtual space, the data being acquired by the acquisition means, and for generating and storing time series data of the line of sight of the user of the VR device from data indicating the line of sight of the user of the VR device, the data being acquired by the acquisition means; analysis means for visualizing changes in the actions of the user of the VR device performing a plurality of tasks in a virtual space based on time-series data of the actions of the user of the VR device stored in the storage means, and for visualizing changes in the line of sight of the user of the VR device based on time-series data of the line of sight of the user of the VR device stored in the storage means; and an output means for outputting the results of the analysis by the analysis means. Work analysis system.
9. an acquisition step of acquiring data indicating actions of a user of a VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating a line of sight of the user of the VR device, detected by the VR device; a storage step of generating and storing time series data of the actions of the user of the VR device from data indicating the actions of the user of the VR device performing a plurality of tasks in a virtual space, which data was acquired in the acquisition step, and generating and storing time series data of the line of sight direction of the user of the VR device from data indicating the line of sight direction of the user of the VR device, which data was acquired in the acquisition step; an analysis step of visualizing changes in the actions of the user of the VR device performing a plurality of tasks in a virtual space based on time-series data of the actions of the user of the VR device stored in at least the storage step, and visualizing changes in the gaze direction of the user of the VR device based on time-series data of the gaze direction of the user of the VR device stored in the storage step; and an output step of outputting a result of the analysis in the analysis step. Work analysis method.
10. On the computer, an acquisition step of acquiring data indicating actions of a user of a VR device performing a plurality of tasks in a virtual space, detected by the VR device, and data indicating a line of sight of the user of the VR device, detected by the VR device; a storage step of generating and storing time series data of the actions of the user of the VR device from data indicating the actions of the user of the VR device performing a plurality of tasks in a virtual space, which data was acquired in the acquisition step, and generating and storing time series data of the line of sight direction of the user of the VR device from data indicating the line of sight direction of the user of the VR device, which data was acquired in the acquisition step; an analysis step of visualizing changes in the actions of the user of the VR device performing a plurality of tasks in a virtual space based on time-series data of the actions of the user of the VR device stored in at least the storage step, and visualizing changes in the gaze direction of the user of the VR device based on time-series data of the gaze direction of the user of the VR device stored in the storage step; and an output step of outputting the results of the analysis in the analysis step.
