Training support system, training support method, and training support program
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- NEC PLATFROMS LTD
- Filing Date
- 2025-01-22
- Publication Date
- 2026-08-03
Smart Images
Figure 2026125370000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a training support system, a training support method, and a training support program.
Background Art
[0002] In order to improve the proficiency of workers, work training is carried out in a VR (Virtual Reality) space for training that simulates the work environment. For example, Patent Document 1 discloses a system in which a worker (hereinafter, trainee) who receives training can perform ship handling training even at a remote location by means of a ship handling training environment constructed in a metaverse space. In the system of Patent Document 1, an instructor can access the metaverse space from his or her own terminal and check the ship handling situation of the trainee.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] When an instructor gives an instruction to a place that the trainee cannot see, there is a risk that the instruction cannot be clearly conveyed to the trainee simply by pointing to the place or explaining it verbally. Therefore, the communication cost increases.
[0005] The present disclosure aims to provide a training support system, a training support method, and a training support program that enable smooth communication between an instructor and a trainee.
Means for Solving the Problems
[0006] The training support system relating to this disclosure includes a marker setting unit that sets a marker at any position in a virtual space in response to an instructor's operation, and an instruction image generation unit that generates an instruction image to make the trainee recognize the position of the marker, wherein the instruction image is superimposed on the trainee's field of view in the virtual space.
[0007] The training support method relating to this disclosure comprises the steps of: setting a marker at an arbitrary position in a virtual space in response to an instructor's operation; generating an instruction image to make the trainee recognize the position of the marker; and superimposing the instruction image onto the trainee's field of view in the virtual space.
[0008] The training support program relating to this disclosure causes a computer to perform the following processes: setting a marker at an arbitrary position in a virtual space in response to an instructor's operation; generating an instruction image to make the trainee recognize the position of the marker; and superimposing the instruction image onto the trainee's field of view in the virtual space. [Effects of the Invention]
[0009] This disclosure enables the provision of a training support system, training support method, and training support program that facilitate smooth communication between instructors and trainees. [Brief explanation of the drawing]
[0010] [Figure 1] This figure shows an example of the configuration of the training support system related to this disclosure. [Figure 2] This figure shows another example of the configuration of the training support system related to this disclosure. [Figure 3] This figure shows an example of a virtual space in which trainees conduct work training. [Figure 4] This figure shows an example of a trainee's field of view in a virtual space where they conduct work training. [Figure 5] This figure shows an example of an instruction image. [Figure 6] This figure shows an example of a trainee's field of view with an instruction image superimposed. [Figure 7] It is a flowchart showing an example of a training support method according to the present disclosure. [Figure 8] It is a diagram showing another example of the configuration of a training support system according to the present disclosure. [Figure 9] It is a diagram showing another example of an instruction image. [Figure 10] It is a diagram showing another example of the field of view of a trainee with an instruction image superimposed. [Figure 11] It is a diagram showing another example of the field of view of a trainee with an instruction image superimposed. [Figure 12] It is a flowchart showing another example of a training support method according to the present disclosure. [Figure 13] It is a diagram showing another example of the configuration of a training support system according to the present disclosure. [Figure 14] It is a diagram showing an example of the field of view of a trainee with a text message superimposed. [Figure 15] It is a diagram showing another example of the configuration of a training support system according to the present disclosure. [Figure 16] It is a diagram showing another example of the configuration of a training support system according to the present disclosure. [Figure 17] It is a block diagram showing an example of the hardware configuration for realizing the training support function of a training support system according to the present disclosure.
Mode for Carrying Out the Invention
[0011] (Embodiment 1) <Overview of the Training Support System> First, the overview of the training support system 1 will be described. The training support system 1 according to the present disclosure is a system that supports the work training of workers in a virtual space for training that simulates a work environment and is generated using VR (Virtual Reality) technology. Hereinafter, the worker who undergoes work training by the training support system 1 will be referred to as a trainee, and the person who gives instructions to the trainee will be referred to as an instructor. The training support system 1 is communicably connected to user devices such as, for example, an HMD (Head Mounted Display) and a controller.
[0012] The training support system 1 displays an image of a virtual space on a display device (such as an HMD) of the trainee. The trainee uses a user device such as an HMD or a controller to operate their own avatar in the virtual space and conduct work training in that virtual space.
[0013] While the trainee is in the virtual space, the instructor can be in either the virtual space or the real space. When the instructor is in the virtual space, the instructor also wears a user device such as an HMD or a controller, similar to the trainee. Then, the instructor operates their own avatar in the virtual space using a user device such as an HMD or a controller. On the other hand, when the instructor is in the real space, for example, the training support system 1 outputs an image of the virtual space to a monitor. Then, the instructor checks the virtual space from the image displayed on the monitor. Also, the instructor can be in a place separated from the trainee or near the trainee, either in the virtual space or the real space.
[0014] In the work training of the trainee in the virtual space, the trainee and the instructor need to communicate with each other. The training support system 1 according to the present disclosure supports the mutual communication between the trainee and the instructor. Note that the work training in the present disclosure is, for example, work training in a dangerous place, and includes, but is not particularly limited to, repair work on high-voltage lines and electrical equipment, work involving handling of chemical substances, explosives, radioactive substances, etc. Of course, the work training in the present disclosure may also be simple work without danger.
[0015] <Configuration of the training support system> Hereinafter, a configuration example of the training support system 1 will be described with reference to FIG. 1. FIG. 1 is a diagram showing an example of the configuration of the training support system according to the present disclosure. As shown in FIG. 1, the training support system 1 includes a marker setting unit 101 and an instruction image generation unit 103.
[0016] The marker setting unit 101 sets markers at any location in the virtual space, at least in response to the instructor's operation. For example, the instructor can set markers by operating a controller. Alternatively, the instructor may select a marker to set from, for example, several different types of markers with different display modes. This allows the instructor to set a priority for each marker. By setting markers at any location in the virtual space in this way, the instructor can clearly communicate instructions to the trainee. Therefore, smooth communication between the instructor and trainee is possible during training in the virtual space.
[0017] The instruction image generation unit 103 generates an instruction image that allows the trainee to recognize the position of the marker set by the marker setting unit 101. The instruction image generated by the instruction image generation unit 103 is superimposed on the trainee's field of view in the virtual space. That is, even if a marker is set in a position that the trainee cannot see, they can recognize the position of the marker by checking the instruction image superimposed on their field of view. Therefore, the instruction image that allows the trainee to recognize the position of the marker makes it easier for the trainee to grasp the instructor's instructions. Thus, smoother communication between the instructor and trainee is possible during training in the virtual space.
[0018] As described above, the training support system 1 sets a marker at any position in the virtual space, at least in response to the instructor's operation. The training support system 1 then generates an instruction image that allows the trainee to recognize the position of the marker set by the marker setting unit 101. The instruction image is superimposed on the trainee's field of view in the virtual space. According to Embodiment 1, the instructor and trainee can communicate smoothly during training in the virtual space.
[0019] (Embodiment 2) <Configuration of the training support system> Below, another example of the training support system will be explained using Figure 2. Figure 2 is a diagram showing another example of the configuration of the training support system according to this disclosure. As described in Embodiment 1, the training support system 1 according to this disclosure is a system that conducts work training for trainees in a virtual space for training that mimics the work environment, generated using VR (Virtual Reality) technology. The training support system 1 also supports mutual communication between trainees and instructors.
[0020] As shown in Figure 2, the training support system 1 comprises a control server 10, a trainee device 20, an instructor device 30, and a virtual space generation server 40.
[0021] The control server 10 is configured to communicate with the trainee device 20, the instructor device 30, and the virtual space generation server 40. The control server 10 performs various controls related to the virtual space provided to the trainee and the instructor. Details of the control server 10 will be described later.
[0022] The trainee device 20 is a device for the trainee, including, for example, an HMD or a controller. Figure 3 is a diagram showing an example of a virtual space in which the trainee performs work training. As shown in Figure 3, the trainee uses the trainee device 20 to operate their own avatar (hereinafter referred to as the trainee avatar U1) in the virtual space S. That is, the trainee performs work training in the virtual space S by operating the trainee avatar U1. One or more types of objects O are placed in the virtual space S. In the following description, the xyz 3D Cartesian coordinate system will be used as appropriate. In this disclosure, the z-axis direction is defined as the vertical direction, and the xy-plane is defined as the horizontal plane. Of course, the z-axis direction may be inclined from the vertical direction, and the xy-plane may also be a plane inclined from the horizontal plane.
[0023] The configuration of the trainee device 20 will now be described. As shown in Figure 2, the trainee device 20 includes a marker setting means 201, a posture and motion acquisition means 202, and an image display means 203.
[0024] The marker setting means 201 is provided, for example, in the controller. The trainee can operate the marker setting means 201 to set a marker at any position in the virtual space S. For example, the trainee can place a marker on an object O placed in the virtual space S. The trainee may also select a marker to set from, for example, several different display modes of markers. This allows the trainee to set a priority for each marker. In addition, the marker setting means 201 may include, for example, a tablet device or a stylus, and the trainee can set handwritten markers using the tablet device or stylus. The marker setting means 201 transmits information about the marker, such as the position and display mode of the marker set by the trainee, to the control server 10.
[0025] The posture and motion acquisition means 202 acquires information about the posture and motion of the person being trained. The posture and motion acquisition means 202 includes various sensors capable of detecting posture, motion, or both, such as an acceleration sensor, a gyroscope, and an optical sensor. The posture and motion acquisition means 202 transmits the information about the posture and motion of the person being trained to the control server 10.
[0026] The image display means 203 is, for example, a display unit (display) provided on the HMD. Figure 4 is a diagram showing an example of the field of view of a trainee in a virtual space where the trainee performs work training. A trainee wearing an HMD can obtain a field of view in the virtual space S shown in Figure 4, with the image display means 203 positioned in the field of view.
[0027] The instructor device 30 is a device for the instructor, including, for example, an HMD or controller. As shown in Figure 2, the instructor device 30 comprises a marker setting means 301, a posture and motion acquisition means 302, and an image display means 303. The marker setting means 301, posture and motion acquisition means 302, and image display means 303 each have the same configuration as the marker setting means 201, posture and motion acquisition means 202, and image display means 203 of the trainee device 20, respectively, so their description is omitted. Note that if the instructor is in the real world, the image display means 303 may be, for example, a monitor.
[0028] The virtual space generation server 40 is a server that generates a virtual space S provided to trainees and instructors. As shown in Figure 2, the virtual space generation server 40 comprises a database 401 and a virtual space generation means 402.
[0029] Database 401 stores configuration data related to the environment and avatars of the virtual space S. Regarding the environment of the virtual space S, for example, the image setting data defined in 3D coordinates within the virtual space S, such as objects existing in the virtual space S and the range in which avatars can move, is stored in database 401. In addition, setting data related to senses other than sight, such as sound, may also be stored in database 401.
[0030] Regarding avatars, for example, configuration data for avatars that can be operated by users (including trainees and instructors) who have access to the virtual space S is stored in database 401. The configuration data also includes information about the user of the avatar. The configured avatar can move around within the virtual space S through operation from user devices (including trainee devices 20 and instructor devices 30). Furthermore, the position of the avatar in the virtual space S is defined in 3D coordinates and is updated as needed through user operation.
[0031] The virtual space generation means 402 generates a virtual space S based on the configuration data stored in the database 401. The virtual space generation means 402 transmits information about the generated virtual space S to the control server 10.
[0032] Here, we will explain the control server 10 in detail. As mentioned above, the control server 10 performs various controls related to the virtual space S provided to the trainee and the instructor. As shown in Figure 2, the control server 10 includes a marker setting unit 101, a trainee position information acquisition unit 102, an instruction image generation unit 103, an instructor position information acquisition unit 104, and an instructor field of view image generation unit 105.
[0033] The marker setting unit 101 sets a marker at any position in the virtual space S, at least in response to the operation of the instructor's marker setting means 301. Of course, the marker may also be set at any position in the virtual space S in response to the operation of the trainee's marker setting means 201. An example of setting a marker in response to the operation of the instructor's marker setting means 301 will be described below.
[0034] The marker setting unit 101 acquires information about the markers, such as the position and display mode of the markers set by the instructor, from the marker setting means 301. The marker setting unit 101 also acquires information about the generated virtual space S from the virtual space generation means 402. The marker setting unit 101 then sets the markers in the virtual space S by associating the marker information with the virtual space S. The marker setting unit 101 outputs information indicating the virtual space S to which the marker information is associated to the instruction image generation unit 103 and the instructor's field of view image generation unit 105.
[0035] The trainee location information acquisition unit 102 acquires the location information of the trainee, i.e., the trainee avatar U1, in the virtual space S. The trainee location information acquisition unit 102 acquires the location information of the trainee avatar U1 from the information on the trainee's posture and movements received from the posture and movement acquisition means 202. The trainee location information acquisition unit 102 then outputs the acquired location information of the trainee avatar U1 to the instruction image generation unit 103.
[0036] The instruction image generation unit 103 generates an instruction image that allows the trainee to recognize the position of a marker set by the instructor. Based on the position information of the trainee avatar U1, the instruction image generation unit 103 generates an instruction image that includes an area outside the trainee avatar U1's field of view. Figure 5 shows an example of an instruction image. The instruction image G1 shown in Figure 5 is an image in which the marker M is displayed on a 360° image from the trainee avatar U1's viewpoint. The 360° image may also be a video. The method for generating the instruction image G1 shown in Figure 5 will be described below.
[0037] The instruction image generation unit 103 obtains information from the marker setting unit 101 indicating a virtual space S to which information about marker M is associated. The instruction image generation unit 103 also obtains the location information of the trainee avatar U1 from the trainee location information acquisition unit 102. The instruction image generation unit 103 calculates the viewpoint position of the trainee avatar U1 from the location information of the trainee avatar U1. The instruction image generation unit 103 sets up a virtual camera on the calculated viewpoint position and uses the virtual camera to acquire a 360° image with the z-axis on the viewpoint position as the rotation center. The image acquired by the instruction image generation unit 103 in this way is a 360° image from the viewpoint of the trainee avatar U1. Next, the instruction image generation unit 103 generates instruction image G1 by displaying marker M on the 360° image from the viewpoint of the trainee avatar U1, based on the information indicating a virtual space S to which information about marker M is associated.
[0038] The instruction image generation unit 103 transmits the generated instruction image G1 to at least the trainee's image display means 203. Of course, the instruction image generation unit 103 may also transmit the generated instruction image to the instructor's image display means 303. Figure 6 is a diagram showing an example of the trainee's field of view with the instruction image superimposed. The instruction image G1 transmitted to the trainee's image display means 203 is superimposed on the trainee's field of view V, as shown in Figure 6. That is, even if a marker M is set in a position that the trainee cannot see, the trainee can recognize the position of the marker M by checking the instruction image G1 superimposed on the field of view V. Therefore, the instruction image G1 that makes the trainee recognize the position of the marker M makes it easier for the trainee to grasp the instructor's instructions. Thus, the instructor and trainee can communicate smoothly in training in a virtual space.
[0039] The instructor location information acquisition unit 104 acquires the location information of the instructor, i.e., the instructor avatar, in the virtual space S if the instructor is in the same virtual space S as the trainee. The instructor location information acquisition unit 104 acquires the location information of the instructor avatar from the information on the instructor's posture and movements received from the posture and movement acquisition means 302. The instructor location information acquisition unit 104 then outputs the acquired location information of the instructor avatar to the instructor field of view image generation unit 105.
[0040] The instructor's field of view image generation unit 105 generates an image of the instructor's field of view. The instructor's field of view image generation unit 105 obtains information from the marker setting unit 101 indicating a virtual space S to which information about marker M is associated. The instructor's field of view image generation unit 105 also obtains the position information of the instructor avatar from the instructor position information acquisition unit 104. The instructor's field of view image generation unit 105 calculates the viewpoint position of the instructor avatar from the position information of the instructor avatar. The instructor's field of view image generation unit 105 sets up a virtual camera on the calculated viewpoint position and acquires an image of the instructor's field of view. Next, the instructor's field of view image generation unit 105 displays marker M on the instructor's field of view image based on the information indicating a virtual space S to which information about marker M is associated.
[0041] The instructor's field of view image generation unit 105 transmits the instructor's field of view image, in which the marker M is displayed, to at least the trainee's image display means 203. The trainee can switch between the field of view V, in which the instruction image G1 is superimposed, and the instructor's field of view image in which the marker M is displayed, as displayed on the image display means 203. By referring to the instructor's field of view image in which the marker M is displayed, in addition to the instruction image G1, the trainee can better recognize the position of the marker M. Therefore, the trainee can better grasp the instructor's instructions. Consequently, the instructor and trainee can communicate smoothly during training in the virtual space.
[0042] The configuration of the training support system 1 has been described above. Note that the instructor position information acquisition unit 104 and the instructor field of view image generation unit 105 are not essential components. Therefore, the training support system 1 does not need to include the instructor position information acquisition unit 104 and the instructor field of view image generation unit 105. In addition, the marker setting unit 101, the trainee position information acquisition unit 102, the instruction image generation unit 103, the instructor position information acquisition unit 104, and the instructor field of view image generation unit 105 may be implemented on a server or device other than the control server 10.
[0043] Furthermore, the training support system 1 may superimpose the instruction image G1 onto the trainee's field of view V, and may also present the trainee with specific task instructions, such as "rotate" or "cut," at the location where marker M is displayed.
[0044] <Training support method> Next, an example of a training support method will be explained using Figure 7. Figure 7 is a flowchart of an example of a training support method according to this disclosure. The flowchart shown in Figure 7 is triggered when at least one instructor operates the marker setting means 301 to set a marker M at an arbitrary position in the virtual space S.
[0045] First, the marker setting unit 101 sets a marker M at any position in the virtual space S, at least in response to the instructor's operation of the marker setting means 301 (step S101). The marker setting unit 101 obtains information about the marker M, such as the position and display mode of the marker M set by the instructor, from the instructor's marker setting means 301. The marker setting unit 101 also obtains information about the generated virtual space S from the virtual space generation means 402. Then, the marker setting unit 101 sets the marker M in the virtual space S by associating the marker information with the virtual space S. The marker setting unit 101 outputs information indicating the virtual space S to which the marker M information is associated to the instruction image generation unit 103.
[0046] Next, the trainee location information acquisition unit 102 acquires the location information of the trainee, i.e., the trainee avatar U1, in the virtual space S (step S102). The trainee location information acquisition unit 102 acquires the location information of the trainee avatar U1 from the information on the trainee's posture and movements received from the posture and movement acquisition means 202. Then, the trainee location information acquisition unit 102 outputs the acquired location information of the trainee avatar U1 to the instruction image generation unit 103. Note that this step S102 may be performed simultaneously with or before step S101.
[0047] Next, the instruction image generation unit 103 generates an instruction image G1 that allows the trainee to recognize the position of marker M set by the instructor (step S103). The instruction image generation unit 103 obtains information from the marker setting unit 101 that indicates a virtual space S to which information about marker M is associated. The instruction image generation unit 103 also obtains the position information of the trainee avatar U1 from the trainee position information acquisition unit 102. The instruction image generation unit 103 calculates the viewpoint position of the trainee avatar U1 from the position information of the trainee avatar U1. The instruction image generation unit 103 sets up a virtual camera on the calculated viewpoint position and uses the virtual camera to acquire a 360° image with the z-axis on the viewpoint position as the rotation center, as a 360° image from the viewpoint of the trainee avatar U1. Then, based on the information indicating a virtual space S to which information about marker M is associated, the instruction image generation unit 103 displays marker M on the 360° image from the viewpoint of the trainee avatar U1 and generates instruction image G1. The instruction image generation unit 103 transmits the generated instruction image G1 to at least the trainee's image display means 203.
[0048] Next, the trainee image display means 203 superimposes the instruction image G1 onto the trainee's field of view V in the virtual space S (step S104). Note that the superimposition process may be performed by the control server 10.
[0049] As described above, the training support system 1 generates instruction image G1 by displaying markers on a 360° image from the trainee avatar U1's perspective. The training support system 1 then superimposes instruction image G1 onto the trainee's field of view V in the virtual space S. Even if a marker M is set in a position that the trainee cannot see, they can recognize the position of the marker M by checking the instruction image G1 superimposed on their field of view V. Therefore, by using instruction image G1 to make the trainee aware of the position of marker M, the trainee can more easily grasp the instructor's instructions. Thus, smooth communication between the instructor and trainee can be achieved during training in the virtual space.
[0050] (Embodiment 3) <Configuration of the training support system> Below, another example of the training support system, more specifically another form of the instruction image generation unit 103, will be described using Figure 8. Figure 8 is a diagram showing another example of the configuration of the training support system according to this disclosure. As shown in Figure 8, the training support system 1 according to this embodiment 3 comprises a control server 10, a trainee device 20, an instructor device 30, and a virtual space generation server 40. The training support system 1 according to this embodiment 3 differs from the training support system 1 according to embodiment 2 in the configuration of the control server 10. Note that the trainee device 20, the instructor device 30, and the virtual space generation server 40 are the same as those described in the training support system 1 in embodiment 2, so redundant explanations will be omitted.
[0051] First, the instruction image generated by the instruction image generation unit 103 according to this third embodiment will be described. Figure 9 shows another example of an instruction image. The instruction image G1 according to the second embodiment is an image in which a marker M is displayed on a 360° image from the viewpoint of the trainee avatar U1 (see Figure 5). On the other hand, the instruction image G2 according to this third embodiment is an image in which a marker M is displayed on an overhead view image of the virtual space S, as shown in Figure 9. In this disclosure, the overhead view image is an image of the virtual space S viewed from the z-axis positive direction. The example of the overhead view image shown in Figure 9 is an overhead view image of the virtual space S in which multiple areas separated by boundaries exist. In addition to the position of the marker M, the instruction image G2 also displays the position of the trainee, i.e., the trainee avatar U1, and the position of the instructor, i.e., the instructor avatar U2, in the virtual space S.
[0052] Next, the control server 10 that generates the instruction image G2 will be described. As shown in Figure 8, the control server 10 includes a marker setting unit 101, a trainee position information acquisition unit 102, an instruction image generation unit 103, and an instructor position information acquisition unit 104. In addition, explanations of the control server 10 that overlap with those of Embodiment 2 have been omitted as appropriate.
[0053] The marker setting unit 101, similar to the marker setting unit 101 in Embodiment 2, sets a marker M at any position in the virtual space S, at least in response to the operation of the instructor's marker setting means 301. Of course, the marker M may also be set at any position in the virtual space S in response to the operation of the trainee's marker setting means 201. The marker setting unit 101 acquires information about the marker M, such as the position and display mode of the marker M set by the instructor, from the instructor's marker setting means 301. The marker setting unit 101 also acquires information about the generated virtual space S from the virtual space generation means 402. The marker setting unit 101 then sets the marker M in the virtual space S by associating the information about the marker M with the virtual space S. The marker setting unit 101 outputs information indicating the virtual space S to which the information about the marker M is associated to the instruction image generation unit 103.
[0054] The trainee location information acquisition unit 102 acquires the location information of the trainee avatar U1, similar to the trainee location information acquisition unit 102 in Embodiment 2. The trainee location information acquisition unit 102 outputs the acquired location information of the trainee avatar U1 to the instruction image generation unit 103.
[0055] The instructor location information acquisition unit 104 acquires the location information of the instructor avatar U2 if the instructor is in the same virtual space S as the trainee. The instructor location information acquisition unit 104 outputs the acquired location information of the instructor avatar U2 to the instruction image generation unit 103.
[0056] The instruction image generation unit 103 generates instruction image G2. First, the instruction image generation unit 103 obtains information from the marker setting unit 101 indicating the virtual space S to which information about marker M is associated. Then, based on the information indicating the virtual space S, the instruction image generation unit 103 generates an overhead image that provides an overview of the virtual space S.
[0057] Furthermore, the instruction image generation unit 103 acquires the location information of the trainee avatar U1 from the trainee location information acquisition unit 102. Similarly, the instruction image generation unit 103 acquires the location information of the instructor avatar U2 from the instructor location information acquisition unit 104.
[0058] Then, the instruction image generation unit 103 generates an instruction image G2 by displaying the positions of the trainee avatar U1, the instructor avatar U2, and the marker M on an overhead image, based on the information regarding the marker M, the position information of the trainee avatar U1, and the position information of the instructor avatar U2.
[0059] The instruction image generation unit 103 transmits the generated instruction image G2 to at least the trainee's image display means 203. Of course, the instruction image generation unit 103 may also transmit the generated instruction image G2 to the instructor's image display means 303. Figure 10 shows another example of the trainee's field of view with the instruction image superimposed. The instruction image G2 transmitted to the trainee's image display means 203 is superimposed on the trainee's field of view V, as shown in Figure 10. That is, even if a marker M is set in a position that the trainee cannot see, the trainee can recognize the position of the marker M by checking the instruction image G2 superimposed on the field of view V. Therefore, the instruction image G2 that makes the trainee recognize the position of the marker M makes it easier for the trainee to grasp the instructor's instructions. Thus, the instructor and trainee can communicate smoothly in training in the virtual space.
[0060] The configuration of the training support system 1 has been described above. Also, as in Embodiment 2, the marker setting unit 101, the trainee location information acquisition unit 102, the instruction image generation unit 103, and the instructor location information acquisition unit 104 may be implemented on a server or device other than the control server 10.
[0061] Figure 11 shows another example of the trainee's field of view with instruction images superimposed. As shown in Figure 11, the training support system 1 may superimpose instruction image G1 and instruction image G2 onto the trainee's field of view V, respectively. The training support system 1 may also be configured to allow switching between instruction image G1 and instruction image G2 when superimposing them onto the field of view V.
[0062] Furthermore, the control server 10 according to this third embodiment may also include an instructor's field of view image generation unit 105, similar to the second embodiment. That is, the training support system 1 may be configured to allow switching between an image displayed by the image display means 203 between a field of view V with an instruction image G2 superimposed and an instructor's field of view image with a marker M displayed.
[0063] <Training support method> Next, another example of a training support method will be explained using Figure 12. Figure 12 is a flowchart of another example of a training support method according to this disclosure. Note that explanations that overlap with the training support method described in Embodiment 2 will be omitted as appropriate.
[0064] First, the marker setting unit 101 sets a marker M at any position in the virtual space S, at least in response to the operation of the instructor's marker setting means 301 (step S101).
[0065] Next, the trainee location information acquisition unit 102 acquires the location information of the trainee, i.e., the trainee avatar U1, in the virtual space S (step S102).
[0066] Next, the instructor location information acquisition unit 104 acquires the location information of the instructor, i.e., the instructor avatar U2, in the virtual space S (step S105). This step S105 may be performed simultaneously with step S102, or before step S102.
[0067] Next, the instruction image generation unit 103 generates an instruction image G2 that allows the trainee to recognize the position of marker M (step S103). First, the instruction image generation unit 103 obtains information from the marker setting unit 101 that indicates a virtual space S to which information about marker M is associated. Then, based on the information indicating the virtual space S, the instruction image generation unit 103 generates an overhead image that provides an overview of the virtual space S.
[0068] Furthermore, the instruction image generation unit 103 acquires the location information of the trainee avatar U1 from the trainee location information acquisition unit 102. Similarly, the instruction image generation unit 103 acquires the location information of the instructor avatar U2 from the instructor location information acquisition unit 104.
[0069] The instruction image generation unit 103 then generates an instruction image G2 by displaying the positions of the trainee avatar U1, the instructor avatar U2, and the marker M in an overhead view image, based on the information regarding the marker M, the position information of the trainee avatar U1, and the position information of the instructor avatar U2. The instruction image generation unit 103 then transmits the generated instruction image G2 to at least the trainee's image display means 203.
[0070] Next, the trainee's image display means 203 superimposes the instruction image G2 onto the trainee's field of view V in the virtual space S (step S104). Note that the superimposition process may be performed by the control server 10.
[0071] As described above, the training support system 1 generates an instruction image G2 by displaying the positions of marker M, trainee avatar U1, and instructor avatar U2 on an overhead image that provides an overview of the virtual space S. The training support system 1 then superimposes the instruction image G2 onto the trainee's field of view V in the virtual space S. Even if marker M is set in a position that the trainee cannot see, they can recognize the position of marker M by checking the instruction image G2 superimposed on their field of view V. Therefore, the instruction image G2, which makes the trainee aware of the position of marker M, makes it easier for the trainee to grasp the instructor's instructions. Thus, smooth communication between the instructor and trainee is possible during training in the virtual space.
[0072] (Embodiment 4) <Configuration of the training support system> The following describes another example of a training support system using Figure 13. Figure 13 is a diagram showing another example of the configuration of the training support system according to this disclosure. As shown in Figure 13, the training support system 1 according to this embodiment 4 comprises a control server 10, a trainee device 20, an instructor device 30, and a virtual space generation server 40. The training support system 1 according to this embodiment 4 differs from the training support system 1 according to embodiments 2 and 3 in the configuration of the control server 10. Note that the trainee device 20, the instructor device 30, and the virtual space generation server 40 are the same as those described in the training support system 1 in embodiment 2, so redundant explanations will be omitted.
[0073] In embodiments 2 and 3, instruction images G1 or G2 or both, which allow the trainee to recognize the position of marker M, are superimposed on the trainee's field of view V, thereby facilitating communication between the instructor and trainee in virtual space training. The training support system 1 according to embodiment 4 differs from the training support system 1 according to embodiments 2 and 3 in that it further includes a notification unit 106 that notifies the trainee that marker M has been set.
[0074] A control server 10 equipped with a notification unit 106 will now be described. As shown in Figure 13, the control server 10 includes a marker setting unit 101, a trainee position information acquisition unit 102, an instruction image generation unit 103 (not shown), an instructor position information acquisition unit 104, and a notification unit 106. The control server 10 may also include an instructor field of view image generation unit 105 as described in Embodiment 2. Regarding the control server 10, explanations that overlap with Embodiments 2 and 3 will be omitted as appropriate. That is, in order to mainly explain the function of the notification unit 106, the explanation regarding the instruction image generation unit 103 (not shown) will be omitted.
[0075] The marker setting unit 101 sets a marker M at any position in the virtual space S, at least in response to the operation of the instructor's marker setting means 301, similar to embodiments 2 and 3. The marker setting unit 101 outputs information indicating the virtual space S to which the marker information is associated to the notification unit 106.
[0076] The trainee location information acquisition unit 102 acquires the location information of the trainee, i.e., the trainee avatar U1, in the virtual space S, similar to embodiments 2 and 3. The trainee location information acquisition unit 102 outputs the acquired location information of the trainee avatar U1 to the notification unit 106.
[0077] The instructor location information acquisition unit 104 acquires the location information of the instructor avatar U2 if the instructor is in the same virtual space S as the trainee. The instructor location information acquisition unit 104 outputs the acquired location information of the instructor avatar U2 to the notification unit 106.
[0078] The notification unit 106 notifies the trainee that marker M has been set, at least when the instructor has set marker M. More specifically, the notification unit 106 notifies the trainee that marker M has been set by displaying a text message superimposed on the trainee's field of view V. The notification method will be described in detail below.
[0079] First, the notification unit 106 obtains information from the marker setting unit 101 indicating the virtual space S to which information about marker M is linked. The notification unit 106 also obtains the location information of the trainee avatar U1 from the trainee location information acquisition unit 102.
[0080] Next, the notification unit 106 calculates the position of marker M relative to the position of the trainee avatar U1 based on the information regarding marker M and the position information of the trainee avatar U1. Then, the notification unit 106 generates a text message indicating the position of marker M relative to the position of the trainee avatar U1.
[0081] The notification unit 106 transmits the generated text message to at least the trainee's image display means 203, superimposing it onto the trainee's field of view V. Of course, the notification unit 106 may also transmit the generated text message to the instructor's image display means 303. Figure 14 shows an example of the trainee's field of view with the text message superimposed. The text message G3 transmitted to the trainee's image display means 203 is superimposed onto the trainee's field of view V, as shown in Figure 14. That is, even if a marker M is set in a position that the trainee cannot see, the trainee can recognize that the marker M has been set by checking the text message G3 superimposed on the field of view V. Therefore, the text message G3 that makes the trainee aware that a marker M has been set makes it easier for the trainee to grasp the instructor's instructions. Thus, the instructor and trainee can communicate smoothly in training in the virtual space.
[0082] The notification unit 106 may determine the display mode of the text message G3 based on the position of marker M relative to the position of the trainee avatar U1, and information related to marker M. For example, the text message G3 "!! Marker 2 is ○m behind you" shown in Figure 14 indicates that marker M has been set 3m behind the trainee avatar U1. Also, the text message G3 "Marker 1 has been placed in area 3" shown in Figure 14 indicates that marker M has been set in area 3 in a virtual space S where multiple areas separated by boundaries exist. The notification unit 106 may change the color and size of the text message G3 based on, for example, the position of marker M relative to the position of the trainee avatar U1, and the priority set for marker M.
[0083] By changing the display mode of text message G3 based on the position of marker M relative to the position of trainee avatar U1, and information related to marker M, instructors and trainees can communicate more smoothly during training in a virtual space.
[0084] Furthermore, the text message G3 superimposed on the field of view V may change its display when the trainee recognizes a marker M. When the trainee recognizes a marker M, for example, the text message G3 may disappear from the field of view V or become fainter. In this way, by changing the display of the text message G3 when the trainee recognizes a marker M, it becomes easier for the trainee to determine which marker M to check next.
[0085] Furthermore, if the instructor device 30 includes an input means, the notification unit 106 may use the message entered by the instructor via the input means as text message G3. Examples of input means include, but are not limited to, a keyboard, a tablet device, or a stylus.
[0086] As described above, when the instructor sets a marker M, the training support system 1 displays a text message G3 superimposed on the trainee's field of view V to notify them that the marker M has been set. Even if the marker M is set in a location that the trainee cannot see, they can recognize that the marker M has been set by checking the text message G3 superimposed on their field of view V. Therefore, the text message G3 that notifies the trainee that marker M has been set makes it easier for the trainee to understand the instructor's instructions. Thus, smooth communication between the instructor and trainee is possible in training in the virtual space.
[0087] (Embodiment 5) <Configuration of the training support system> The following describes another example of the training support system, more specifically another form of the notification unit 106, using Figure 15. Figure 15 is a diagram showing another example of the configuration of the training support system according to this disclosure. As shown in Figure 15, the training support system 1 according to this embodiment 5 comprises a control server 10, a trainee device 20, an instructor device 30, and a virtual space generation server 40. The training support system 1 according to this embodiment 5 differs from the training support system 1 according to embodiment 4 in that the function of the notification unit 106 is different, and the trainee device 20 and the instructor device 30 are further equipped with sensory information output means 204 and 304. The configuration other than the notification unit 106 and the sensory information output means 204 and 304 is the same as that of the training support system 1 described in embodiments 2 to 4, so redundant explanations will be omitted.
[0088] In Embodiment 4, when at least the instructor sets marker M, a text message G3 is superimposed on the trainee's field of view V to notify them that marker M has been set, thereby facilitating communication between the instructor and trainee in virtual space training. In Embodiment 5, the training support system 1 notifies the trainee that marker M has been set by presenting sensory information that can be perceived by perception when at least the instructor sets marker M. The sensory information includes, for example, sound, vibration, light, and temperature changes.
[0089] A control server 10 equipped with a notification unit 106 will now be described. As shown in Figure 15, the control server 10 includes a marker setting unit 101, a trainee position information acquisition unit 102, an instruction image generation unit 103 (not shown), an instructor position information acquisition unit 104, and a notification unit 106. The control server 10 may also include an instructor field of view image generation unit 105 as described in Embodiment 2. Note that descriptions of the control server 10 that overlap with Embodiments 2 to 4 will be omitted as appropriate.
[0090] The marker setting unit 101 sets a marker M at any position in the virtual space S, at least in response to the operation of the instructor's marker setting means 301, similar to embodiments 2 to 4. The marker setting unit 101 outputs information indicating the virtual space S to which the marker information is associated to the notification unit 106.
[0091] The trainee location information acquisition unit 102 acquires the location information of the trainee, i.e., the trainee avatar U1, in the virtual space S, similar to embodiments 2 to 4. The trainee location information acquisition unit 102 outputs the acquired location information of the trainee avatar U1 to the notification unit 106.
[0092] The instructor location information acquisition unit 104 acquires the location information of the instructor avatar U2 when the instructor is in the same virtual space S as the trainee, similar to embodiments 2 to 4. The instructor location information acquisition unit 104 outputs the acquired location information of the instructor avatar U2 to the notification unit 106.
[0093] The notification unit 106 notifies the trainee that marker M has been set, at least when the instructor has set marker M. More specifically, the notification unit 106 notifies the trainee that marker M has been set by presenting sensory information that can be perceived by the trainee. The notification method will be described in detail below.
[0094] First, the notification unit 106 obtains information from the marker setting unit 101 indicating the virtual space S to which information about marker M is linked. The notification unit 106 also obtains the location information of the trainee avatar U1 from the trainee location information acquisition unit 102.
[0095] Next, the notification unit 106 calculates the position of marker M relative to the position of the trainee avatar U1 based on the information regarding marker M and the position information of the trainee avatar U1. Then, the notification unit 106 generates a signal indicating the position of marker M relative to the position of the trainee avatar U1.
[0096] The notification unit 106 transmits the generated signal to at least the trainee's sensory information output means 204, causing it to output sensory information. Of course, the notification unit 106 may also transmit the generated signal to the instructor's sensory information output means 304. If the sensory information is sound, the sensory information output means 204 and 304 are, for example, speakers or earphones provided on the HMD. In this case, the sensory information output means 204 and 304 output sound as sensory information. If the sensory information is vibration, the sensory information output means 204 and 304 are, for example, vibration devices provided on the HMD or controller. In this case, the sensory information output means 204 and 304 output vibration as sensory information.
[0097] Even if a marker M is set in a location that the trainee cannot see, the trainee can recognize that the marker M has been set by sensing sensory information based on the signal generated by the notification unit 106. Therefore, the sensory information that makes the trainee aware that marker M has been set makes it easier for the trainee to grasp the instructor's instructions. Thus, smooth communication between the instructor and the trainee can be achieved during training in the virtual space.
[0098] The notification unit 106 may determine the output mode of sensory information based on the position of marker M relative to the position of the trainee avatar U1, and information related to marker M. The notification unit 106 may change, for example, the volume and direction of sound, the magnitude and pattern of vibration, etc., based on the position of marker M relative to the position of the trainee avatar U1, and the priority set for marker M. By changing the output mode of sensory information based on the position of marker M relative to the position of the trainee avatar U1, and information related to marker M, the instructor and trainee can communicate more smoothly in training in the virtual space.
[0099] Furthermore, the notification unit 106 may change the output mode of sensory information when the trainee recognizes marker M. When the trainee recognizes marker M, the notification unit 106 may, for example, stop outputting sound or vibration, or reduce the magnitude of sound or vibration. In this way, by changing the output mode of sensory information when the trainee recognizes marker M, the trainee can more easily determine which marker M to check next.
[0100] In summary, when the instructor sets marker M, the training support system 1 presents sensory information that can be perceived by the trainee to inform them that marker M has been set. Even if marker M is set in a location that the trainee cannot see, they can recognize that marker M has been set by sensing the sensory information that makes the trainee aware that marker M has been set. Therefore, the trainee can more easily grasp the instructor's instructions through the sensory information that makes the trainee aware that marker M has been set. Thus, smooth communication between the instructor and trainee can be achieved in training in the virtual space.
[0101] (Embodiment 6) <Configuration of the training support system> The following describes another example of the training support system, more specifically another form of the notification unit 106, using Figure 16. Figure 16 is a diagram showing another example of the configuration of the training support system according to this disclosure. As shown in Figure 16, the training support system 1 according to this embodiment 6 comprises a control server 10, a trainee device 20, an instructor device 30, and a virtual space generation server 40. The training support system 1 according to this embodiment 6 differs from the training support system 1 according to embodiment 4 in that the function of the notification unit 106 is different, and the virtual space generation server 40 further comprises a guidance avatar generation means 403. The configuration other than the notification unit 106 and the guidance avatar generation means 403 is the same as that of the training support system 1 described in embodiments 2 to 5, so redundant explanations will be omitted.
[0102] At least when the instructor sets marker M, the setting of marker M is notified in Embodiment 4 by superimposing a text message G3 onto the trainee's field of view V, and in Embodiment 5 by presenting sensory information to the trainee. The training support system 1 according to Embodiment 6 generates a guidance avatar in the virtual space S and uses the guidance avatar to guide the trainee to the location of marker M.
[0103] First, the guidance avatar generation means 403 will be described. The guidance avatar generation means 403 generates a guidance avatar in the virtual space S based on the avatar setting data stored in the database 401. The guidance avatar generation means 403 transmits information about the guidance avatar to the notification unit 106.
[0104] Next, the control server 10 equipped with a notification unit 106 will be described. As shown in Figure 16, the control server 10 includes a marker setting unit 101, a trainee position information acquisition unit 102, an instruction image generation unit 103 (not shown), an instructor position information acquisition unit 104, and a notification unit 106. The control server 10 may also include an instructor field of view image generation unit 105 as described in Embodiment 2. Note that descriptions of the control server 10 that overlap with Embodiments 2 to 5 have been omitted as appropriate.
[0105] The marker setting unit 101 sets a marker M at any position in the virtual space S, at least in response to the operation of the instructor's marker setting means 301, similar to embodiments 2 to 5. The marker setting unit 101 outputs information indicating the virtual space S to which the marker information is associated to the notification unit 106.
[0106] The trainee location information acquisition unit 102 acquires the location information of the trainee, i.e., the trainee avatar U1, in the virtual space S, similar to embodiments 2 to 5. The trainee location information acquisition unit 102 outputs the acquired location information of the trainee avatar U1 to the notification unit 106.
[0107] The instructor location information acquisition unit 104 acquires the location information of the instructor avatar U2 when the instructor is in the same virtual space S as the trainee, similar to embodiments 2 to 5. The instructor location information acquisition unit 104 outputs the acquired location information of the instructor avatar U2 to the notification unit 106.
[0108] The notification unit 106 notifies the trainee that marker M has been set, at least when the instructor has set marker M. More specifically, the notification unit 106 notifies the trainee that marker M has been set by having the guidance avatar generated by the guidance avatar generation means 403 guide the trainee to the location of marker M. The notification method will be explained in detail below. The notification method will be explained in detail below.
[0109] First, the notification unit 106 obtains information from the marker setting unit 101 indicating the virtual space S to which information about marker M is linked. The notification unit 106 also obtains the location information of the trainee avatar U1 from the trainee location information acquisition unit 102. Then, the notification unit 106 obtains information about the guidance avatar from the guidance avatar generation means 403.
[0110] Next, the notification unit 106 controls the guidance avatar based on information indicating the virtual space S associated with marker M, the location information of the trainee avatar U1, and information about the guidance avatar. More specifically, the notification unit 106 controls the guidance avatar to guide the trainee to the location of marker M.
[0111] The guidance avatar, for example, moves through the virtual space S to lead the trainee to the location of marker M, or presents the trainee with the avatar's field of view, thereby guiding the trainee to the location of marker M. In other words, even if marker M is set in a location that the trainee cannot see, the guidance avatar allows the trainee to recognize that marker M has been set and to recognize its location. Therefore, the guidance avatar makes it easier for the trainee to understand the instructor's instructions. Thus, smooth communication between the instructor and trainee is possible during training in the virtual space.
[0112] The guidance avatar may be configured to be operated by an instructor, for example, using an instructor device 30. Furthermore, the guidance avatar may be controlled by AI (Artificial Intelligence). In this case, the AI may operate on the control server 10, or on another device (for example, an edge computer or cloud server).
[0113] In summary, the training support system 1 generates a guidance avatar in the virtual space S when the instructor sets marker M, and uses this guidance avatar to guide the trainee to the location of marker M. Even if marker M is set in a location that the trainee cannot see, the guidance avatar allows the trainee to recognize that marker M has been set and to know its location. Therefore, the guidance avatar makes it easier for the trainee to understand the instructor's instructions. Thus, smooth communication between the instructor and trainee is possible during training in the virtual space.
[0114] <Hardware configuration for implementing training functions> Some or all of the monitoring processes implemented by the training support system 1 according to Embodiments 1 to 6 can be implemented by a general-purpose computer system. This will be briefly explained below with reference to Figure 17.
[0115] Figure 17 is a block diagram showing an example of a hardware configuration for realizing the training support function of the training support system according to this disclosure. The computer 50 includes, for example, a CPU (Central Processing Unit) 501 which is a control device, RAM (Random Access Memory) 502 and ROM (Read Only Memory) 503. The computer 50 further includes an IF (Interface) 504 which is an interface to the outside and an HDD (Hard Disk Drive) 505 which is an example of a non-volatile storage device. Furthermore, the computer 50 may also include input devices such as a keyboard and mouse and display devices such as a display, as configurations not shown.
[0116] HDD505 stores an OS (Operating System) and a control program 506, which are not shown in the diagram. The control program 506 is a computer program (training support program) that implements the training support functions of the training support system 1.
[0117] The CPU 501 controls various processes in the computer 50, including access to RAM 502, ROM 503, IF 504, and HDD 505. The computer 50 reads and executes the OS and control program 506 stored in HDD 505 by the CPU 501. In this way, the computer 50 realizes the training support functions of the training support system 1.
[0118] The program described above includes a set of instructions (or software code) that, when loaded into a computer, causes the computer to perform one or more of the functions described in this disclosure. The program may be stored in a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include RAM, ROM, flash memory, SSD (Solid-State Drive), or other memory technologies, CD-ROM, DVD (Digital Versatile Disc), Blu-ray® disc, or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically, or otherwise propagating signals.
[0119] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure can be made as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.
[0120] Each drawing is merely illustrative to illustrate one or more embodiments. Each drawing may be associated with one or more other embodiments rather than with only one specific embodiment. As those skilled in the art will understand, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings, for example, to create embodiments not explicitly shown or described. Not all features or steps shown in any one drawing to illustrate an exemplary embodiment are necessarily required, and some features or steps may be omitted. The order of steps shown in any of the drawings may be changed as appropriate.
[0121] Some or all of the above embodiments may also be described as follows, but are not limited to the following: (Note 1) A marker setting unit that sets a marker at any position in the virtual space according to the instructor's operation, The system includes an instruction image generation unit that generates an instruction image to allow the trainee to recognize the position of the marker, The aforementioned instruction image is superimposed onto the field of view of the trainee in the virtual space. Training support system. (Note 2) The system further includes a location information acquisition unit that acquires location information of the trainee in the virtual space, The instruction image generation unit generates the instruction image based on the position information, The instruction image includes an area outside the trainee's field of vision in the virtual space. The training support system described in Appendix 1. (Note 3) The instruction image generation unit generates the instruction image by displaying the marker on the image generated based on the trainee's viewpoint. The viewpoint of the trainee is determined based on the trainee's location information. The training support system described in Appendix 2. (Note 4) The instruction image generation unit generates the instruction image by displaying the position of the person being trained and the position of the marker on an overhead image that provides an overview of the virtual space. The training support system described in Appendix 2. (Note 5) The system further includes a notification unit that, at least when the instructor sets the marker, notifies the trainee that the marker has been set. A training support system as described in any one of the items 1 to 4 in the appendix. (Note 6) The notification unit displays a text message superimposed on the trainee's field of vision to notify that the marker has been set. The text message indicates the position of the marker relative to the trainee's position, and the display changes when the trainee recognizes the marker. The training support system described in Appendix 5. (Note 7) The notification unit presents sensory information that can be perceived by perception to notify that the marker has been set. The aforementioned sensory information changes when the trainee recognizes the marker. The training support system described in Appendix 5 or 6. (Note 8) The notification unit guides the trainee to the location of the marker using an avatar generated in the virtual space. A training support system as described in any one of the items 5 to 7 of the appendix. (Note 9) The instruction image is displayed in the field of view at a position that does not overlap with the marker displayed in the field of view. A training support system as described in any one of the items 1 through 8 of the appendix. (Note 10) The instruction image generation unit, A first instruction image is generated by displaying the marker on an image generated based on the viewpoint of the trainee, which is determined based on the location information of the trainee. A second instruction image is generated by displaying the position of the trainee and the position of the marker on an overhead image that provides an overview of the virtual space. In response to the trainee's actions, the instruction image superimposed on the trainee's field of view is switched between the first instruction image and the second instruction image. The training support system described in Appendix 2. (Note 11) The instruction image generation unit, A first instruction image is generated by displaying the marker on an image generated based on the viewpoint of the trainee, which is determined based on the location information of the trainee. A second instruction image is generated by displaying the position of the trainee and the position of the marker on an overhead image that provides an overview of the virtual space. The first instruction image and the second instruction image are superimposed onto the field of view of the person being trained. The training support system described in Appendix 2. (Note 12) The system further includes an image display means for displaying an image showing the field of view of the trainee in the virtual space, The image display means displays the image on which the instruction image is superimposed. A training support system as described in any one of the items 1 through 12 of the appendix. (Note 13) The steps include setting a marker at any location in the virtual space according to the instructor's instructions, The steps include generating an instruction image that allows the trainee to recognize the position of the marker, The system includes the step of superimposing the instruction image onto the field of view of the trainee in the virtual space, Training support methods. (Note 14) The process involves setting a marker at any location in the virtual space according to the instructor's input, A process to generate an instruction image that allows the trainee to recognize the position of the marker, The computer is instructed to perform the process of superimposing the aforementioned instruction image onto the field of view of the trainee in the virtual space. Training support program.
[0122] Some or all of the elements (e.g., configuration and function) described in Appendices 2 to 12 that are dependent on Appendice 1 may also be dependent on Appendices 13 and 14 in the same way as those described in Appendices 2 to 12. Some or all of the elements described in any appendice may be applicable to various hardware, software, recording means, systems, and methods for recording software. [Explanation of symbols]
[0123] 1. Training support system 10 Control Server 20 Trainee Devices 30 Instructor Devices 40 Virtual Space Generation Server 50 Computers 101 Marker setting section 102 Trainee location information acquisition unit 103 Instruction Image Generation Unit 104 Instructor location information acquisition unit 105 Instructor's View Image Generation Unit 106 Hochi Department 201, 301 Marker setting means 202, 302 Posture motion acquisition means 203, 303 Image display means 204, 304 Sensory information output means 401 Database 402 Virtual Space Generation Method 403 Means for generating avatars for guidance 501 CPU 502 RAM 503 ROM 504 IF 505 HDD 506 Control Program G1, G2 instruction images G3 Text Message M Marker O Object S Virtual Space U1 Trainee Avatar U2 Instructor Avatar V-field of view
Claims
1. A marker setting unit that sets a marker at any position in the virtual space according to the instructor's operation, The system includes an instruction image generation unit that generates an instruction image to allow the trainee to recognize the position of the marker, The aforementioned instruction image is superimposed onto the field of view of the trainee in the virtual space. Training support system.
2. The system further includes a location information acquisition unit that acquires location information of the trainee in the virtual space, The instruction image generation unit generates the instruction image based on the position information, The instruction image includes an area outside the trainee's field of vision in the virtual space. The training support system according to claim 1.
3. The instruction image generation unit generates the instruction image by displaying the marker on the image generated based on the trainee's viewpoint. The viewpoint of the trainee is determined based on the trainee's location information. The training support system according to claim 2.
4. The instruction image generation unit generates the instruction image by displaying the position of the person being trained and the position of the marker on an overhead image that provides an overview of the virtual space. The training support system according to claim 2.
5. The system further includes a notification unit that, at least when the instructor sets the marker, notifies the trainee that the marker has been set. The training support system according to claim 3 or 4.
6. The notification unit displays a text message superimposed on the trainee's field of vision to notify that the marker has been set. The text message indicates the position of the marker relative to the trainee's position, and the display changes when the trainee recognizes the marker. The training support system according to claim 5.
7. The notification unit presents sensory information that can be perceived by perception to notify that the marker has been set. The aforementioned sensory information changes when the trainee recognizes the marker. The training support system according to claim 5.
8. The notification unit guides the trainee to the location of the marker using an avatar generated in the virtual space. The training support system according to claim 5.
9. The steps include setting a marker at any location in the virtual space according to the instructor's instructions, The steps include generating an instruction image that allows the trainee to recognize the position of the marker, The system includes the step of superimposing the instruction image onto the field of view of the trainee in the virtual space, Training support methods.
10. The process involves setting a marker at any location in the virtual space according to the instructor's input, A process to generate an instruction image that allows the trainee to recognize the position of the marker, The computer is instructed to perform the process of superimposing the aforementioned instruction image onto the field of view of the trainee in the virtual space. Training support program.