Action request system, action request method, and action request program

Abstract

To provide an operation request system which is convenient for operators.SOLUTION: A system includes a display control unit for causing a target object that is an object of required user operation to appear in a virtual space, and displaying the target object on a head-mounted display mounted by a user, and an operation unit for accepting setting operation of the target object, wherein the operation unit displays an operation screen for an operator including a user visual field region where an image displayed on the head-mounted display is displayed, a parameter setting region where the attribute of the target object is set, and a score display region where the score of user operation to the target object is displayed.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an action request system, an action request method, and an action request program. [Background technology]

[0002] In the above technical field, Patent Document 1 discloses a system for supporting rehabilitation performed on hemiplegic patients caused by stroke or the like. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-228957 A [Non-patent literature]

[0004] [Non-Patent Document 1] Nichols S, Patel H: Health and safety implications of virtual reality: a review of empirical evidence. Appl Ergon 2002;33:251-271 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology described in the above document does not provide a system that is easy for operators to use.

[0006] An object of the present invention is to provide a technique for solving the above-mentioned problems. [Means for solving the problem]

[0007] In order to achieve the above object, the system according to the present invention comprises: a display control unit that causes a target object, which is a target of the requested user action, to appear in a virtual space and display the target object on a head mounted display worn by the user; an operation unit that accepts a setting operation of the target object; An action request system comprising: The operation unit includes: a user viewing area for displaying an image displayed on the head mounted display; a parameter setting area for setting attributes of the target object; a score display area for displaying a score of a user's action on the target object; The operation request system displays an operation screen for an operator including the above.

[0008] In order to achieve the above object, the method according to the present invention comprises: a display control step in which a target object, which is a target of the requested user action, appears in a virtual space and is displayed on a head mounted display worn by the user by a display control unit; an operation step in which an operation unit receives a setting operation of the target object; An action request method comprising: In the operation step, a user viewing area for displaying an image displayed on the head mounted display; a parameter setting area for setting attributes of the target object; a score display area for displaying a score of a user's action on the target object; The present invention relates to an operation request method for displaying an operation screen for an operator, the operation screen including:

[0009] In order to achieve the above object, the program according to the present invention comprises: a display control step of making a target object, which is a target of the requested user action, appear in the virtual space and display it on a head mounted display worn by the user; an operation step of accepting a setting operation of the target object; An operation request program for causing a computer to execute the above, In the operation step, a user viewing area for displaying an image displayed on the head mounted display; a parameter setting area for setting attributes of the target object; a score display area for displaying a score of a user's action on the target object; It is an operation request program that displays an operation screen for an operator including the above. Effect of the Invention

[0010] According to the present invention, it is possible to provide an action request system that is easy for an operator to use. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a configuration of a rehabilitation support system according to a first embodiment of the present invention. [Diagram 2] FIG. 11 is a block diagram showing the configuration of a rehabilitation support system according to a second embodiment. [Figure 3A] FIG. 11 is a diagram showing an example of a display screen of the rehabilitation support system according to the second embodiment. [Figure 3B] FIG. 11 is a diagram showing an example of a display screen of the rehabilitation support system according to the second embodiment. [Figure 3C] FIG. 11 is a diagram showing an example of a display screen of the rehabilitation support system according to the second embodiment. [Figure 3D] FIG. 11 is a diagram showing an example of a display screen of the rehabilitation support system according to the second embodiment. [Figure 3E] FIG. 11 is a diagram showing an example of a display screen of the rehabilitation support system according to the second embodiment. [Figure 3F] FIG. 11 is a diagram showing an example of a display screen of the rehabilitation support system according to the second embodiment. [Figure 3G]FIG. 11 is a diagram showing an example of a display screen of the rehabilitation support system according to the second embodiment. [Figure 4] FIG. 11 is a diagram showing an example of a display screen of the rehabilitation support system according to the second embodiment. [Diagram 5] 13 is a flowchart showing a processing flow of the rehabilitation support system according to the second embodiment. [Figure 6] FIG. 11 is a diagram showing another example of a display screen of the rehabilitation support system according to the second embodiment. [Figure 7] FIG. 13 is a diagram showing an example of an operation screen of the rehabilitation support system according to the third embodiment. [Figure 8] FIG. 13 is a diagram showing another example of an operation screen of the rehabilitation support system according to the third embodiment. [Figure 9] FIG. 13 is a diagram showing yet another example of an operation screen of the rehabilitation support system according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. However, the components described in the following embodiment are merely examples, and are not intended to limit the technical scope of the present invention.

[0013] [First embodiment] A rehabilitation support system 100 according to a first embodiment of the present invention will be described with reference to Fig. 1. The rehabilitation support system 100 is a system that supports rehabilitation performed for a user 110.

[0014] As shown in FIG. 1, the rehabilitation support system 100 includes a detection unit 101 and display control units 102 and 103.

[0015] The detection unit 101 detects the direction of the head of a user 110 wearing a head mounted display 111 .

[0016] The display control unit 102 generates a target object 122 for rehabilitation to be viewed by the user 110 in a virtual space, and causes the head mounted display 111 to display the target object 122 in accordance with the head orientation of the user 110 detected by the detection unit 101. The display control unit 103 causes the head mounted display 111 to display an announcement image 131 for announcing the position of the target object 122.

[0017] According to this embodiment, by displaying a notification image on the screen, the next change in inner ear information that will be obtained can be predicted in advance from visual information, thereby preventing sensory conflict.

[0018] [Second embodiment] A rehabilitation support system 200 according to a second embodiment of the present invention will be described with reference to Fig. 2. Fig. 2 is a diagram for explaining the configuration of the rehabilitation support system 200 according to this embodiment.

[0019] 2, the rehabilitation support system 200 includes a rehabilitation support device 210, two base stations 231 and 232, a head-mounted display 233, and two controllers 234 and 235. A user 220 performs rehabilitation movements by twisting the upper body and stretching the arms in accordance with the display on the head-mounted display 233 while sitting on a chair 221. In this embodiment, the description will be given on the premise that rehabilitation is performed while sitting on a chair, but the present invention is not limited to this.

[0020] The two base stations 231, 232 detect the movement of the head mounted display 233 and the movements of the controllers 234, 235, and send them to the rehabilitation support device 210. The rehabilitation support device 210 controls the display of the head mounted display 233 while evaluating the rehabilitation movement of the user 220.

[0021] The head mounted display 233 may be of a non-transparent type, a video see-through type, or an optical see-through type.

[0022] In this embodiment, the controllers 234 and 235 held by the user 220 and the base stations 231 and 232 are shown as examples of sensors for detecting the position of the user's hands, but the present invention is not limited to these. Cameras (including depth sensors) for detecting the position of the user's hands by image processing, sensors for detecting the position of the user's hands by temperature, wristwatch-type wearable terminals worn on the user's arms, motion capture, and the like are also included in the concept of sensors of the present invention.

[0023] The rehabilitation support device 210 includes a motion detection unit 211 , display control units 212 and 213 , an evaluation unit 214 , an update unit 215 , a task set database 216 , and an operation unit 217 .

[0024] The motion detection unit 211 acquires the positions of the controllers 234, 235 held by the user 220 via the base stations 231, 232, and detects the rehabilitation motion of the user 220 from a change in the position of the user's 220's hands.

[0025] The display control unit 212 generates an avatar object 241 that moves according to the detected rehabilitation motion and a target object 242 that indicates a target of the rehabilitation motion in a virtual space. Then, images of the avatar object 241 and the target object 242 are displayed on the display screen 240 according to the orientation and position of the head mounted display 233 detected by the motion detection unit 211. The images of the avatar object 241 and the target object 242 are displayed superimposed on a background image 243. Here, the avatar object 241 has the same shape as the controllers 234 and 235, but is not limited to this. The avatar object 241 moves in the display screen 240 in accordance with the movements of the controllers 234 and 235. As displayed on the avatar object 241, the controllers 234 and 235 are provided with buttons, and are configured to enable various setting operations and the like. The background image 243 includes a horizon 244 and a ground surface image 245.

[0026] The display control unit 212 gradually changes the display position and size of the target object 242 so that it appears as if the target object 242 is descending downward from above the user 220. The user 220 moves the controllers 234, 235 to move the avatar object 241 on the screen closer to the target object 242. When a sensor object (not shown here) included in the avatar object 241 collides with the target object 242, the target object 242 disappears.

[0027] The display control unit 213 further causes a radar screen image 250 to be displayed on the display screen 240 of the head mounted display 233. The radar screen image 250 indicates the relative direction of the position of the target object 242 with respect to a reference direction in the virtual space (here, initially set to be the front direction of a user sitting upright in a chair).

[0028] The display control unit 213 displays the radar screen image 250 in the center (for example, within a range of −50 degrees to 50 degrees) of the display screen 240 of the head mounted display 233, regardless of the orientation of the head of the user 220.

[0029] The radar screen image 250 includes a head image 251 representing the user's head as seen from above, a block image 252 obtained by dividing the periphery of the head image 251 into a plurality of blocks, and a fan-shaped image 253 as a visual field area image showing the user's visual field area. A target position image showing the position of a target object is shown by which block of the block image 252 is colored. This allows the user 220 to know whether the target object is on the left side or the right side of the direction in which the user is facing. Note that in this embodiment, the block image 252 is fixed and the fan-shaped image 253 moves, but the present invention is not limited to this. The fan-shaped image 253 and the head image 251 may be fixed while the block image 252 is moved according to the direction of the head. Specifically, if the head faces left, the block image 252 may rotate to the right.

[0030] The evaluation unit 214 compares the rehabilitation action detected by the action detection unit 211 with the target position represented by the target object displayed by the display control unit 212 to evaluate the rehabilitation ability of the user 220. Specifically, the evaluation unit 214 determines whether or not an avatar object 241, which moves in response to the rehabilitation action detected by the action detection unit 211, overlaps with a target object 242 by comparing their positions in the three-dimensional virtual space.

[0031] If these overlap, it is evaluated that one rehabilitation movement has been completed, and points are added. The display control unit 212 can make the target object 242 appear at different positions (for example, three stages of positions) in the depth direction. The evaluation unit 214 gives different points to each of the distant objects (higher points to objects farther away, and lower points to objects closer to the object).

[0032] The update unit 215 updates the target tasks according to the accumulated points. For example, the target tasks may be updated using a task achievement rate (number of goals achieved / number of tasks).

[0033] The task set database 216 stores a set of multiple tasks. A task refers to one rehabilitation movement to be performed by the user. Specifically, the information representing one task includes the position, speed, and size of a target object that was made to appear, as well as the size of the avatar object at that time. The task set database 216 stores a task set that determines the order in which such multiple tasks are provided to the user.

[0034] For example, a task set may be stored as a template for each hospital, or a history of executed task sets may be stored for each user. The rehabilitation support device 210 may be configured to be able to communicate with other rehabilitation support devices via the Internet. In this case, one task set can be executed by the same user at multiple locations, and various templates can be shared among multiple users at different locations.

[0035] The operation unit 217 is provided to operate the display control in the display control unit 212 and the display control unit 213. Specifically, the operation unit 217 displays an operation screen 300 for an operator, as shown in Figs. 3A to 3G. The display for displaying the setting screen may be an external display connected to the rehabilitation support device 210, or may be a display built into the rehabilitation support device 210, and any device may be used. The operation screen 300 includes a user field of view screen 301, various parameter setting screens 302, a score display screen 303, a pause button 304, a re-center button 305, and an end button 307. Although Figs. 3A to 3G include an area 306 showing the appearance of the actual user 220 for the sake of explanation, the operation screen 300 does not need to include the area 306.

[0036] The user field of view screen 301 displays an image that is actually displayed on the head mounted display 233. A reference direction 311 in a virtual space is displayed in the user field of view screen 301. As described in FIG. 2, the radar screen image 250 is displayed in the center of the user field of view screen 301 (for example, in a field of view angle range of −50 degrees to 50 degrees). The radar screen image 250 indicates which direction the position of the target object 242 that will appear next is relative to the reference direction in the virtual space. In this example, the colored position of the block image 252 indicates that the target object 242 will appear at the furthest position to the left of the reference direction 311 in the virtual space. The position of the sector image 253 and the direction of the head image 251 indicate that the user is already facing leftward.

[0037] Moreover, the various parameter setting screen 302 is a screen for setting a plurality of parameters that define a task. The operation unit 217 accepts input to the various parameter setting screen 302 from an input device (not shown). The input device may be a mouse or a keyboard, or may be a touch panel, and the technical configuration thereof is not important.

[0038] The various parameter setting screen 302 includes an input area 321 for determining the sizes of the left and right target objects, an input area 322 for determining the size of the avatar object 241, an input area 323 for determining the falling speed of the target object, and an input area 324 for determining the position of the next target object to appear. It further includes a check box 325 for setting whether or not to accept operation of the appearance position of the target object by a hot key.

[0039] The input area 321 can set the radius of a visual object (visual size) for making it easier for the user to see the position of the target object, and the radius of a target object that reacts with the avatar object 241 (evaluation size) on each of the right and left sides. That is, in the example of FIG. 3A, the user can see a ball with a radius of 20 cm, but the task is not completed unless the user actually touches a ball with a radius of 10 cm located in the center of the balls. If the visual size is small, it is difficult for the user to find the target object. If the visual size is large, it is easier for the user to find the target object. If the evaluation size is large, the allowable amount of deviation of the avatar object 241 is large, and if the evaluation size is small, the allowable amount of deviation of the avatar object 241 is small, and the rehabilitation movement can be evaluated more severely. These visual sizes and evaluation sizes can also be made to match.

[0040] In the input area 322, the sensor size (sensor object size) of the avatar object 241 can be set differently for the left and right. If the sensor size is large, the task is accomplished even if the hand position is significantly off the target object, so the difficulty of the rehabilitation action is reduced. Conversely, if the sensor size is small, the hand must be moved accurately to the central area of ​​the target object (depending on the evaluation size), so the difficulty of the rehabilitation action is increased. In the example of FIG. 3A, the sensor size is 1.75 cm for each of the left and right.

[0041] In the input area 323, the speed at which the target object 242 moves in the virtual space can be specified for each side. In this example, the speed is set to 70 cm / s.

[0042] That is, in the example of FIG. 3A, the task of the user 220 is to grasp an avatar object (controller) including a 1.75 cm sensor portion in the virtual space and bring it into contact with a target object (ball) of radius 10 cm falling at a speed of 70 cm / s at a location far to the left.

[0043] Input area 324 has a shape that is an enlarged version of radar screen image 250. Because check box 325 is checked, when an operation of clicking or tapping on any of the blocks in input area 324 is performed, target object 242 is generated at a position in virtual space that corresponds to the position of the block on which the operation was performed.

[0044] On the other hand, the score display screen 303 includes an enlarged radar screen image 331 and a score list 332. The enlarged radar screen image 331 is an enlarged version of the radar screen image 250 displayed on the head mounted display 233, and changes in real time according to the user's movement and the position where the target object 242 will next appear.

[0045] The score list 332 shows the total number of times a task was performed at each position and a score indicating how many times the task was completed. The score may be expressed as a fraction, a percentage, or a combination of both. The evaluation unit 214 uses the value of the score list 332 after a series of rehabilitation movements determined by one task set to derive rehabilitation evaluation points.

[0046] At this time, the evaluation unit 214 weights the points according to the appearance position of the target object, the touch accuracy of the avatar object 241, and the number of consecutive achievements. In this embodiment, the falling speed and task interval are not included in the weighting. This is based on the fact that exercise intensity does not necessarily depend on speed, and furthermore, from the viewpoint of preventing accidents, factors that make the user rush are eliminated.

[0047] The pause button 304 is a button for pausing the series of rehabilitation movements. The end button 307 is a button for ending the series of rehabilitation movements.

[0048] The re-center button 305 is a button that receives a reconstruction instruction from an operator for reconstructing the virtual space in accordance with the position of the user 220. When the re-center button 305 is operated, the display control unit 212 reconstructs the virtual space with the position of the head mounted display 233 at that moment as the origin and the orientation of the head mounted display 233 at that moment as the reference direction.

[0049] 3B shows a state in which the target object 242 appears on the user field of view screen 301 of FIG. 3A. In this state, when the user 220 extends his / her left arm as shown in the area 306, the avatar object 241 appears on the user field of view screen 301. A viewing object 312 for improving the visibility of the target object 242 is displayed around the target object 242. Here, the viewing object 312 is donut-shaped, but the present invention is not limited to this, and may be a line or an arrow extending radially from the target object. The viewing size set in the input area 321 indicates the radius of this donut-shaped viewing object 312.

[0050] Fig. 3C shows the user field of view screen 301 at the moment when the target object 242 in Fig. 3B descends further and touches the avatar object 241. At this point, the avatar object 241 and the visual object 312 are touching, but the target object 242 does not disappear at this point, and the task is not accomplished (a certain number of points are scored and a "good" evaluation is given). Only when the avatar object 241 touches the target object 242 is the task accomplished (a "perfect" evaluation given).

[0051] FIG. 3D shows the user field of view screen 301 immediately after the target object 242 in FIG. 3C has further descended and touched the avatar object 241, and the target object 242 has disappeared.

[0052] FIG. 3E shows an operation screen 300 in which the user's task is to grasp an avatar object (controller) including a 1.75 cm sensor portion in a virtual space and bring it into contact with a target object (ball) of radius 10 cm that is falling at a speed of 70 cm / s at a location far to the right of the user.

[0053] 3F shows an operation screen 300 in which the size of the target object on the right side has been changed to 3 cm, while the sensor size has been changed to 10 cm. Because the sensor size is large at 10 cm, the sensor object 313 can be seen protruding from the avatar object 241. The task of the user is to grab the avatar object (controller) including the 10 cm sensor object 313 in the virtual space and bring it into contact with a target object (ball) with a radius of 3 cm that is falling at a speed of 20 cm / s at a location far to the right of the user.

[0054] 3G shows an operation screen 300 in which the size of the target object on the right side has been changed to 30 cm, while the sensor size has been changed to 10 cm. The user's task is to grab an avatar object (controller) including a 10 cm sensor object 313 in the virtual space and touch it to a target object (ball) with a radius of 30 cm that is falling at a speed of 20 cm / s at a location far to the right of the user.

[0055] As shown in FIG. 4, a landscape image obtained by capturing an actual landscape (for example, a video of the streets of New York) may be displayed as a background image. The landscape image may be an image of the roads around the rehabilitation facility, or an image of a foreign country. It is possible to make the patient feel as if they are walking in a foreign country or a familiar place. By superimposing the landscape image, it is possible to realize training with a large amount of information while entertaining the patient.

[0056] FIG. 5 is a flowchart showing the flow of processing in the rehabilitation support device 210.

[0057] In step S501, as a calibration process, the rehabilitation movement goal is initialized to suit the user. Specifically, each patient is first asked to perform an action within the range of movement as a calibration, and the action is set as an initial value, and then the goal is initialized to suit the user.

[0058] Next, in step S503, the task is started. Specifically, in addition to a method in which the operator specifies each task in real time, a task set called a template may be read from a task set database, and task requests (i.e., display of target objects by the display control unit 212) may be made in order from a plurality of tasks set in advance.

[0059] In step S505, it is determined whether the task has been completed, and if so, a score is recorded according to the degree of completion (perfect or good). In step S507, a determination is made as to whether all tasks in the task set have been completed or whether the operator has pressed the end button 307.

[0060] If not, the process returns to step S503 and the next task is started. If not, the process proceeds to step S511 and the points for each task are weighted according to the conditions and then totaled to calculate the cumulative points.

[0061] In step S507, the user's fatigue level may be calculated from the change in score, etc., and if the fatigue level exceeds a predetermined threshold, this may be regarded as a "stop condition" and the process may be automatically terminated.

[0062] (About dual tasks) Healthy people usually do two or more things at the same time in their daily lives, such as "walking while talking." This "ability to do two things at the same time" declines with age. For example, "if someone talks to you while you are walking, you stop walking." The cause of falls in elderly people is not only "deterioration of motor function," but also "deterioration of the ability to do two things at the same time." In fact, many elderly people fall after returning home, even if their motor function is judged to have been sufficiently restored through rehabilitation. One of the reasons for this is that rehabilitation is performed in an environment and conditions that allow them to concentrate on the rehabilitation movement. In other words, in the living environment, movements are often performed under conditions that make it difficult to concentrate on the movement, such as poor visibility, the presence of obstacles, or being distracted by conversation.

[0063] Therefore, it is considered important to carry out rehabilitation that allows the elderly to divide their attention, and it is desirable to specifically provide dual task training. This type of dual task training is an effective program not only for preventing falls in the elderly, but also for preventing dementia.

[0064] Dual task training includes training that combines a cognitive task with a motor task, as well as training that combines two types of motor tasks.

[0065] As described above, the task described in Figures 3A to 3G is a dual cognitive and motor task, since it requires the user to confirm the position of the next target object on the radar screen image (cognitive task) and then turn the body and reach out to that position at the right time (motor task).

[0066] Other cognitive and motor tasks include training such as reaching out while subtracting ones from 100, and reaching out to fill a glass of water without spilling it.

[0067] If the evaluation of the dual task exercise test is about 20% lower than that of the simple exercise, the evaluation unit 214 notifies the display control unit 212 to repeat the dual task.

[0068] (Other dual task training examples) As shown in Figure 6, a question image (e.g., multiplication) may be superimposed on the background screen, or a question may be asked by voice, and the acquisition of the target object with the answer displayed among multiple target objects may be highly evaluated. Rock, Paper, Scissors may be displayed on the background screen, and the subject may be asked to retrieve the object with the winning mark. Such a multiple-choice task + motor task is a dual-task training that requires more advanced cognitive functions.

[0069] Furthermore, numbers may simply be displayed on the objects, and only the acquisition of objects with larger numbers may be evaluated.

[0070] The evaluation unit 214 may compare the single task score with the dual task score, and use the score difference to evaluate the cognitive function.

[0071] Dual task training requiring two motor functions simultaneously may be configured, for example, by providing two foot pedals and allowing the user to retrieve a target object only when either foot pedal is pressed. To retrieve a target object from the right, the user must reach out with his right hand while pressing the foot pedal with his right foot, requiring dual motor functions of interlocking the hands and feet. Another possible configuration would be to require the user to always touch a designated location with an avatar object on the opposite side to the avatar object that retrieves the object.

[0072] As described above, according to this embodiment, the radar screen image allows the user to recognize in advance the direction to which the head should be turned, so that even if the field of view is narrowed, confusion in the inner ear information is not caused, and VR sickness can be prevented. In other words, a comfortable rehabilitation can be provided to the user during rehabilitation using a head mounted display.

[0073] The position of the next object may be notified using stereophonic sound.

[0074] The target object does not necessarily have to fall vertically, but may be configured to touch a target approaching horizontally.

[0075] [Third embodiment] Next, a rehabilitation support device according to a third embodiment of the present invention will be described with reference to Figs. 7 to 9. Figs. 7 to 9 are diagrams showing operation screens 700, 800, and 900 of the rehabilitation support device. The rehabilitation support device according to this embodiment has a different layout of the operation screen compared to the second embodiment. Other configurations and operations are similar to those of the second embodiment, so the same configurations and operations are denoted by the same reference numerals and detailed description thereof will be omitted.

[0076] 7 is a diagram showing an operation screen 700 for generating a task based on a manual operation by an operator and providing it to a user. The user field of view screen 301, the re-center button 305, and the like and their contents are the same as those of the screen described in FIG. 3A.

[0077] The operation screen 700 includes, on the left side, a score display area 732 showing the positions of target objects that have appeared in the past and the number of times they have been achieved (achievement rate), a parameter setting area 721, and a task history display area 741. Furthermore, the operation screen 700 has an input area 724 for determining the position of the target object that will appear next, and a check box 725 for setting whether or not to accept operation of the appearance position of the target object by a hot key.

[0078] 8 is a diagram showing an operation screen 800 for causing a user to execute a task set read out from task set database 216. User field of view screen 301, re-center button 305, and the like and their contents are the same as those of the screen described in FIG. 3A.

[0079] The operation screen 800 does not have various parameter setting areas, but includes a task history display area 841, a score display area 832 showing the position of target objects that have appeared in the past and the number of times they have been achieved (achievement rate), and a task list display area 833 to be generated in the future.

[0080] Fig. 9 is a diagram showing an example of a screen 900 for displaying and editing the contents of a task set stored in task set database 216. On the screen of Fig. 9, a task set 901 consisting of 38 tasks is displayed.

[0081] Each task included in the task set 901 has parameters of occurrence time 911, task interval 912, task position 913, task angle 914, task distance 915, speed 916, perfect criterion 917, good criterion 918, and caught criterion 919.

[0082] 9 shows a state in which the parameters of task No. 2 are being edited. After editing, if the user selects the save button 902, the task set in the task set database 216 is updated.

[0083] The total data display area 903 displays the total play time and the total number of left-hand and right-hand tasks.

[0084] In the new task registration area 904, a new task with various parameters set can be added to the task set 901. When all parameters such as the appearance position and speed are set and a new registration button 941 is selected, a line is added to the task set 901 at the top. In this case, it is registered as task No. 39. As described above, in this embodiment, a rehabilitation support device that is easier to operate and more user-friendly can be provided.

[0085] [Other embodiments] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In addition, systems or devices that combine the separate features included in each embodiment in any way are also included in the scope of the present invention.

[0086] The present invention may be applied to a system consisting of multiple devices, or to a single device. Furthermore, the present invention is also applicable to a case where a rehabilitation assistance program that realizes the functions of the embodiment is supplied directly or remotely to a system or device. Therefore, the scope of the present invention also includes a program that is installed in a computer to realize the functions of the present invention by a computer, a medium storing the program, and a WWW (World Wide Web) server that downloads the program. In particular, the scope of the present invention includes at least a non-transitory computer readable medium that stores a program that causes a computer to execute the processing steps included in the above-mentioned embodiment.

Claims

1. a display control unit that causes a target object, which is a target of the requested user action, to appear in a virtual space and display the target object on a head mounted display worn by the user; an operation unit that accepts a setting operation of the target object; An action request system comprising: The operation unit includes: a user viewing area for displaying an image displayed on the head mounted display; a parameter setting area for setting attributes of the target object; a score display area for displaying a score of a user's action on the target object; An operation request system that displays an operation screen for an operator including the above.

2. The operation screen further includes:

2. The action request system of claim 1, further comprising an input area for defining the location of a next-appearing target object.

3. 3. The action request system according to claim 2, wherein the input area is a block image obtained by dividing the periphery of the user position into a plurality of blocks.

4. The input area is: The action request system according to claim 3 , further comprising at least one of a visual field area image indicating the visual field of the user and a head image indicating a direction of the user's head as viewed from above.

5. a display control step in which a target object, which is a target of the requested user action, appears in a virtual space and is displayed on a head mounted display worn by the user by a display control unit; an operation step in which an operation unit receives a setting operation of the target object; An action request method comprising: In the operation step, a user viewing area for displaying an image displayed on the head mounted display; a parameter setting area for setting attributes of the target object; a score display area for displaying a score of a user's action on the target object; An operation request method for displaying an operation screen for an operator, comprising:

6. a display control step of making a target object, which is a target of the requested user action, appear in the virtual space and display it on a head mounted display worn by the user; an operation step of accepting a setting operation of the target object; An operation request program for causing a computer to execute the above, In the operation step, a user viewing area for displaying an image displayed on the head mounted display; a parameter setting area for setting attributes of the target object; a score display area for displaying a score of a user's action on the target object; An operation request program for displaying an operation screen for an operator including the above.

Images