Information processing apparatus, information processing method, and program

Abstract

To enable a user to safely move in a virtual space.SOLUTION: An information processing apparatus 101 controls movement of virtual content in a virtual space. The information processing apparatus 101 estimates a behavior of a user reacting to movement of the virtual content on the basis of a position and attitude of the user. Then, the information processing apparatus 101 controls the movement of the virtual content in accordance with whether or not a prescribed condition is satisfied that an estimated position of a movement destination of the user after execution of the estimated behavior is safe.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to the control of virtual objects.

Background Art

[0002] In recent years, in VR (Virtual Reality) systems, by using devices corresponding to VR, it is possible to execute content such as performing sports or fitness movements in a virtual space. When using an HMD (Head-Mounted Display) that is worn on the user's head as a VR device, the surrounding environment in the real space cannot be recognized while wearing it, so there is a risk of hitting an obstacle or the like. In order to avoid such a danger, Patent Document 1 discloses a technique of setting a safe area where the user can move safely around the user and warning the user when the user tries to go outside the safe area. Further, Patent Document 2 discloses a technique of installing virtual obstacles on the virtual space so as to overlap with the obstacles in the real space so that the user does not contact the obstacles.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technology disclosed in Patent Document 1, there are cases where it is inevitable for the user to go out of the safe area depending on the situation of the content being played. For example, when the content is a sport such as volleyball, the user tries to jump to attack the flying ball so that the hand can reach the ball. In that case, even if a warning is given to the user, there is a force acting on the user to continue moving in the jumping direction and the user cannot stop immediately, and situations such as going out of the safe area can be considered. Also, in the technology disclosed in Patent Document 2, when there is another obstacle where the user has avoided an obstacle, it is conceivable that the user cannot stop immediately and will come into contact with the obstacle.

[0005] An object of the present invention is to enable a user to move safely in a virtual space.

Means for Solving the Problems

[0006] The information processing apparatus according to the present invention includes a control means for controlling the movement of a virtual object in a virtual space, and an estimation means for estimating the behavior of the user with respect to the movement of the virtual object based on the position and posture of the user, and the control means controls the movement of the virtual object based on the estimated position of the movement destination of the user when the estimated behavior of the user is performed.

Effects of the Invention

[0007] According to the present invention, it is possible to enable a user to move safely in a virtual space.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Mode for Carrying Out the Invention

[0009] Hereinafter, each embodiment will be described in detail based on the attached drawings.

[0010] [Embodiment 1] In this embodiment, a case where a user uses a VR (Virtual Reality) fitness application (hereinafter referred to as a fitness application) that performs exercise while avoiding virtual content such as a ball in a virtual space will be described as an example. In the VR system of this embodiment, the behavior of the user is predicted from the position and posture of the user and the movement direction of the virtual content, and the virtual content is controlled according to whether the position estimated as the user's movement destination is safe. Hereinafter, virtual content such as a ball is an example of a virtual object.

[0011] FIG. 1 shows an example of the overall configuration of the VR system according to this embodiment. The VR system includes an information processing apparatus 101, a head-mounted display (hereinafter referred to as an HMD) 102 worn on the user's head, and a controller 103 operated by the user. The information processing apparatus 101 is connected to the HMD 102 and communicates therewith. Note that, as shown in the figure, communication may be performed by wire, or wireless communication technologies such as a wireless LAN or Bluetooth may be used. The information processing apparatus 101 starts the fitness application and transmits images, sounds, etc. generated by the fitness application to the HMD 102. The information processing apparatus 101 and the HMD 102 may be integrally configured.

[0012] The HMD 102 displays the video generated by the information processing device 101 within the field of view of the user wearing it. The HMD 102 may be equipped with a microphone for inputting the user's voice, a speaker for outputting the voice generated by the information processing device 101, and the like. The user operates the character in the fitness app using the controller 103 while connected to the HMD 102 or the information processing device 101.

[0013] With reference to FIG. 2, a configuration example of each device of the VR system according to this embodiment will be described. As shown in FIG. 2(a), the information processing device 101 includes a control unit 201, an arithmetic unit 202, a memory 203, a graphics arithmetic unit 204, a storage device 205, and a communication interface for communicating with an external device. As the communication interface, there are an HMD communication unit 215 for communicating with the HMD 102, a controller communication unit 216 for communicating with the controller 103, and a network communication unit 217 for communicating with a network such as the Internet. The network communication unit 217 is an interface for communicating with an external network such as the Internet and communicates with a database or the like existing on the network.

[0014] The control unit 201 is a CPU (Central Processing Unit) and controls the entire information processing device 101. The memory 203 is a RAM (Random Access Memory) and functions as a work memory. The storage device 205 is a large-capacity storage device such as an HDD (Hard Disk Drive) and stores various data and programs for executing the fitness app. By the control unit 201 reading out the program stored in the storage device 205, expanding it in the memory 203, and executing it, the processing of the flowchart described later is realized. The arithmetic unit 202 and the graphics arithmetic unit 204 perform the arithmetic operations necessary for the execution of the processing. The control unit 201 transmits the processing result to the HMD 102 via the HMD communication unit 215 as video or audio.

[0015] As shown in FIG. 2(a), the HMD 102 includes a video display device 218, an audio output device 219, a position and orientation detection device 220, a camera 221, and a microphone 222. The video display device 218 displays the video received from the information processing device 101 within the user's field of view. The audio output device 219 outputs the audio received from the information processing device 101 to the user's hearing. The position and orientation detection device 220 detects the position and orientation of the HMD 102. The camera 221 detects information around the HMD 102. The microphone 222 inputs the voice spoken by the user. In order to transmit and receive information between each device included in the HMD 102, the information processing device 101 is equipped with an HMD communication unit 215.

[0016] Between the HMD communication unit 215 and the HMD 102, communication of various digital data (such as images, audio, text data, position and orientation data, etc.) is performed. This communication may be either wired communication or wireless communication. Also, for the communication protocol used in this communication, any communication protocol may be used as long as image data, video data, text, control data, etc. can be communicated. For example, there are Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP), Picture Transfer Protocol (PTP), Universal Serial Bus (USB). Also, for example, there are Local Area Network (LAN), Health Level Seven (HL7), Digital Imaging and Communications in Medicine (DICOM), etc. Also, communication protocols other than the above may be used.

[0017] As shown in FIG. 2(a), the controller 103 includes a button input device 223 that receives input from the user, a position and orientation detection device 224 that detects the position and orientation of the controller 103, and a tactile output device 225 that provides stimuli such as vibration or current to the user's sense of touch. In order to transmit and receive information between each device included in the controller 103, the information processing device 101 is equipped with a controller communication unit 216.

[0018] Between the controller communication unit 216 and the controller 103, digital data such as input signals, position and orientation data, and tactile data are communicated. This communication may be either wired communication or wireless communication. Also, the communication protocol used for this communication may be the same protocol as the communication protocol used between the HMD communication unit 215 and the HMD 102, or another type of communication protocol may be used.

[0019] Figure 2(b) shows an example of the functional configuration of the information processing apparatus 101. The information processing apparatus 101 has each function shown in Figure 2(b). By executing the program stored in the storage device 205 by the control unit 201, each function shown in Figure 2(b) is realized. The safety area setting unit 206 sets an area where the user can act safely. As a method for setting the safety area, there is a method of installing a transmitter or the like at the four corners of an area without obstacles, and setting the safety area assuming that there are no obstacles within the area range set by the transmitter. Also, there are methods such as moving the controller 103 to trace the periphery of an area without obstacles, and detecting surrounding obstacles with the camera 221 of the HMD 102.

[0020] The first position and orientation processing unit 207 acquires position and orientation data such as the XYZ coordinates and inclination of the HMD 102 in the real space from the position and orientation detection device 220 of the HMD 102, and calculates the position and orientation of the user. The second position and orientation processing unit 208 acquires position and orientation data such as the XYZ coordinates and inclination of the controller 103 in the real space from the position and orientation detection device 224 of the controller 103, and calculates the position and orientation of the user's hand. The virtual content generation unit 209 generates the virtual content generated by the fitness application at an arbitrary position and orientation in the virtual space. Also, a process for erasing the virtual content is performed.

[0021] The image processing unit 210 calculates how virtual content looks to the user using the user's position information obtained from the first position and orientation processing unit 207 and the position information of the virtual content obtained from the virtual content generation unit 209 and the virtual content movement unit 211. The image processing unit 210 causes the video display device 218 of the HMD 102 to display the video information as the calculation result. As a result, the user wearing the HMD 102 can visually recognize the virtual content as if it were in front of them.

[0022] The virtual content movement unit 211 moves the position and orientation of the virtual content based on parameters such as the destination position and movement speed of the virtual content. When the virtual content is moved, the video information obtained by the image processing unit 210 is sequentially updated. The position movement estimation unit 212 estimates what action the user will take next from the user's position and orientation and the states such as the position and orientation and movement direction of the virtual content. As a method of estimation, there is a method of accumulating and learning data such as what actions the user took when the user visually recognized the virtual content in the virtual space and using the obtained results.

[0023] The danger determination unit 213 determines whether the action of the user estimated by the position movement estimation unit 212 is dangerous. Specifically, the danger determination unit 213 determines whether the position of the user's movement destination when the estimated action is taken is outside the safe area. In addition, the danger determination unit 213 may photograph the surroundings of the user with a camera or the like to detect obstacles and determine whether the user will come into contact with the obstacles when the estimated action is taken. When the danger determination unit 213 determines danger, the induction position estimation unit 214 estimates the position and orientation, moving direction, etc. of the virtual content so as to satisfy a predetermined condition under which the user's behavior becomes safe. The predetermined condition is that the position of the user's movement destination when the estimated behavior is performed is within the safe area. Also, it is that the user does not come into contact with an obstacle. As a method of estimation, there is a method of setting in advance data such as the direction in which the user is likely to move with respect to the position and orientation, moving direction of the virtual content statistically. Also, there is a method of learning the relationship between the user's behavior and the movement of the virtual content during the execution of the fitness app, and predicting the direction in which the user moves using the learned result.

[0024] Figure 3 is a flowchart showing the processing executed by the information processing apparatus 101 according to the present embodiment. In the following description of the flowchart, the notation of the steps (steps) is omitted by attaching S at the beginning for each step (step). The processing of this flowchart starts from the state where the user wears the HMD 102 and turns on the power of the information processing apparatus 101.

[0025] When the information processing apparatus 101 is activated, in S301, the control unit 201 executes initialization processing of each device of the VR system. In the initialization processing, the OS installed in the information processing apparatus 101 is started, the state is confirmed, and the connected devices, connection confirmation with the HMD 102, the controller 103, etc. are performed. In S302, the control unit 201 activates the fitness app. In S303, the safe area setting unit 206 sets a safe area as an area where the user can act safely.

[0026] In S304, the first position and orientation processing unit 207 acquires the position and orientation information of the user from the position and orientation data of the HMD 102. In S305, the second position and orientation processing unit 208 acquires the position and orientation information of the user's hand from the position and orientation data of the controller 103. During the execution of this flowchart, the control unit 201 sequentially stores the position and orientation information acquired in S304 and S305 in the sequential memory 203 or the like.

[0027] In S306, the control unit 201 starts the execution of the fitness application. The fitness application is an application that displays virtual content generated by the fitness application on the HMD 102 worn by the user, and aims to promote the user's health by having the user perform movements such as avoiding the virtual content. The control unit 201 may accept input of user information using the controller 103 at the start of the execution of the fitness application. Further, the control unit 201 may change settings such as the difficulty level of the fitness application according to the user's physical information such as age, gender, and assumed amount of exercise. Further, the control unit 201 may set the amount of exercise, the number of times of avoiding virtual content, etc. according to the difficulty level, or may set them to arbitrary numerical values.

[0028] As a method of starting the fitness application, there is a method of displaying an image including an icon such as "Start" or "START" on the HMD 102, having the user select the icon with the controller 103, and inputting an instruction with the button input device 223. Further, there is a method of using, as a trigger, the detection of a gesture of a predetermined operation or the like by the movement of the position and orientation of the controller 103.

[0029] In S307, the virtual content generation unit 209 generates virtual content at an arbitrary position and orientation in the virtual space. The virtual content to be generated is determined by the fitness application. When the content of the fitness is to avoid a ball or the like, the generated content is content in the shape of a ball.

[0030] In S308, the virtual content movement unit 211 executes the operation preparation of the virtual content generated in S307. In the operation preparation, parameters such as the position to move the virtual content generated in S307 and the moving speed (hereinafter referred to as moving parameters) are determined according to the difficulty level set in the fitness application. When the difficulty level is low, the virtual content movement unit 211 determines moving parameters such that the virtual content moves at a low speed to a position where it is easy for the user to avoid. Also, when the difficulty level is high, the virtual content movement unit 211 determines moving parameters such that the virtual content moves at a high speed to a position where it is difficult for the user to avoid. Note that the difficulty level may be set to gradually increase as the fitness application progresses, or may be set based on the user's physical ability or the like. The virtual content movement unit 211 determines the trajectory of the virtual content using the position and orientation of the virtual content generated in S307 and the determined moving parameters.

[0031] In S309, the position movement estimation unit 212 estimates what actions the user will take when moving the position and orientation of the virtual content along the trajectory determined in S308. In S310, the danger determination unit 213 determines whether the estimated position of the user's moving destination is dangerous when the user performs the action estimated in S309. Here, if the estimated moving position of the user is outside the safe area, it is determined to be dangerous, and if the estimated moving position of the user is inside the safe area, it is determined to be safe. When the danger determination unit 213 determines that the estimated position of the moving destination is dangerous, the process proceeds to S311 to correct the moving parameters determined in S308. When it is determined that the estimated position of the moving destination is safe, the process proceeds to S314.

[0032] Referring to FIG. 4, the destination of the user will be described. For user 403 playing the fitness app, a safe area 401 is set. FIG. 4(a) shows the state when the trajectory 402 of the virtual content is determined in S308. The video in which the virtual content moves along the trajectory 402 is in a state of being temporarily generated by the video processing unit 210 and has not been output to the HMD 102 yet. That is, the video in which the virtual content moves along the trajectory 402 is not visible to the user 403. In the trajectory 402, when the user 403 is at the position 410, since the virtual content is coming from in front of the user 403 and moving leftward, the position movement estimation unit 212 estimates that the user 403 will move to the position 411 to avoid the virtual content (S309). Since the estimated destination position 411 is outside the safe area 401, the danger determination unit 213 determines that the user's destination is dangerous (S310).

[0033] Return to the description of FIG. 3. In S311, the virtual content movement unit 211 cancels the trajectory of the virtual content determined in S308. In the process of canceling the trajectory of the virtual content, the movement parameters determined in S308 are discarded, and the initial state at the time of virtual content generation is restored. In S312, the guidance position estimation unit 214 estimates the trajectory of the virtual content such that the user's destination satisfies a predetermined condition regarding safety. Specifically, the guidance position estimation unit 214 estimates the trajectory of the virtual content for guiding the user's destination to a position within the safe area.

[0034] FIG. 4(b) shows the state when the trajectory 402 of the virtual content in FIG. 4(a) is corrected to the trajectory 412 of the virtual content estimated in S312. In the trajectory 412, the virtual content is changed to move from in front of the user 403 and rightward so that the estimated position of the user 403's destination is the position 413 within the safe area 401.

[0035] In S313, the virtual content movement unit 211 re-determines the movement parameters of the virtual content according to the orbit of the virtual content estimated in S312. Specifically, it determines the position and orientation, movement direction, movement speed, etc. of the virtual content. After the completion of the process in S313, or when it is determined in S310 that the estimated position of the user's destination is a safe position, the process proceeds to S314. In S314, the video processing unit 210 causes the video information of the virtual content generated in S307 to be displayed on the video display device 218 of the HMD 102. Also, the video processing unit 210 updates the position and orientation of the virtual content in the virtual space using the movement parameters of the virtual content determined in S308 or S313. The user who visually recognizes the virtual content takes actions such as avoiding the moving virtual content.

[0036] In S315, the control unit 201 determines whether the exercise of the fitness app has ended. The conditions for ending are, for example, when the amount of exercise set at the start of the execution of the fitness app in S306 is reached, or when the number of times of avoiding the virtual content is completed. When the control unit 201 determines to end the exercise of the fitness app, the process proceeds to S316, and when it determines to continue the exercise of the fitness app, the process proceeds to S308. In S316, the control unit 201 saves the data in the fitness app, performs an end process on the connected HMD 102 and controller 103, and makes it in a state where the power can be safely turned off. After that, the control unit 201 ends the processing of the series of flowcharts.

[0037] According to the present embodiment as described above, when the user is about to perform a play that may damage the user's own safety, the movement of the virtual content can be controlled so as to avoid such a play. Thereby, the user can continue playing safely without being aware of obstacles or the like.

[0038] [Embodiment 2] In Embodiment 2, a method for guiding a user based on the safety level of the estimated position of the user's destination will be described. Note that the content described in Embodiment 1 will be omitted from the description.

[0039] FIG. 5 is a flowchart showing the processing executed by the information processing apparatus 101 according to the present embodiment. Since the processing from S501 to S508 is the same as the processing from S301 to S308, the description thereof will be omitted. In S509, the position movement estimation unit 212 estimates what actions the user will take when the position and orientation of the virtual content are moved along the trajectory determined in S508. Since the details of the processing content are the same as those in S308, the description thereof will be omitted.

[0040] In S510, the position movement estimation unit 212 calculates the safety level for one or more destinations that the user can move to from the user's current position and orientation. The safety level of the destination is calculated based on the positional relationship between the user's destination and the safe area. Specifically, it is calculated based on whether the user's destination is within the safe area. Also, the safety level of the destination is calculated based on whether there are obstacles at the user's destination, whether the destination is easy for the user to move to, and the like. Note that the safety level for the user's destination when the actions estimated in S509 are taken may be calculated separately.

[0041] Referring to FIG. 6, the safety level of the user's destination will be described. A safe area 600 is set as an area where a user playing a fitness app can move safely. In FIG. 6, estimated movement positions 602 to 604 that the user can move to from the user's current position 601 are shown. The estimated movement positions 602 to 604 include the user's destinations when the actions estimated in S509 are taken. In FIG. 6, the user's movement directions are set to three directions, but it may be less than three directions or more than three directions. For example, it may be a preset direction such as front, back, left, and right, or it may be the user's movement direction estimated for the trajectory of the virtual content according to some candidates of movement parameters.

[0042] FIG. 7 shows an example of the calculation results of the safety levels for each of the estimated movement positions 602 to 604 shown in FIG. 6. Since the estimated movement position 602 is outside the safe area, the safety level is 0% as it is considered that safety cannot be ensured. The estimated movement position 603 is in the backward diagonal direction of the user's movement, so it is a direction in which it is difficult for the user to move and there is a risk of falling. However, since it is within the safe area, the safety level is 50%. The estimated movement position 604 has no factors inhibiting the user's movement, so the safety level is 100%. In calculating the safety level, factors such as the user's physical ability and age may be reflected. Also, tendencies such as the direction in which the user is likely to move can be learned from the execution status of the fitness application that the user is running, and the learned results may be reflected.

[0043] In S511, the position movement estimation unit 212 determines whether the calculation of the safety level has been completed for the movement destinations of all users. If the position movement estimation unit 212 determines that the calculation of the safety level has been completed, the process proceeds to S512. If it determines that the calculation of the safety level has not been completed, assuming there are other possible movement destinations, the process proceeds to S509 to calculate the safety level for the other movement destinations.

[0044] In S512, the position movement estimation unit 212 selects the estimated movement position with the highest safety level from among the safety levels calculated in S510. Note that the position movement estimation unit 212 is not limited to the method of selecting the estimated movement position with the highest safety level, and may select the estimated movement position in consideration of the set difficulty level, the user's physical ability, etc.

[0045] In S513, the position movement estimation unit 212 determines whether the selected estimated movement position is the same as the user's movement destination (initial position) when the action estimated in S509 is performed. If the position movement estimation unit 212 determines that the selected estimated movement position is the same as the initial position, the process proceeds to S517. On the other hand, if the position movement estimation unit 212 determines that the selected estimated movement position is not the initial position, the process proceeds to S514 to correct the movement parameters determined in S508 so as to guide the user's position to the selected estimated movement position. Since S514 to S519 are the same as the processes of S311 to S316, the description thereof is omitted.

[0046] According to the present embodiment as described above, when the user is about to perform a play that may impair the user's own safety, while avoiding such a play, the movement of the virtual content is controlled so that the user can move to an appropriate position according to the user's physical ability or the like. As a result, the user can continue playing safely without being aware of obstacles.

[0047] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiment to a system or apparatus via a network or a storage medium, and having one or more processors in the computer of the system or apparatus read and execute the program. Further, it can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0048] The disclosure of each of the above embodiments includes the following configurations, methods, and programs. (Configuration 1) Control means for controlling the movement of a virtual object in a virtual space, Estimation means for estimating the behavior of the user with respect to the movement of the virtual object based on the position and posture of the user, and the control means controls the movement of the virtual object based on the estimated position of the destination of the user when the estimated behavior of the user is performed, characterized in that the information processing apparatus. (Configuration 2) The control means corrects the movement of the virtual object so that the estimated position satisfies the predetermined condition when the estimated position of the destination of the user when the estimated behavior of the user is performed does not satisfy the predetermined condition for safety, the information processing apparatus according to Configuration 1, characterized in that. (Configuration 3) The control means determines the trajectory of the virtual object, the estimation means estimates the behavior of the user with respect to the trajectory of the virtual object, When the estimated position satisfies the predetermined condition, the control means moves the virtual object along the trajectory; when the estimated position does not satisfy the predetermined condition, the control means corrects the trajectory of the virtual object so that the estimated position satisfies the predetermined condition. The information processing apparatus according to Configuration 2. (Configuration 4) The apparatus further includes setting means for setting a safe area within which the user can move safely. The information processing apparatus according to Configuration 2 or 3, wherein the predetermined condition is that the position is within the safe area. (Configuration 5) The information processing apparatus according to any one of Configurations 2 to 4, wherein the predetermined condition is that the virtual object does not contact an obstacle. (Configuration 6) The apparatus further includes calculating means for calculating the safety level of a possible movement destination based on the position and orientation of the user. The information processing apparatus according to any one of Configurations 1 to 5, wherein the control means determines the movement destination based on the safety level, and controls the movement of the virtual object so as to guide the position of the user to the determined movement destination. (Configuration 7) The control means determines the trajectory of the virtual object. The estimation means estimates the behavior of the user with respect to the trajectory of the virtual object. The information processing apparatus according to Configuration 6, wherein when the movement destination determined based on the safety level is the same as the estimated position of the movement destination of the user when the estimated behavior is performed, the control means moves the virtual object along the trajectory; when they are different, the control means corrects the trajectory of the virtual object so as to guide the position of the user to the movement destination determined based on the safety level. (Configuration 8) The control means determines the trajectory of the virtual object. The estimation means estimates the behavior of the user with respect to the trajectory of the virtual object. The calculation means calculates a safety level for a first position representing an estimated position of the destination of the user when the estimated action is taken, and a safety level for a second position different from the first position representing a position of a destination that can be moved from the position and posture of the user. When the destination determined based on the safety level corresponds to the first position, the control means moves the virtual object along the trajectory, and when it corresponds to the second destination, the control means corrects the trajectory of the virtual object so as to guide the position of the user to the destination determined based on the safety level. The information processing apparatus according to Configuration 6. (Configuration 9) Further comprising setting means for setting a safe area where the user can act safely. The calculation means calculates the safety level based on the positional relationship between the destination and the safe area. The information processing apparatus according to any one of Configurations 6 to 8. (Configuration 10) The calculation means calculates the safety level based on the ease of movement of the user to the destination. The information processing apparatus according to any one of Configurations 6 to 9. (Configuration 11) The control means determines the destination based on the safety level and the physical ability of the user. The information processing apparatus according to any one of Configurations 6 to 10. (Configuration 12) The video of the virtual object generated by the control means is displayed on a head-mounted display worn by the user. The information processing apparatus according to any one of Configurations 1 to 11. (Method) A control step of controlling the movement of a virtual object in a virtual space, An estimation step of estimating the action of the user with respect to the movement of the virtual object based on the position and posture of the user, Including, In the control step, the movement of the virtual object is controlled based on the estimated position of the destination of the user when the estimated action of the user is taken. The information processing method. (Program) A computer, control means for controlling the movement of a virtual object in a virtual space, estimation means for estimating the user's action with respect to the movement of the virtual object based on the user's position and orientation, functioning as, a program for controlling the movement of the virtual object based on the estimated position of the user's movement destination when the estimated user action is performed by the control means.

Explanation of Signs

[0049] 101: Information processing apparatus, 102: Head-mounted display, 203: Controller

Claims

1. control means for controlling the movement of a virtual object in a virtual space; estimation means for estimating the user's action with respect to the movement of the virtual object based on the user's position and posture; characterized by comprising: The control means controls the movement of the virtual object based on the estimated position of the user's destination when the estimated user action is performed. An information processing apparatus.

2. If the estimated position of the user's destination when the estimated user action is performed does not satisfy a predetermined condition for safety, the control means modifies the movement of the virtual object so that the estimated position satisfies the predetermined condition. The information processing apparatus according to claim 1, characterized in that

3. The control means determines the trajectory of the virtual object; The estimation means estimates the user's action with respect to the trajectory of the virtual object; When the estimated position satisfies the predetermined condition, the control means moves the virtual object along the trajectory, and when the estimated position does not satisfy the predetermined condition, the control means corrects the trajectory of the virtual object so that the estimated position satisfies the predetermined condition. The information processing apparatus according to claim 2, characterized in that

4. further comprising setting means for setting a safe area where the user can act safely; The predetermined condition is that it is within the safe area. The information processing apparatus according to claim 2, characterized in that

5. The predetermined condition is that there is no contact with an obstacle. The information processing apparatus according to claim 2, characterized in that

6. further comprising calculation means for calculating the safety level of a movable destination from the user's position and posture; The control means determines the destination based on the safety level and controls the movement of the virtual object so as to guide the user's position to the determined destination. The information processing apparatus according to claim 1, characterized in that

7. The control means determines the trajectory of the virtual object; The estimation means estimates the user's action with respect to the trajectory of the virtual object; When the destination determined based on the safety level is the same as the estimated position of the user's destination when the estimated action is performed, the control means moves the virtual object along the trajectory, and when it is different from the estimated position, the control means moves the virtual object along the trajectory. The information processing apparatus according to claim 6, characterized in that the trajectory of the virtual object is corrected so as to guide the user's position to the destination determined based on the safety level.

8. The control means determines the trajectory of the virtual object; The estimation means estimates the user's behavior with respect to the trajectory of the virtual object, The calculation means calculates a safety level for a first position representing an estimated position of the user's destination when performing the estimated behavior, and a safety level for a second position different from the first position representing a position of a movable destination from the user's position and posture, The control means moves the virtual object on the trajectory when the destination determined based on the safety level corresponds to the first position, and corrects the trajectory of the virtual object so as to guide the user's position to the destination determined based on the safety level when the destination corresponds to the second destination. The information processing apparatus according to claim 6, characterized in that

9. Further comprising setting means for setting a safety area in which the user can act safely, The calculation means calculates the safety level based on the positional relationship between the destination and the safety area. The information processing apparatus according to claim 6, characterized in that

10. The calculation means calculates the safety level based on the ease of movement of the user to the destination. The information processing apparatus according to claim 6, characterized in that

11. The control means determines the destination based on the safety level and the physical ability of the user. The information processing apparatus according to claim 6, characterized in that

12. The information processing apparatus according to claim 1, characterized in that the video of the virtual object generated by the control means is displayed on a head-mounted display worn by the user.

13. A control step of controlling the movement of a virtual object in a virtual space; An estimation step of estimating the user's behavior with respect to the movement of the virtual object based on the user's position and posture; including In the control step, the movement of the virtual object is controlled based on an estimated position of the user's destination when performing the estimated user behavior. An information processing method.

14. A computer, Control means for controlling the movement of a virtual object in a virtual space; Estimation means for estimating the user's behavior with respect to the movement of the virtual object based on the user's position and posture, function as A program for controlling the movement of the virtual object based on an estimated position of the user's destination when performing the estimated user behavior by the control means.

Images