Information processing apparatus, information processing method, and program

Abstract

To allow a user wearing a head-up display to easily enjoy an immersive experience when viewing a content.SOLUTION: An information processing apparatus 10 generates a virtual space including a physical expression image indicating at least a part of the body of a user. The information processing apparatus 10 displays, on a display, an operation image including at least one of one or more operation buttons representing predefined angle correction and a slider representing continuous angle correction. The information processing apparatus 10 receives operation information of the user while the virtual space and the operation images are displayed on the display. The information processing apparatus 10 corrects, based on an angle represented by the operation information, a display angle for the virtual space including the physical expression image when presenting the virtual space on the display. The information processing apparatus 10 displays, on the display, the virtual space including the physical expression image with a corrected angle.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] In recent years, technology that provides virtual spaces using head-mounted displays has rapidly become popular. It has been pointed out that with such technology, whether or not users can achieve a sense of immersion, that is, a sense of reality, is an extremely important factor in providing excitement and satisfaction.

[0003] Patent Document 1 discloses a technique for correcting the pitch angle of a virtual space including a body representation image so as to suppress the discrepancy between the display position of the body representation image, which represents an image of the user's body displayed on a head-mounted display, and the actual position of the user's body. In the technique of Patent Document 1, the user corrects the pitch angle by operating an operation device such as that shown in Figure 5 of Patent Document 1. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6664778 Summary of the Invention [Problem to be solved by the invention]

[0005] By adopting the technology of Patent Document 1, the discrepancy between the position of a part of the user's body depicted on the screen representing the virtual space and the position of the corresponding part of the user's body in reality is reduced, allowing the user to feel a sense of immersion.

[0006] The technology disclosed in Patent Document 1 is premised on the assumption that the user will operate an operating device such as that shown in Figure 5 of Patent Document 1. However, if an operating device is not used for the purpose of simplifying the system configuration, for example, it is also disclosed that an operating screen such as that shown in Figure 16 of Patent Document 1 may be displayed in the virtual space as an alternative (for example, paragraph

[0090] ).

[0007] By displaying an operation screen such as that shown in FIG. 16 of Patent Document 1 in a virtual space, a dedicated operation device is not required. However, the operation screen shown in FIG. 16 of Patent Document 1 only displays a pitch angle correction gauge. For example, a user may want to accurately correct the pitch angle to their desired level with simpler operations, rather than simply operating the operation screen shown in FIG. 16 of Patent Document 1 to continuously correct the pitch angle. Also, there may be cases where it is preferable for the pitch angle to be corrected automatically without user operation.

[0008] Therefore, an object of the present disclosure is to provide an information processing device, an information processing method, and a program that allow a user to more easily obtain a sense of immersion when wearing a head-up display and watching content. [Means for solving the problem]

[0009] In order to solve the above problem, a first aspect of the present disclosure is an information processing device that presents a virtual space on a display worn on a user's head, the information processing device comprising: a first receiving means that receives detection information from a sensor that detects movement of the user's head; a generation means that generates the virtual space in accordance with the detection information received by the first receiving means; a display control means that displays, on the display, an operation image for receiving an operation that represents a degree of correction of an angle of the virtual space as seen by the user when the virtual space generated by the generation means is displayed on the display, the operation image including at least one of one or more operation buttons that represent a predetermined angle correction and a slider that represents continuous angle correction; a second receiving means that receives operation information from the user when the virtual space and the operation image are displayed on the display by the display control means; and a correction means that, when the operation information received by the second receiving means is an operation on the operation image, corrects an angle of the display of the virtual space based on the angle represented by the operation information, and the display control means displays, on the display, the virtual space whose angle has been corrected by the correction means.

[0010] A second aspect of the present disclosure is an information processing device that presents a virtual space on a display worn on a user's head by playing predetermined video content, the information processing device having: a first reception means that receives detection information from a sensor that detects movement of the user's head; a generation means that generates the virtual space based on the detection information received by the first reception means and an image generated by playing the video content; a display control means that displays the virtual space generated by the generation means on the display; and a correction means that, when a body expression image showing at least a part of a virtual user's body is displayed on the display, corrects the angle of the body expression image as seen from the user based on body posture information of the virtual user in the virtual space that is pre-added to each time of the video content.

[0011] A third aspect of the present disclosure is an information processing device that presents a virtual space on a display worn on a user's head by playing predetermined video content, the information processing device having: a first reception means that receives detection information from a sensor that detects movement of the user's head; a generation means that generates the virtual space based on the detection information received by the first reception means and an image generated by playing the video content; a display control means that displays the virtual space generated by the generation means on the display; and a correction means that, when a body expression image showing at least a part of a virtual user's body is displayed on the display, corrects the angle of the body expression image as seen by the user based on at least one of the body expression image displayed in the virtual space and a virtual object displayed in the virtual space. [Effects of the Invention]

[0012] According to the present disclosure, it is possible to provide an information processing device, an information processing method, and a program that enable a user to more easily obtain a sense of immersion when viewing content while wearing a head-up display. [Brief explanation of the drawings]

[0013] [Figure 1] 1 illustrates an example configuration of a system including an information processing device according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of the information processing device illustrated in FIG. [Figure 3] FIG. 2 is a diagram illustrating an example of the configuration of the HMD shown in FIG. [Figure 4] 4 is a diagram showing three axial directions of the HMD shown in FIG. 3. FIG. [Figure 5] 2 is a diagram illustrating an example of the electrical configuration of the pointing device illustrated in FIG. 1. FIG. [Figure 6] FIG. 1 is a diagram showing the positional relationship of a VR space image intended by a creator or the like. [Figure 7] FIG. 10 is a diagram showing the positional relationship of an actual VR space image. [Figure 8]FIG. 10 is a diagram showing the positional relationship of the VR space image after pitch angle correction. [Figure 9A] FIG. 10 is a diagram showing an example of an operation image. [Figure 9B] FIG. 10 is a diagram showing an example of an operation image. [Figure 10] FIG. 10 is a diagram showing an example of an operation image displayed in a VR space image. [Figure 11] 1 is a flowchart illustrating an example of processing executed in an embodiment. [Figure 12] FIG. 10 is a diagram for explaining a second embodiment. [Figure 13] FIG. 10 is a diagram for explaining a second embodiment. [Figure 14] FIG. 10 is a diagram for explaining a second embodiment. [Figure 15] FIG. 10 is a diagram for explaining a second embodiment. [Figure 16] FIG. 10 is a diagram for explaining a second embodiment. [Figure 17] FIG. 10 is a diagram showing another example of an operation image. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present disclosure will be described.

[0015] First Embodiment (A) Description of the configuration of the first embodiment of the present disclosure 1 is a diagram showing a configuration example of an information processing system including an information processing device according to the first embodiment of the present disclosure. As shown in Fig. 1, the information processing system according to the first embodiment of the present disclosure includes an information processing device 10, an HMD (Head Mount Display) 30, a pointing device 50, and a network 70.

[0016] Here, as will be described later, the information processing device 10 is configured by a personal computer or the like, and generates a VR (Virtual Reality) space image based on a program or data supplied from a server (not shown) connected to a network 70, supplies the generated image to the HMD 30, and updates the VR space image in accordance with the movement of the head of a user wearing the HMD 30. When a pointing device 50 is operated by a user, the information processing device 10 executes processing (described later) in accordance with the operation. Note that the pointing device 50 may be of any type. The VR space image is an example of a virtual space.

[0017] The HMD 30 is worn by the user on the head, displays a VR space image supplied from the information processing device 10 on a built-in display, and detects the movement of the user's head and supplies the detected movement to the information processing device 10.

[0018] The pointing device 50 is operated by a user, and generates and outputs operation information corresponding to the operation. The pointing device 50 is, for example, a device attached to the HMD 30 or the information processing device 10, for operating or specifying an object in a VR space.

[0019] The network 70 is configured by, for example, the Internet, and transmits information between a server (not shown) and the information processing device 10 as IP packets.

[0020] 2 is a block diagram showing an example of the electrical configuration of the information processing device 10. As shown in FIG. 2, the information processing device 10 includes a pitch angle correction amount setting unit 11, a reception unit 12, a VR space image generation unit 13, an HMD movement detection unit 14, an avatar generation unit 15, and a communication unit 16.

[0021] Here, the pitch angle correction amount setting unit 11 sets the amount of correction for the pitch angle of the VR space image based on information input from the pointing device 50. The pitch angle correction amount setting unit 11 is an example of a correction means.

[0022] When the pointing device 50 is operated, the reception unit 12 receives operation information, which is information indicating the operation, from the pointing device 50. The reception unit 12 is an example of a second reception means.

[0023] The VR space image generation unit 13 generates a VR space image constructed around the user and supplies it to the HMD 30. The VR space image generation unit 13 is an example of a generation means and a display control means.

[0024] The HMD motion detection unit 14 receives information about the movement of the HMD 30 output from an acceleration sensor (described later) included in the HMD 30, and detects the movement of the HMD 30 to detect the movement of the user's head. The information about the movement of the HMD 30 is an example of information detected by a sensor that detects the movement of the user's head. The HMD motion detection unit 14 is also an example of a first accepting means.

[0025] The avatar generation unit 15 generates an avatar image, which is an image of at least a part of the body of an avatar that is an incarnation of a protagonist from a first-person perspective. The avatar image is an example of a body expression image. The avatar is also an example of a virtual user.

[0026] The communication unit 16 accesses a server (not shown) via the network 70, obtains information stored in the server, and transmits information to the server.

[0027] Fig. 3 is a block diagram showing an example of the electrical configuration of the HMD 30. As shown in Fig. 3, the HMD 30 has a processor 31, a memory 32, a set of displays 33, a plurality of acceleration sensors 34, a plurality of LEDs (Light Emitting Diodes) 35, a communication unit 36, a speaker 37, and a microphone (hereinafter simply referred to as "microphone") 38.

[0028] The HMD 30 is worn on the user's head when in use. The HMD 30 has a pair of left and right displays 33 for displaying the VR space image supplied from the information processing device 10 to the left and right eyes of the user, a pair of left and right optical lenses positioned between the displays 33 and the user's eyes for expanding the viewing angle, and an acceleration sensor 34 for detecting the movement of the user's head.

[0029] Here, the processor 31 controls each part of the device based on the programs and data stored in the memory 32.

[0030] The memory 32 is configured by, for example, a random access memory (RAM) and a read only memory (ROM), and stores programs and data executed by the processor 31.

[0031] The display 33 presents the VR space image supplied from the information processing device 10 to the left and right eyes of the user.

[0032] The acceleration sensor 34 is configured by, for example, a gyro sensor. As shown in Fig. 4, the acceleration sensor 34 detects and outputs the movement of the user's head as the acceleration of each of a roll angle θr, which is the angle in the roll direction in which the head is tilted left and right, a yaw angle θy, which is the angle in the yaw direction in which the face is shaken left and right, and a pitch angle θp, which is the angle in the pitch direction in which the chin is raised and lowered.

[0033] Returning to Fig. 3, the LED 35, for example, constitutes a light-emitting marker, and is configured to be arranged so as to be able to detect the position of the HMD 30 relative to the information processing device 10.

[0034] The communication unit 36 ​​is connected to the information processing device 10 wirelessly or via a wired connection, receives VR space images from the information processing device 10, and transmits information indicating the acceleration of the HMD 30 in three axes directions detected by the acceleration sensor 34 to the information processing device 10.

[0035] The speaker 37 converts audio information supplied from the information processing device 10 via the communication unit 36 ​​into sound and emits the sound. Note that headphones may be used instead of the speaker 37.

[0036] The microphone 38 converts the voice uttered by the user into an electrical signal and outputs it.

[0037] 5 is a diagram showing an example of the electrical configuration of pointing device 50. As shown in FIG. 5, pointing device 50 has a processor 51, memory 52, operation detection unit 53, a sensor group 54, communication unit 55, and vibration unit 56.

[0038] Here, the processor 51 controls each part of the device based on the programs and data stored in the memory 52.

[0039] The memory 52 is configured by RAM, ROM, etc., and stores the programs and data executed by the processor 51.

[0040] The operation detection unit 53 detects and outputs, for example, an operation of the pointing device 50.

[0041] The sensor group 54 is configured by, for example, an inclination sensor, and detects and outputs the angle of the pointing device 50.

[0042] The communication unit 55 is connected to the information processing device 10 wirelessly or via a wired connection, and receives, for example, information for controlling the vibration unit 56 from the information processing device 10, and transmits information detected by the operation detection unit 53 and the sensor group 54 to the information processing device 10.

[0043] The vibration unit 56 is configured by, for example, a vibration motor, and generates vibrations under the control of the processor 51 to vibrate the pointing device 50 itself.

[0044] (B) Description of Operation of Embodiments of the Present Disclosure Next, the operation of the embodiment of the present disclosure will be described. Below, an overview of the operation of the embodiment of the present disclosure will be described, and then the details of the operation will be described with reference to a flowchart.

[0045] 6 to 8 are diagrams for explaining an overview of the operation of the present disclosure. FIG. 6 is a diagram illustrating a situation in which an underwater environment is presented as a VR space image, and is assumed by a creator or photographer of the VR space image (hereinafter referred to as "creator, etc."). In the example of FIG. 6, an underwater environment (details are omitted for simplicity of the drawing) is presented to a user 90 as a VR space image. Also, in the example of FIG. 6, a fin 100 as a part of the body of the user 90's avatar (virtual user) is presented at a position that coincides with the user 90's feet. Also, in the example of FIG. 6, a shark 110 is attacking the fin 100. That is, the creator, etc., creates or photographs (hereinafter referred to as "creator, etc.") the VR space image, assuming that the user 90 will be viewing the image, for example, in a sitting position, and that the user 90's feet are positioned approximately 45 degrees below the front direction of the virtual camera. Note that the VR space image is an example of an image representing a virtual space. Furthermore, the fin 100 as a part of the body of the avatar (virtual user) of the user 90 is an example of a body expression image.

[0046] FIG. 7 shows the situation when a user 90 actually watches the VR space image. In the example of FIG. 7, the user 90 watches the VR space image not in a sitting position but in a supine position lying on a sofa 92 or the like. In such a case, a conventional information processing device that presents a VR space image does not take into consideration the posture of the user 90, and therefore, as shown in FIG. 7, the fin 100 is displayed at a position away from the feet of the user 90. In this case, it is difficult for the user 90 to recognize the fin 100 as a part of his or her body, and therefore, even if a shark 110 attacks such a fin 100, it is difficult for the user 90 to perceive it as an attack on him or her.

[0047] In the past, when an enemy, monster, friend, or other person in the VR space tried to interfere with or approach the body of the first-person perspective protagonist, if the position of a part of the protagonist's body displayed in the VR space image differed from the position of the real user 90, the sense of immersion was significantly impaired, which was a problem.

[0048] Therefore, in an embodiment of the present disclosure, when playback of a VR space image starts or during playback of the VR space image, the user 90 operates the pointing device 50 to correct the pitch angle θp as shown in FIG. 8, and performs the correction so that an image of a body part of the user's avatar or an image of another person attempting to interfere with the body part is presented in a position intended by the creator or the like. At this time, in an embodiment of the present disclosure, an operation panel OP as shown in FIG. 9A is displayed on the display 33. The user operates this operation panel OP to perform the correction so that an image of a body part of the avatar or an image of another person attempting to interfere with the body part is presented. The operation panel is an example of an operation image of the present disclosure.

[0049] When correcting the pitch angle while a VR space image is being displayed on the display 33, there are times when the user wants to make a large correction to the pitch angle and times when the user wants to make a small correction to the pitch angle. In such cases, the user needs to use the pointing device 50 to achieve both large and small corrections to the pitch angle.

[0050] For example, if the scene in the virtual space represented by the VR space image changes and the user (protagonist) changes from a standing position to a supine position, a large correction of the pitch angle (for example, a correction of 30 or 60 degrees) is required. On the other hand, if the user (protagonist) remains in a sitting position and only changes the angle of forward or backward lean, a small correction of the pitch angle (for example, correction in 0.5 degree increments) is required.

[0051] In this case, if the operating device has a mechanical mechanism such as a dial or lever, the user can easily achieve both large and small pitch angle adjustments by operating the dial or lever. On the other hand, with a pointing device 50 in which the user inputs operations by holding the device in their hand and changing the orientation of the device, it is difficult for the user to control small angle differences. To solve this problem, it is possible to convert large movements of the pointing device 50 into instructions for small angle changes, but doing so makes it difficult to issue instructions for large angle changes. In other words, it is not easy to input angle differences that correspond to a large dynamic range.

[0052] Therefore, in this embodiment, an operation panel OP as shown in FIG. 9A is displayed on the display 33, and the pitch angle is corrected according to information input to the operation panel OP. As shown in FIG. 9A, the operation panel OP is an operation image for receiving operations indicating the degree of correction of the angle of the VR space image including the avatar image. The operation panel OP includes one or more operation buttons B1, B2 indicating a predetermined angle correction, and a slider S indicating a continuous angle correction. The user corrects the pitch angle θp by operating the operation panel OP via the pointing device 50.

[0053] The operation buttons B1 and B2 shown in Fig. 9A, which represent adjustments to predetermined angles, are primarily suited to fine adjustments of the angle. On the other hand, the slider S is suited to quick adjustments of large angles. The detailed functions of the operation panel OP will be described below.

[0054] (Operation buttons B1, B2) The operation panel OP in FIG. 9A has six operation buttons: +10 degrees, +5 degrees, +1 degree, -1 degree, -5 degrees, and -10 degrees. Note that the operation panel OP in FIG. 9A is an example, and operation buttons B1 and B2, for example, may be arranged in 0.5-degree increments. These operation buttons can be clicked continuously, and if the user presses "+1 degree" three times in a row, the pitch angle changes by +3 degrees. This corrects the angle of the VR space image, allowing the user to see a view as if they were lifting their chin up, for example. Furthermore, the pitch angle changes discontinuously the moment operation buttons B1 and B2 are pressed. This has the effect of making it less likely for the user to experience so-called VR sickness.

[0055] When arranging the operation buttons B1 and B2 within the operation panel OP, it is preferable to arrange the minimum plus (the "+1 degree" operation button in the above example) and the minimum minus (the "-1 degree" operation button in the above example) in close proximity to each other. For example, if the angle adjustment is excessive after pressing the "+1 degree" operation button several times in rapid succession, it becomes possible to press the minimum "-1 degree" operation button to adjust the angle back.

[0056] (Slider S) As shown in Fig. 9A, the operation panel OP has a slider S. The slider S can be operated by two types of operation, a slide operation and a point operation, and is configured so that the user can select either operation according to their preference.

[0057] (Slide operation) The slide operation is, for example, an operation of sliding a point on the slider S shown in FIG. 9A up and down. As shown in FIG. 9B, the amount of pitch angle correction is displayed on the slider S by a horizontal line L corresponding to the point. The user operates the pointing device 50 to specify a location inside the vertically long slider S with the point. As a result, a horizontal line L is displayed at the position of the point. Then, when the user presses a trigger button (not shown) provided on the pointing device 50, this horizontal line L is in a "grabbed" state while the trigger button is kept pressed. Then, when the user moves the pointing device 50 up and down, this horizontal line L moves up and down smoothly, and the pitch angle changes continuously, and the pitch angle of the VR space image is corrected according to the change in pitch angle.

[0058] By performing a slide operation, the user can quickly make large adjustments to the pitch angle. Furthermore, the user can quickly determine the optimal pitch angle while checking in real time whether the avatar image representing the main character in the VR space image overlaps with the user's body position in the real world.

[0059] However, if the VR space image changes too suddenly, the user may be prone to VR sickness. Therefore, in order to reduce the likelihood of the user experiencing VR sickness, the change in the angle of the VR space image may be delayed slightly relative to the movement of the horizontal line L of the slider S, rather than precisely following the movement of the horizontal line L of the slider S.

[0060] (Point operation) The point operation is, for example, an operation of correcting the angle by specifying a point on the slider S shown in FIG. 9A.

[0061] Specifically, first, the user operates the pointing device 50 to align the point with the inner area on the slider S. Then, the user presses and immediately releases a trigger button (not shown) provided on the pointing device 50. As a result, the angle of the VR space image is immediately corrected to the pitch angle according to the position corresponding to the point.

[0062] This is the same as when many operation buttons are prepared. When the user performs a pointing operation, the angle of the VR space image changes discontinuously, which has the effect of making the user less susceptible to VR sickness compared to a sliding operation. The user can modify the pitch angle of the VR space image by arbitrarily combining the sliding and pointing operations described above.

[0063] (Display window D) As shown in FIG. 9A, the operation panel OP has a display window D that displays the amount of pitch angle correction numerically. For example, when the user performs the operation described above, the amount of pitch angle correction by that operation is displayed in the display window D. The amount of pitch angle correction is the angle difference between the VR space image before the pitch angle is corrected and the VR space image after the pitch angle is corrected. The display window D is an example of an area that displays angle information represented by operation information.

[0064] Generally, there is little need for the user to be aware of the amount of pitch angle correction. However, as described above, multiple means for correcting the pitch angle are available (for example, operation buttons B1, B2 and slider S), and the user may be confused by the operations and actions. Therefore, the display window D of the operation panel OP displays the amount of pitch angle correction numerically. This allows the user to easily understand the operation of correcting the pitch angle using the operation panel OP. Furthermore, as the user becomes accustomed to the operation, they will gradually be able to understand, in numerical terms, approximately how many degrees of correction is required.

[0065] (Clear button C) As shown in FIG. 9A, the operation panel OP has a clear button C for returning the VR space image to its initial state (for example, the VR space image before the pitch angle was corrected). The user can return the angle of the VR space image, etc., to its initial state by performing an operation such as clicking the clear button C. For example, if the user is not familiar with operating the operation panel OP, pressing the clear button C allows the user to redo the operation. Also, depending on the type of content displayed in the VR space image, it may be preferable to return the pitch angle to the angle intended by the content creator. In such a case, the user can immediately return the pitch angle to its original state by pressing the clear button C. The clear button C is an example of an operation button that returns the display angle of a VR space image, the angle of which has been corrected, to the angle of the VR space image before the angle was corrected.

[0066] FIG. 10 shows an example of an operation panel OP displayed in a virtual space. As shown in FIG. 10, when a shark is displayed and the user repeatedly adjusts the pitch angle using the slider S, the shark's position changes continuously, increasing the likelihood that the user will experience so-called VR sickness. In contrast, when the pitch angle is adjusted using the operation buttons B1 and B2 (+10 degrees, +5 degrees, +1 degree, -1 degree, -5 degrees, and -10 degrees) in the operation panel OP, the shark's position changes suddenly rather than continuously, reducing the likelihood that the user will experience VR sickness. In other words, the more jerky the VR space image changes, the lower the likelihood of experiencing VR sickness.

[0067] For this reason, for example, the user may make a large correction to the pitch angle using the +10 degree or -10 degree operation button of operation buttons B1 and B2, and then make a fine correction to the pitch angle using slider S. Alternatively, the user may make a large and quick correction to the pitch angle using slider S, and then make a fine correction to the pitch angle using the +1 degree or -1 degree operation button of operation buttons B1 and B2. This allows the user to feel immersed without experiencing VR sickness.

[0068] (Displaying or hiding the operation panel OP) The operation panel OP is not originally intended to be displayed in the VR space image at all times, and is preferably displayed only when it is necessary to correct the pitch angle. For this reason, in this embodiment, for example, when a predetermined operation is input to the pointing device 50 by the user, the operation panel OP is displayed in the VR space image. For example, when a trigger button (not shown) of the pointing device 50 is pressed, the operation panel OP is displayed in the VR space image. Note that any trigger for displaying the operation panel OP may be used. For example, when the user performs a specific operation using multiple buttons of the pointing device 50, the operation panel OP may be displayed in the VR space image.

[0069] In this embodiment, for example, when a predetermined operation is input to the pointing device 50 by the user, the operation panel OP is controlled to be hidden. For example, when an area outside the frame of the operation panel OP is pressed, the operation panel OP is hidden. In order to hide the operation panel OP, a delete button such as an x ​​mark may be placed within the operation panel OP, and the operation panel OP may be hidden when the x mark is pressed.

[0070] Also, for example, there may be cases where the user accidentally clicks a little outside the operation panel OP when trying to specify a certain point on the slider S. For this reason, for example, a margin may be set as a predetermined area around the operation panel OP, and control may be performed so that the operation panel OP is hidden when an area outside the margin is clicked.

[0071] As described above, according to the information processing system of this embodiment, when the pitch angle is corrected using the pointing device 50 while a VR space image is being played back, an operation panel OP equipped with operation buttons B1, B2 and a slider S is displayed. By operating this operation panel OP, the user can correct large pitch angles and small pitch angles, making it possible to correct the pitch angle comfortably and quickly. In addition, the pitch angle can be corrected easily and accurately using the pointing device 50.

[0072] Furthermore, as described above, by correcting the pitch angle and aligning a part of the avatar's body with a part of the user's body, the sense of body ownership over the avatar can be enhanced, thereby increasing the sense of immersion.

[0073] Furthermore, this embodiment is characterized in that, of the three angles (θr, θy, θp) detected from the movement of the head of the user 90 and used to correct the line of sight, particular attention is paid to the pitch angle θp. That is, the posture of the avatar as the protagonist from a first-person perspective may change in various ways as the story progresses, but when a human's eyes capture their own body within the field of view, tilting their head (movement along the roll axis) or looking back and forth (movement along the yaw axis) is a relatively rare event. In many cases, there will be no problem even if we assume that the protagonist is not tilting their head and is facing almost directly ahead without shifting left or right toward the object of interest.

[0074] In most cases, you can expect your own body to be located near the center of your field of vision, within shoulder width of your own. The way your body appears in your field of vision changes significantly depending on whether you raise or lower your chin (movement along the pitch axis). The shape of your own body in your field of vision changes depending on various human movements, such as standing, sitting, bending, and lying down, but these changes can be roughly accommodated by adjusting the pitch angle.

[0075] Therefore, in the present disclosure, in addition to the HMD movement detection unit 14 that detects gaze movement based on the roll angle θr, yaw angle θy, and pitch angle θp from a sensor that senses the movement of the user's head, a pitch angle correction amount setting unit 11 is provided to enable forced movement (pitch up, pitch down) based on the intention of the user 90, particularly with regard to the pitch angle that controls changes in the gaze in the up and down direction, thereby reducing the discrepancy between the physical expression of the avatar as the protagonist from a first-person perspective and the user's actual posture.

[0076] Because the human brain has a great ability to make corrections, simply correcting the rough alignment of the limb positions is expected to have a significant psychological effect that can maintain the sense of immersion. For this reason, this embodiment uses the pointing device 50 to roughly align the body of the avatar, who is the main character from a first-person perspective, with the body posture of the real user 90, and the user 90 can operate the pointing device 50 according to their own intentions, thereby providing a virtual space with a more immersive feel.

[0077] Fig. 11 is a flowchart for explaining an example of processing executed in an embodiment of the present disclosure. Below, detailed operations of the present disclosure will be explained with reference to the flowchart shown in Fig. 11. When the processing of the flowchart shown in Fig. 11 starts, the following steps are executed.

[0078] In step S100, the HMD motion detection unit 14 of the information processing device 10 receives detection information that is the output of the acceleration sensor 34 of the HMD 30. The HMD motion detection unit 14 then detects the initial position of the HMD 30 by referring to the detection information. That is, for example, an initial roll angle θr0, an initial yaw angle θy0, and an initial pitch angle θp0 are detected as the initial position of the HMD 30 in the three axial directions. For example, when θr0=0, θy0=0, and θp0=0, the roll angle θr, yaw angle θy, and pitch angle θp that serve as the drawing reference are set to θr=0, θy=0, and θp=0, respectively. Note that instead of using the output of the acceleration sensor 34, the LEDs 35 provided in the HMD 30 may be turned on and used as markers to detect the initial position by image recognition.

[0079] In step S102, the pitch angle correction amount setting unit 11 assigns "0" as the initial value of the pitch angle correction amount θpc.

[0080] In step S104, the avatar generation unit 15 executes a process of generating an avatar image of the user 90 based on the roll angle θr, yaw angle θy, and pitch angle θp as the initial position detected in step S100. For example, in the example of Fig. 7, the avatar generation unit 15 generates an image of the fin 100 to be worn on a part of the body of the avatar of the user 90 as the avatar image.

[0081] In step S106, the VR space image generation unit 13 executes a process of generating a VR space image based on the roll angle θr, yaw angle θy, and pitch angle θp as the initial position detected in step S100. For example, in the example of Fig. 7, an image showing an underwater environment is generated, and the avatar image generated in step S104 is superimposed on the image to generate a VR space image.

[0082] In step S108, the VR space image generation unit 13 outputs the VR space image generated in step S106 to the HMD 30. As a result, in the HMD 30, for example, the communication unit 36 ​​receives the VR space image and supplies it to the processor 31. The processor 31 displays the VR space image supplied from the communication unit 36 ​​on the display 33.

[0083] In step S110, the HMD motion detection unit 14 detects the position of the HMD 30 by referring to the detection information supplied from the acceleration sensor 34 of the HMD 30. More specifically, the HMD motion detection unit 14 detects the movements in the roll axis direction, yaw axis direction, and pitch axis direction shown in FIG.

[0084] In step S112, the pitch angle correction amount setting unit 11 refers to the operation information received by the receiving unit 12 and determines whether or not the user has performed an operation on the pointing device 50 to request the display of the operation panel OP. If the pitch angle correction amount setting unit 11 determines that an operation to request the display of the operation panel OP has been performed (step S112: Y), the process proceeds to step S114, and otherwise (step S112: N), the process proceeds to step S126. For example, if a predetermined operation button (not shown) provided on the pointing device 50 has been pressed, the process determines Y and proceeds to step S114.

[0085] In step S114, the pitch angle correction amount setting unit 11 controls the display 33 to display the operation panel OP.

[0086] In step S116, the pitch angle correction amount setting unit 11 refers to the operation information received by the receiving unit 12 and determines whether or not an operation has been performed on the operation panel OP via the pointing device 50. If the pitch angle correction amount setting unit 11 determines that an operation has been performed on the operation panel OP (step S116: Y), the process proceeds to step S122, and otherwise (step S116: N), the process proceeds to step S118.

[0087] In step S118, the pitch angle correction amount setting unit 11 refers to the operation information received by the receiving unit 12 and determines whether the operation information is an operation on an area different from the operation panel OP (for example, an operation such as clicking outside the frame of the operation panel OP). If the pitch angle correction amount setting unit 11 determines that the operation information received by the receiving unit 12 is an operation on an area different from the operation panel OP (step S118: Y), the process proceeds to step S120; otherwise (step S118: N), the process returns to step S114.

[0088] In step S120, the pitch angle correction amount setting unit 11 controls the display 33 so that the operation panel OP is not displayed.

[0089] In step S122, the pitch angle correction amount setting unit 11 acquires operation information that the user has performed on the operation panel OP via the pointing device 50. For example, when the user has performed an operation (e.g., pitch angle correction) as shown in Fig. 8 on the operation panel OP via the pointing device 50, the pitch angle correction amount setting unit 11 acquires operation information that represents the operation.

[0090] In step S123, the pitch angle correction amount setting unit 11 executes a process of updating the pitch angle correction amount θpc in accordance with the operation information for the pointing device 50 acquired in step S122. For example, in the example of Fig. 8, the user inputs "-35 degrees" by performing a slide operation or a point operation on the operation panel OP, and therefore the pitch angle correction amount θpc is set to -35.

[0091] In step S124, the VR space image generation unit 13 executes a process of correcting the pitch angle according to the pitch angle correction amount updated in step S123. For example, in the example of Fig. 8 described above, the pitch angle correction amount θpc = -35, so the VR space image generation unit 13 executes a process of correcting the pitch angle θp by -35 degrees (a process of setting θp ← θp + θpc).

[0092] In step S126, the avatar generation unit 15 executes a process of generating an avatar image of the user 90 based on the pitch angle corrected in step S124. For example, in the example of Fig. 8 described above, the avatar generation unit 15 generates an image of the fin 100 to be attached to a part of the body of the avatar of the user 90 based on the pitch angle θp corrected in step S124.

[0093] In step S128, the VR space image generation unit 13 executes a process of generating a VR space image. For example, in the example of Fig. 8 described above, an image showing the underwater environment is generated based on the pitch angle θp corrected in step S124, and an image of the shark 110 is also generated. Then, the avatar image generated in step S126 is superimposed on these images to generate a VR space image.

[0094] In step S130, the VR space image generation unit 13 outputs the VR space image generated in step S128 to the HMD 30. As a result, in the HMD 30, for example, the communication unit 36 ​​receives the VR space image and supplies it to the processor 31. The processor 31 displays the VR space image supplied from the communication unit 36 ​​on the display 33. As a result, as shown in FIG. 8, a VR space image in which the positions of the avatar image of the fin 100 and the shark 110 have been appropriately corrected is displayed on the display 33 of the HMD 30. As described above, the human brain is known to transfer bodily sensations between the protagonist in the VR space and the user, resulting in a sense of body ownership. At that time, the closer the visual representation of the protagonist's body provided in the virtual space is to the position where the user's body should be, the easier it is to feel that sensation. Therefore, by correcting the pitch angle θp, for example, in the example of FIG. 8, the sense of body ownership over the fin 100 can be enhanced. This allows the user to strongly recognize the attack of the shark 110 as an attack on the user, thereby enhancing the sense of immersion in the VR space.

[0095] In step S132, the VR space image generation unit 13 determines whether or not to terminate the processing, and if it determines to terminate the processing (step S132: Y), it terminates the processing, otherwise (step S132: N), it returns to step S110 and repeats the same processing as in the above case.

[0096] According to the above processing, for example, if the position of the fin 100, which is part of the avatar image, does not match the position of the foot of the user 90, as shown in FIG. 7, the pitch angle θp can be corrected by operating the pointing device 50, and by matching these as shown in FIG. 8, the sense of immersion in the VR space can be enhanced.

[0097] As described above, the information processing device of the first embodiment receives detection information from a sensor that detects the movement of a user's head, and generates a VR space image including an avatar image showing at least a part of the user's body in accordance with the detection information. When a VR space image including the generated avatar image is displayed on a display, the information processing device displays, on the display, an operation image for receiving an operation indicating a degree of correction of the angle of the avatar image, the operation image including one or more operation buttons indicating a predetermined angle correction and a slider indicating continuous angle correction. Then, when the VR space image and the operation image are displayed on the display, the information processing device receives user operation information. If the received operation information is an operation on the operation image, the information processing device corrects the display angle of the VR space image including the avatar image when presenting the VR space image on the display, based on the angle indicated by the operation information. Then, the information processing device displays, on the display, the VR space image including the avatar image with the corrected angle. This allows a user to more easily experience a sense of immersion when watching content while wearing a head-up display. Specifically, multiple different correction means for correcting the display position of the user's body within the virtual space are displayed within the virtual space, allowing the user to smoothly correct the position of the avatar image within the VR space image.

[0098] Second Embodiment Next, a second embodiment will be described. The second embodiment differs from the first embodiment in that the pitch angle of a part of the body of the avatar captured in the VR space image is corrected based on information previously added to each time of the video content. Note that the configuration of the second embodiment is the same as that of the first embodiment, and therefore a detailed description thereof will be omitted.

[0099] Fig. 12 is a diagram for explaining an outline of the operation of the second embodiment. As shown in Fig. 12, a VR space image at each time is displayed on the display 33 by playing back a predetermined video content.

[0100] The video content shown in FIG. 12 is video content in which an avatar, a virtual user, strolls around town, enters a massage parlor, and receives a massage.

[0101] Specifically, when the avatar is strolling around town, scene S1 in FIG. 12 is displayed on display 33, and when the avatar enters a massage parlor, scene S2 in FIG. 12 is displayed on display 33. When the avatar enters the massage parlor, scene S3 in FIG. 12 is displayed on display 33. When the avatar is about to receive a massage, scenes S4 and S5 in FIG. 12 are displayed on display 33. In scene S5, the avatar lies down on a bed, and so feet L, which are part of the avatar's body, are displayed on display 33.

[0102] At this time, it is assumed that the posture of the actual user 90 wearing the HMD 30 is generally one of posture P1 (sitting position), posture P2 (standing position), and posture P3 (supine position) shown in FIG.

[0103] For example, if scene S5 of Figure 12 is displayed on display 33 in a situation where the posture of real user 90 is either posture P1 (sitting) or posture P2 (standing), it is expected that real user 90 will feel a strong sense of discomfort, and the sense of immersion may be lost.

[0104] Therefore, in the second embodiment, avatar posture information is added in advance to each time point of the video content, and the angle of a part of the avatar's body as seen by the real user 90 is corrected based on the posture information.

[0105] FIG. 14 is a diagram illustrating how posture information is added to each time point in the video content. The horizontal axis in FIG. 14 represents the time when the video content is played back. Specifically, at time t1 in FIG. 14, scene S1 of FIG. 12 is displayed on display 33; at time t2 in FIG. 14, scene S2 of FIG. 12 is displayed on display 33; at time t3 in FIG. 14, scene S3 of FIG. 12 is displayed on display 33; at time t4 in FIG. 14, scene S4 of FIG. 12 is displayed on display 33; and at time t5 in FIG. 14, scene S5 of FIG. 12 is displayed on display 33. In such a case, as shown in FIG. 14, avatar posture information A1 to A5 is added in advance to scenes S1 to S5 of the video content at each time point. For example, the posture information A1 to A5 is added in advance to the video content by the creator of the video content, etc.

[0106] The pitch angle correction amount setting unit 11 of the second embodiment acquires posture information that is added in advance to each time point of the video content, and corrects the angle of the foot L as seen by the actual user in accordance with the posture information.

[0107] For example, as shown in FIG. 15, when foot L1 is displayed on the display, the pitch angle correction amount setting unit 11 of the second embodiment acquires posture information A5 that is added in advance to the video content at time t5, and corrects the pitch angle of the foot as seen by the real user based on the posture information A5. Specifically, the pitch angle correction amount setting unit 11 of the second embodiment corrects the pitch angle as shown in FIG. 15 so that the position of foot L1 changes to the position of foot L2 (direction D in FIG. 15). Alternatively, the pitch angle correction amount setting unit 11 of the second embodiment corrects the pitch angle so that foot L1 in FIG. 15 becomes invisible. For example, foot L1 in scene S5 of FIG. 15 becomes foot L2 in scene S5C. This reduces the sense of discomfort felt by the real user.

[0108] Specifically, in a situation where the posture of the real user 90 is either posture P1 (sitting) or posture P2 (standing), the sense of discomfort felt by the user 90 is reduced when a virtual foot L2 is displayed at the bottom of the display 33 as shown in Fig. 15 rather than when a virtual foot L1 corresponding to the user's own foot is displayed in the center of the display 33. Furthermore, the sense of discomfort is further reduced by not displaying the virtual foot L1.

[0109] The HMD movement detection unit 14 of the second embodiment receives detection information representing the movement of the user's head based on information output from a plurality of acceleration sensors 34 included in the HMD 30, similar to the first embodiment.

[0110] The VR space image generation unit 13 of the second embodiment generates a VR space image based on the detection information received by the HMD motion detection unit 14 and an image generated by playing predetermined video content. Then, the VR space image generation unit 13 of the second embodiment displays the generated VR space image on the display 33.

[0111] When an avatar image showing at least a part of the avatar's body is displayed on the display 33, the pitch angle correction amount setting unit 11 of the second embodiment corrects the pitch angle of the avatar image as seen by the user based on the posture information of the avatar's body in the VR space image that is pre-added to each time point of the video content.

[0112] Fig. 16 is a flowchart for explaining an example of processing executed in the second embodiment. Below, detailed operations of the present disclosure will be explained with reference to the flowchart shown in Fig. 16. Note that operations similar to those in the first embodiment are given the same reference numerals and detailed explanations will be omitted. When playback of a predetermined video content starts, the processing of the flowchart shown in Fig. 16 starts, and the following steps are executed.

[0113] The processes in steps S100 to S108 are executed in the same manner as in the first embodiment.

[0114] In step S210, the HMD movement detection unit 14 of the second embodiment receives detection information representing the movement of the user's head based on information output from the multiple acceleration sensors 34 of the HMD 30, as in the first embodiment.

[0115] In step S222, when an avatar image showing at least a part of the avatar's body is displayed on the display 33, the pitch angle correction amount setting unit 11 acquires posture information of the avatar's body in the VR space image that is pre-added to each time of the video content.

[0116] In step S223, pitch angle correction amount setting unit 11 updates the pitch angle correction amount θpc of the avatar image seen by the user, based on the avatar body posture information acquired in step S222.

[0117] In step S224, the VR space image generation unit 13 executes a process of correcting the pitch angle in accordance with the pitch angle correction amount updated in step S223.

[0118] The processes in steps S126 to S132 are executed in the same manner as in the first embodiment.

[0119] As described above, according to the information processing device of the second embodiment, a VR space image is generated by displaying predetermined video content on a display, and when at least a part of an avatar's body is displayed on the display, the angle of the avatar representation image as seen by the user is corrected based on posture information of the avatar's body in the VR space image that is added in advance to each time of the video content. This makes it possible to prevent a decrease in the sense of immersion that the user experiences when the video content is displayed in the VR space image.

[0120] As described above, in the information processing device of the second embodiment, the relative adjustment of the angle due to scene changes proceeds smoothly due to the posture information previously added to the video content at each time point. However, because the actual body posture of the user watching the video is unknown, absolute adjustment of the angle based on the user's will, as solved by the first embodiment, may not always be possible. To address such cases, the second embodiment can be combined with the first embodiment to achieve a solution. The usefulness of the second embodiment lies in its ability to largely automate the relative adjustment of the angle due to scene changes, whereas the first embodiment required the user to frequently adjust the angle. Therefore, for example, instead of combining the second embodiment with the first embodiment, absolute adjustment of the angle based on the user's will can also be achieved by combining the second embodiment with the invention disclosed in Japanese Patent No. 6664778 or a similar method.

[0121] Third Embodiment Next, a third embodiment will be described. The third embodiment differs from the first and second embodiments in that the pitch angle of a part of the avatar's body is corrected based on the part of the avatar's body captured in the VR space image and the position or posture of a virtual object captured in the VR space image. Note that the configuration of the third embodiment is similar to that of the first embodiment, and therefore a detailed description thereof will be omitted.

[0122] In the third embodiment, when at least a part of the avatar's body is displayed on the display 33, the angle of the part of the avatar's body as seen by the user 90 is corrected based on at least one of the part of the avatar's body and the virtual object displayed in the VR space image.

[0123] In the second embodiment, as shown in FIG. 14, posture information is added to each time of the video content, but in the third embodiment, this posture information is estimated sequentially.

[0124] Specifically, when an avatar image showing at least a part of the avatar's body is displayed on the display 33, the pitch angle correction amount setting unit 11 of the third embodiment corrects the angle of the avatar image as seen by the user based on at least one of the avatar image displayed in the VR space image and the virtual object displayed in the VR space image.

[0125] More specifically, the pitch angle correction amount setting unit 11 of the third embodiment uses a known image processing technique or a known artificial intelligence technique to process the position of a part of the avatar's body or a virtual object that appears in an image of the video content at each time, thereby estimating posture information of a part of the avatar's body at that time.

[0126] For example, the pitch angle correction amount setting unit 11 of the third embodiment estimates posture information of a part of the avatar's body based on the positions of buildings in a city, people in the city, store clerks, and the like, which are examples of virtual objects, in scenes S1 to S4 of Fig. 12. Furthermore, for example, the pitch angle correction amount setting unit 11 of the third embodiment estimates posture information of a part of the avatar's body based on the position of a store clerk, which is an example of a virtual object, and the position of a foot L, which is a part of the avatar's body, in scene S5 of Fig. 12. Then, in the third embodiment, the angle of the part of the avatar's body as seen from the user 90 is corrected based on the estimated posture information.

[0127] In this case, for example, the pitch angle correction amount setting unit 11 of the third embodiment corrects the angle of the foot L1, which is a part of the avatar's body, so that the foot L2 is displayed, as shown in scene S5C of Fig. 15, in the same way as in the second embodiment. This reduces the sense of discomfort felt by the user 90.

[0128] The processing executed in the third embodiment is substantially the same as the processing executed in the second embodiment shown in Fig. 16. The pitch angle correction amount setting unit 11 in the second embodiment acquires posture information added to video content in step S222 in Fig. 16. In contrast, the pitch angle correction amount setting unit 11 in the third embodiment acquires avatar posture information based on at least one of an avatar image displayed in a VR space image and a virtual object displayed in the VR space image in step S222 in Fig. 16.

[0129] As described above, according to the information processing device of the third embodiment, a VR space image, which is an example of a virtual space, is generated by displaying predetermined video content on a display, and when at least a part of an avatar's body is displayed on the display, the angle of at least a part of the avatar's body as seen from the user is corrected based on at least one of at least a part of the avatar's body displayed in the VR space image and a virtual object displayed in the VR space image. This makes it possible to prevent a decrease in the sense of immersion experienced by the user when the video content is displayed in the VR space image.

[0130] As described above, in the information processing device of the third embodiment, the avatar's posture information is sequentially estimated, so that relative adjustment of the angle due to scene changes, avatar movement, and the like proceeds smoothly. However, because the actual body posture of the user watching is unknown, absolute adjustment of the angle based on the user's will, as solved by the first embodiment, may not always be possible. To solve such a problem, the third embodiment can be combined with the first embodiment. The usefulness of the third embodiment lies in its ability to largely automate relative adjustment of the angle due to scene changes, avatar movement, and the like, whereas the first embodiment required the user to frequently adjust the angle. Therefore, for example, instead of combining the third embodiment with the first embodiment, absolute adjustment of the angle based on the user's will can also be achieved by combining the third embodiment with the invention disclosed in Japanese Patent No. 6664778 or a similar method.

[0131] <Description of Modified Embodiments> The above-described embodiments are merely examples, and it goes without saying that the present disclosure is not limited to the above-described cases. For example, in the above-described embodiments, the case where only the pitch angle is corrected has been described as an example, but the yaw angle and roll angle may also be corrected. FIG. 17 shows an example of an operation panel OP intended to further correct the yaw angle and roll angle. That is, in the example of FIG. 17, the operation panel OP further includes an operation button Y for correcting the yaw angle and an operation button R for correcting the roll angle.

[0132] It is considered that situations where the yaw angle needs to be corrected (for example, when the user wants to define a position where the user turns their face left or right as a new front) and where the roll angle needs to be corrected (for example, when the user wants to define a position where the user tilts their head as a new front) occur rarely. Therefore, it is also assumed that the correction of the yaw angle and roll angle does not require as delicate a correction means as the correction of the pitch angle.

[0133] Therefore, for example, operation buttons corresponding to the minimum pitch angle (e.g., operation buttons corresponding to "+1 degree" and "-1 degree") may be provided for correcting the yaw angle and roll angle. In the example of Fig. 17, an operation button Y for the yaw angle and an operation button R for the roll angle for correcting the minimum angle are arranged at the top of the operation panel OP.

[0134] Furthermore, if a clear button for resetting the VR space image to its initial state (for example, the VR space image before the roll angle or the roll angle was corrected) were provided for each yaw angle and roll angle, the arrangement of the operation buttons could become extremely complicated. For this reason, the operation panel OP may be configured to have only one clear button for resetting all angles of the pitch angle, yaw angle, and roll angle to their initial states, and pressing this operation button resets all corrections of the pitch angle, yaw angle, and roll angle to zero. In this case, for example, pressing the clear button will reset the pitch angle that has been appropriately corrected to its original state, but the pitch angle can then be appropriately re-corrected using the methods described above.

[0135] According to the above, the yaw angle and roll angle can also be corrected while focusing on correcting the pitch angle.

[0136] In the above embodiment, a VR space image is depicted using computer graphics. However, the present disclosure is not limited to computer graphics. For example, a live-action image captured by a camera capable of capturing a full-dome image may be used. That is, the present disclosure may be applied to image-based rendering or image-based modeling. When a live-action image is used, an avatar is included in the live-action image. In this case, the avatar generation unit 15 may be omitted from the configuration shown in FIG. 2. Of course, a 180-degree image may be used instead of a full-dome (360-degree) image.

[0137] Furthermore, in the above embodiment, the processing shown in FIG. 11 and the like is executed by the information processing device 10, but the configuration of the information processing device 10 may be incorporated into the HMD 30, and the processing shown in FIG. 11 and the like may be executed by the HMD 30.

[0138] 1 includes a network 70 and a server, but the configuration may not include the network 70. Information stored in the server may be stored in the information processing device 10 or the HMD 30.

[0139] In the above embodiments, the processes executed by the CPU after reading the software (program) may be executed by various processors other than the CPU. Examples of such processors include programmable logic devices (PLDs) such as field-programmable gate arrays (FPGAs), whose circuit configuration can be changed after fabrication, and dedicated electrical circuits such as application-specific integrated circuits (ASICs), which are processors with circuit configurations specifically designed to execute specific processes. Each process may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0140] In addition, in each of the above embodiments, the program is described as being pre-stored (installed) in storage, but this is not limiting. The program may be provided in a form stored in a non-transitory storage medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. The program may also be downloaded from an external device via a network.

[0141] Furthermore, each process of this embodiment may be implemented by a computer or server equipped with a general-purpose processor and a storage device, and each process may be executed by a program. This program is stored in a storage device, and may be recorded on a recording medium such as a magnetic disk, optical disk, or semiconductor memory, or may be provided via a network. Of course, any other components do not have to be implemented by a single computer or server, and may be distributed across multiple computers connected via a network.

[0142] It should be noted that the present embodiment is not limited to the above-described embodiments, and various modifications and applications are possible within the scope of the gist of each embodiment.

[0143] The following are notes to the present disclosure. (Appendix 1) An information processing device that presents a virtual space on a display worn on a user's head, a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space in accordance with the detection information received by the first receiving means; a display control means for displaying, on the display, an operation image for receiving an operation representing a degree of correction of an angle of the virtual space as seen by the user, when the virtual space generated by the generation means is displayed on the display, the operation image including at least one of one or more operation buttons representing correction of a predetermined angle and a slider representing correction of a continuous angle; a second receiving means for receiving operation information of the user when the virtual space and the operation image are displayed on the display by the display control means; a correction means for correcting an angle of display of the virtual space based on an angle represented by the operation information when the operation information received by the second reception means is an operation on the operation image, the display control means displays, on the display, the virtual space whose angle has been corrected by the correction means. Information processing device. (Appendix 2) the operation image includes an area for displaying angle information represented by the operation information; 10. The information processing device according to claim 1. (Appendix 3) the operation image includes an operation button for returning the angle of the display of the virtual space, the angle of which has been corrected by the correction means, to the angle of the virtual space before the angle was corrected. 10. The information processing device according to claim 1 or 2. (Appendix 4) the display control means controls so as not to display the operation image when the operation information accepted by the second accepting means is an operation on an area different from the operation image. 4. The information processing device according to claim 1. (Appendix 5) the display control means displays the operation image on the display when the second accepting means accepts, from the user, predetermined operation information requesting display of the operation image. An information processing device according to any one of Supplementary notes 1 to 4. (Appendix 6) An information processing device that presents a virtual space on a display worn on a user's head by playing back predetermined video content, a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space based on the detection information received by the first receiving means and an image generated by playing the video content; a display control means for displaying the virtual space generated by the generation means on the display; a correction means for correcting an angle of the body representation image as seen from the user, based on posture information of the body of the virtual user in the virtual space that is added in advance at each time of the video content, when the body representation image showing at least a part of the body of the virtual user is displayed on the display; An information processing device having the above. (Appendix 7) An information processing device that presents a virtual space on a display worn on a user's head by playing back predetermined video content, a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space based on the detection information received by the first receiving means and an image generated by playing the video content; a display control means for displaying the virtual space generated by the generation means on the display; a correction means for correcting an angle of the body representation image as seen from the user based on at least one of the body representation image displayed in the virtual space and a virtual object displayed in the virtual space when the body representation image showing at least a part of the body of the virtual user is displayed on the display; An information processing device having the above. (Appendix 8) A computer-readable program that causes a computer to perform information processing to present a virtual space on a display worn on a user's head, The computer a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space in accordance with the detection information received by the first receiving means; a display control means for displaying, on the display, an operation image for receiving an operation representing a degree of correction of an angle of the virtual space as seen by the user, when the virtual space generated by the generation means is displayed on the display, the operation image including at least one of one or a plurality of operation buttons representing correction of a predetermined angle and a slider representing correction of a continuous angle; a second receiving means for receiving operation information of the user when the virtual space and the operation image are displayed on the display by the display control means; and a program for causing the program to function as a correction means for correcting an angle of display of the virtual space when presenting the virtual space on the display, based on an angle represented by the operation information, when the operation information accepted by the second accepting means is an operation on the operation image, the display control means displays, on the display, the virtual space whose angle has been corrected by the correction means. program. (Appendix 9) An information processing method in which a computer executes information processing to present a virtual space on a display worn on a user's head, comprising: The computer receiving detection information from a sensor that detects a movement of the user's head; generating the virtual space in accordance with the received detection information; When the generated virtual space is displayed on the display, an operation image is displayed on the display for receiving an operation representing a degree of correction of an angle of the virtual space as seen by the user, the operation image including at least one of one or more operation buttons representing correction of a predetermined angle and a slider representing correction of a continuous angle; receiving operation information from the user while the virtual space and the operation image are displayed on the display; when the received operation information is an operation on the operation image, correcting a display angle of the virtual space when presenting the virtual space on the display based on an angle represented by the operation information; displaying the virtual space with the corrected angle on the display; Information processing methods. (Appendix 10) A computer-readable program that causes a computer to perform information processing to present a virtual space on a display worn on a user's head by playing back predetermined video content, The computer a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space based on the detection information received by the first receiving means and an image generated by playing the video content; a display control means for displaying the virtual space generated by the generation means on the display; and a correction means for correcting an angle of the body representation image as seen from the user based on posture information of the body of the virtual user in the virtual space that is added in advance at each time of the video content when the body representation image showing at least a part of the body of the virtual user is displayed on the display; A program to function as a (Appendix 11) An information processing method in which a computer executes information processing to present a virtual space on a display worn on a user's head by playing back predetermined video content, The computer receiving detection information from a sensor that detects a movement of the user's head; generating the virtual space based on the received detection information and an image generated by playing the video content; Displaying the generated virtual space on the display; When a body representation image showing at least a part of the body of the virtual user is displayed on the display, the angle of the body representation image as seen from the user is corrected based on body posture information of the virtual user in the virtual space that is added in advance to each time point of the video content. Information processing methods. (Appendix 12) A computer-readable program that causes a computer to perform information processing to present a virtual space on a display worn on a user's head by playing back predetermined video content, a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space based on the detection information received by the first receiving means and an image generated by playing the video content; a display control means for displaying the virtual space generated by the generation means on the display; and a correction means for correcting an angle of the body representation image as seen from the user based on at least one of the body representation image displayed in the virtual space and a virtual object displayed in the virtual space when the body representation image showing at least a part of the body of the virtual user is displayed on the display; A program to function as a (Appendix 13) An information processing method in which a computer executes information processing to present a virtual space on a display worn on a user's head by playing back predetermined video content, receiving detection information from a sensor that detects a movement of the user's head; generating the virtual space based on the received detection information and an image generated by playing the video content; Displaying the generated virtual space on the display; When a body representation image showing at least a part of the body of the virtual user is displayed on the display, an angle of the body representation image as seen from the user is corrected based on at least one of the body representation image displayed in the virtual space and a virtual object displayed in the virtual space. Information processing methods. [Explanation of symbols]

[0144] 10. Information processing equipment 11 Pitch angle correction amount setting section 12 Reception 13 Spatial image generation unit 14 Detector 15 Avatar Generation Unit 16 Communications Department 30 HMD 31 processors 32 memory 33 Display 34 Acceleration sensor 36 Communications Department 37 Speaker 38 Mike 50 Pointing Device 51 processors 52 memory 53 Operation detection unit 54 sensors 55 Communications Department 56 Vibration unit 70 Network B1, B2 operation buttons C Clear button D Display window OP operation panel R Operation Button

Claims

1. An information processing device that presents a virtual space on a display worn on a user's head, a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space in accordance with the detection information received by the first receiving means; a display control means for displaying, on the display, an operation image for receiving an operation representing a degree of correction of an angle of the virtual space as seen by the user, when the virtual space generated by the generation means is displayed on the display, the operation image including at least one of one or more operation buttons representing correction of a predetermined angle and a slider representing correction of a continuous angle; a second receiving means for receiving operation information from the user when the virtual space and the operation image are displayed on the display by the display control means; a correction means for correcting an angle of display of the virtual space based on an angle represented by the operation information when the operation information received by the second reception means is an operation on the operation image, the display control means displays, on the display, the virtual space whose angle has been corrected by the correction means. Information processing device.

2. the operation image includes an area for displaying angle information represented by the operation information; The information processing device according to claim 1 .

3. the operation image includes an operation button for returning the angle of the display of the virtual space, the angle of which has been corrected by the correction means, to the angle of the virtual space before the angle was corrected.

3. The information processing device according to claim 1.

4. the display control means controls so as not to display the operation image when the operation information accepted by the second accepting means is an operation on an area different from the operation image.

3. The information processing device according to claim 1.

5. the display control means displays the operation image on the display when the second accepting means accepts, from the user, predetermined operation information requesting display of the operation image.

3. The information processing device according to claim 1.

6. An information processing device that presents a virtual space on a display worn on a user's head by playing back predetermined video content, a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space based on the detection information received by the first receiving means and an image generated by playing the video content; a display control means for displaying the virtual space generated by the generation means on the display; a correction means for correcting an angle of the body representation image as seen from the user, based on posture information of the body of the virtual user in the virtual space that is added in advance at each time of the video content, when the body representation image showing at least a part of the body of the virtual user is displayed on the display; An information processing device having the above.

7. An information processing device that presents a virtual space on a display worn on a user's head by playing back predetermined video content, a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space based on the detection information received by the first receiving means and an image generated by playing the video content; a display control means for displaying the virtual space generated by the generation means on the display; a correction means for correcting an angle of the body representation image as seen from the user based on at least one of the body representation image displayed in the virtual space and a virtual object displayed in the virtual space when the body representation image showing at least a part of the body of the virtual user is displayed on the display; An information processing device having the above.

8. A computer-readable program that causes a computer to perform information processing to present a virtual space on a display worn on a user's head, The computer a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space in accordance with the detection information received by the first receiving means; a display control means for displaying, on the display, an operation image for receiving an operation representing a degree of correction of an angle of the virtual space as seen by the user, when the virtual space generated by the generation means is displayed on the display, the operation image including at least one of one or a plurality of operation buttons representing correction of a predetermined angle and a slider representing correction of a continuous angle; a second receiving means for receiving operation information of the user when the virtual space and the operation image are displayed on the display by the display control means; and a program for causing the program to function as a correction means for correcting an angle of display of the virtual space when presenting the virtual space on the display, based on an angle represented by the operation information, when the operation information accepted by the second accepting means is an operation on the operation image, the display control means displays, on the display, the virtual space whose angle has been corrected by the correction means. program.

9. An information processing method in which a computer executes information processing to present a virtual space on a display worn on a user's head, comprising: The computer receiving detection information from a sensor that detects a movement of the user's head; generating the virtual space in accordance with the received detection information; When the generated virtual space is displayed on the display, an operation image is displayed on the display for receiving an operation representing a degree of correction of an angle of the virtual space as seen by the user, the operation image including at least one of one or a plurality of operation buttons representing correction of a predetermined angle and a slider representing correction of a continuous angle; receiving operation information from the user while the virtual space and the operation image are displayed on the display; when the received operation information is an operation on the operation image, correcting a display angle of the virtual space when presenting the virtual space on the display based on an angle represented by the operation information; displaying the virtual space with the corrected angle on the display; Information processing methods.

10. A computer-readable program that causes a computer to perform information processing to present a virtual space on a display worn on a user's head by playing back predetermined video content, The computer a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space based on the detection information received by the first receiving means and an image generated by playing the video content; a display control means for displaying the virtual space generated by the generation means on the display; and a correction means for correcting an angle of the body representation image as seen from the user based on posture information of the body of the virtual user in the virtual space that is added in advance at each time of the video content when the body representation image showing at least a part of the body of the virtual user is displayed on the display; A program to function as a

11. An information processing method in which a computer executes information processing to present a virtual space on a display worn on a user's head by playing back predetermined video content, The computer receiving detection information from a sensor that detects a movement of the user's head; generating the virtual space based on the received detection information and an image generated by playing the video content; Displaying the generated virtual space on the display; When a body representation image showing at least a part of the body of the virtual user is displayed on the display, the angle of the body representation image as seen from the user is corrected based on body posture information of the virtual user in the virtual space that is added in advance to each time point of the video content. Information processing methods.

12. A computer-readable program that causes a computer to perform information processing to present a virtual space on a display worn on a user's head by playing back predetermined video content, a first receiving means for receiving detection information from a sensor that detects a movement of the user's head; a generating means for generating the virtual space based on the detection information received by the first receiving means and an image generated by playing the video content; a display control means for displaying the virtual space generated by the generation means on the display; and a correction means for correcting an angle of the body representation image as seen from the user based on at least one of the body representation image displayed in the virtual space and a virtual object displayed in the virtual space when the body representation image showing at least a part of the body of the virtual user is displayed on the display; A program to function as a

13. An information processing method in which a computer executes information processing to present a virtual space on a display worn on a user's head by playing back predetermined video content, receiving detection information from a sensor that detects a movement of the user's head; generating the virtual space based on the received detection information and an image generated by playing the video content; Displaying the generated virtual space on the display; When a body representation image showing at least a part of the body of the virtual user is displayed on the display, an angle of the body representation image as seen from the user is corrected based on at least one of the body representation image displayed in the virtual space and a virtual object displayed in the virtual space. Information processing methods.

Images