Virtual reality display device, virtual reality display system, virtual reality display program, storage medium on which a virtual reality display program is recorded, and virtual reality display method

JP7912186B2Active Publication Date: 2026-08-28STYLY INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021206293
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-12-20
Publication Date
2026-08-28
Estimated Expiration
2041-12-20

AI Technical Summary

Benefits of technology

【0034】 このような構成の仮想現実表示装置、仮想現実表示システム、仮想現実表示プログラム、仮想現実表示プログラムが記録された記憶媒体、及び仮想現実表示方法は、仮想現実空間内に、自分が実際に存在しているというユーザの感覚を高めることが容易となる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007912186000001
    Figure 0007912186000001
  • Figure 0007912186000002
    Figure 0007912186000002
  • Figure 0007912186000003
    Figure 0007912186000003
Patent Text Reader

Abstract

To provide a virtual reality display device which facilitates enhancement of a user's feeling as if the user actually existed in a virtual reality space, a virtual reality display system, a virtual reality display program, a storage medium with the virtual reality display program recorded thereon, and a virtual reality display method.SOLUTION: A virtual reality display device 3 comprises: a virtual reality control unit 301 which causes a first virtual reality space to be displayed on a headset 2 and varies an image indicative of the first virtual reality space according to motions about three-axes of a roll, a pitch, and a yaw of the head of a user U and motions in three directions of the back / forth, right / left, and up / down of the user U; and a guiding display processing unit 302 which displays in the first virtual reality space a guiding image for guiding the user U to perform at least four of the motions about the three axes and the motions in the three directions.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[[Technical Field]]

[0001] The present invention relates to a virtual reality display device that causes a display device for displaying an image representing a virtual reality space to display an image, a virtual reality display system, a virtual reality display program, a storage medium having the virtual reality display program recorded thereon, and a virtual reality display method. [[Background Art]]

[0002] Conventionally, there has been known a virtual reality control device that uses a virtual reality headset attached to a user's head and provided with a display unit capable of displaying virtual reality video, and causes generated virtual reality (VR) information to be displayed on the display unit (see, for example, Patent Document 1). In recent years, a large number of virtual reality devices that allow viewing of virtual reality as described above, or contents for virtual reality, have been distributed. [[Prior Art Documents]] [[Patent Documents]]

[0003] [[Patent Document 1]] Japanese Unexamined Patent Application Publication No. 2021-009647 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]

[0004] By the way, a user who views or experiences a virtual reality video can obtain a sensation as if the user actually exists within a virtually configured virtual reality space. However, the degree of such a sensation varies greatly depending on the virtual reality display device and contents.

[0005] An object of the present invention is to provide a virtual reality display device, a virtual reality display system, a virtual reality display program, a storage medium having the virtual reality display program recorded thereon, and a virtual reality display method that easily enhance the user's sensation that the user actually exists within the virtual reality space. [[Means for Solving the Problem]]

[0006] The virtual reality display device according to the present invention is a virtual reality display device that displays an image representing a virtual reality space on a display device for displaying an image representing the virtual reality space, and comprises a virtual reality control unit that displays a preset first virtual reality space on the display device and changes the image representing the first virtual reality space in accordance with the movement of the user's head around three axes: roll, pitch, and yaw, and the movement of the user in three directions: forward, backward, left, right, and up and down, and a guidance display processing unit that displays guidance images in the first virtual reality space that guide the user to perform at least four of the movements around the three axes and the movements in the three directions.

[0007] Furthermore, the virtual reality display system according to the present invention comprises the virtual reality display device described above and the display device.

[0008] Furthermore, the virtual reality display program according to the present invention causes a computer to function as the virtual reality display device described above.

[0009] Furthermore, the storage medium according to the present invention stores a virtual reality display program that causes a computer to function as the virtual reality display device described above.

[0010] Furthermore, the virtual reality display method according to the present invention is a virtual reality display method that causes a display device for displaying an image showing a virtual reality space to display an image showing the virtual reality space, and includes a virtual reality control process that causes a preset first virtual reality space to be displayed on the display device and changes the image showing the first virtual reality space in accordance with the movement of the user's head around three axes: roll, pitch, and yaw, and the movement of the user in three directions: forward, backward, left, right, and up and down, and a guidance display process that displays guidance images in the first virtual reality space that guide the user to perform at least four of the movements from the three axes and the three directions.

[0011] With these configurations, the user is guided to perform four types of movements, including both rotational and linear motion, and the image in the first virtual reality space changes in response to these four movements. As a result, the user experiences changes in their field of view that make them feel as if they are actually present in the first virtual reality space. Consequently, the user's sense of actually being present in the virtual reality space is enhanced.

[0012] Furthermore, it is preferable to further include a voice guidance processing unit that outputs voice guidance to assist in guidance using the aforementioned guidance images.

[0013] In this configuration, user movement guidance using guided images is assisted by voice guidance.

[0014] Furthermore, it is preferable to further include a content display processing unit that, after guidance images that guide the user to perform at least the four movements are displayed in the first virtual reality space, displays content based on a second virtual reality space different from the first virtual reality space on the display device.

[0015] In this configuration, the user's sense of actually being present in the virtual reality space is enhanced by the guidance images, after which content based on the second virtual reality space is displayed, thereby increasing the interest and psychological impact of the content.

[0016] Furthermore, it is preferable to further include a content display processing unit that, when the user performs at least four of the actions described above, displays content based on a second virtual reality space different from the first virtual reality space on the display device.

[0017] With this configuration, content based on the second virtual reality space is displayed only after it has been confirmed that the user has performed at least four of the aforementioned actions. This increases the likelihood that the content will be displayed while the user's sense of actually being present in the virtual reality space is heightened.

[0018] Further preferably, the guidance display processing unit displays, as the guidance image for guiding the movement in the front-rear direction, an image of a road extending forward from the user's feet in the virtual reality space.

[0019] An image of a road extending forward from the user's feet in the virtual reality space is suitable as a guidance image for guiding the user's movement in the front-rear direction.

[0020] Further preferably, the guidance display processing unit displays a predetermined first image at an end of the road as the guidance image for guiding the movement in the front-rear direction.

[0021] The first image displayed at the end of the road is suitable as a guidance image for guiding the user's movement in the front-rear direction.

[0022] Further preferably, the guidance display processing unit displays a predetermined second image on a right side and / or a left side of the road as the guidance image for guiding the movement around the yaw axis.

[0023] The second image displayed on the right side and / or the left side of the road is suitable as a guidance image for guiding the movement around the yaw axis.

[0024] Further preferably, the guidance display processing unit guides the user's movement in the left-right direction and / or the movement around the yaw axis by stereoscopically displaying the guidance image.

[0025] The stereoscopically displayed guidance image is suitable as a guidance image for guiding the user's movement in the left-right direction and / or the movement around the yaw axis.

[0026] Further preferably, the guidance display processing unit guides the movement around the pitch axis by displaying the guidance image such that an upper portion of the guidance image disappears from an upper limit of the user's field of view.

[0027] Displaying the guidance image such that the upper portion of the guidance image disappears from the upper limit of the user's field of view is suitable as a method for guiding the user's movement around the pitch axis.

[0028] Further, it is preferable that the guidance display processing unit displays a plurality of third images floating so as to be three-dimensionally distributed in the front-rear, left-right, and up-down directions of the user's field of view in the virtual reality space as guidance images for guiding movement around the pitch and yaw axes.

[0029] In the virtual reality space, the plurality of third images floating so as to be three-dimensionally distributed in the front-rear, left-right, and up-down directions of the user's field of view are suitable as guidance images for guiding the user's movement around the pitch and yaw axes.

[0030] Further, it is preferable that the guidance display processing unit displays a fourth image turning above the user's head in the virtual reality space as a guidance image for guiding movement around the roll axis.

[0031] The fourth image turning above the user's head in the virtual reality space is suitable as a guidance image for guiding the user's movement around the roll axis.

[0032] Further, it is preferable that the guidance display processing unit displays at least one of the following as a guidance image for guiding movement in the vertical direction: an incoming image in which an object flies toward the user from the front of the user's field of view, an obstacle image displayed at a height near the user's viewpoint position and allowing passage underneath, and a low-position image displayed at a position lower than the user's viewpoint position on a wall surface extending in a substantially vertical direction.

[0033] An incoming image in which an object flies toward the user from the front of the user's field of view, an obstacle image displayed at a height near the user's viewpoint position and allowing passage underneath, and a low-position image displayed at a position lower than the user's viewpoint position on a wall surface extending in a substantially vertical direction are suitable as guidance images for guiding the user's movement in the vertical direction.

Effects of the Invention

[0034] A virtual reality display device, virtual reality display system, virtual reality display program, storage medium on which the virtual reality display program is recorded, and virtual reality display method configured in this way make it easier to enhance the user's sense of actually being present in the virtual reality space. [Brief explanation of the drawing]

[0035] [Figure 1] This is a block diagram showing an example configuration of a virtual reality display system relating to one embodiment of the present invention. [Figure 2] Figure 1 is a flowchart illustrating an example of the operation of a virtual reality display system. [Figure 3] This is an explanatory diagram showing an example of a guidance image displayed in the user's field of view within the first virtual reality space. [Figure 4] This is an explanatory diagram showing an example of a guidance image displayed in the user's field of view within the first virtual reality space. [Figure 5] This is an explanatory diagram showing an example of a guidance image displayed in the user's field of view within the first virtual reality space. [Figure 6] This is an explanatory diagram showing an example of a guidance image displayed in the user's field of view within the first virtual reality space. [Figure 7] This is an explanatory diagram showing an example of a guidance image displayed in the user's field of view within the first virtual reality space. [Figure 8] This is an explanatory diagram showing another example of a guidance image displayed in the user's field of view within the first virtual reality space. [Figure 9] This is an explanatory diagram showing another example of a guidance image displayed in the user's field of view within the first virtual reality space. [Figure 10] This is an explanatory diagram showing another example of a guidance image displayed in the user's field of view within the first virtual reality space. [Figure 11] This is an explanatory diagram showing another example of a guidance image displayed in the user's field of view within the first virtual reality space. [Modes for carrying out the invention]

[0036] Embodiments of the present invention will be described below with reference to the drawings. Components denoted by the same reference numerals in each figure are considered to be the same component, and their descriptions will be omitted. Figure 1 is a block diagram showing an example of the configuration of a virtual reality display system according to one embodiment of the present invention. The virtual reality display system 1 comprises a VR headset 2 (display device) and a virtual reality display device 3.

[0037] VR headset 2 is a display device for displaying images representing a virtual reality space. VR headset 2 can be attached to user U's head by a belt or similar means. VR headset 2 has a goggle-like housing that covers user U's field of view and is equipped with a display such as an LCD or EL (Electro-Luminescence). VR headset 2 also includes speakers for outputting sound.

[0038] Furthermore, VR Headset 2 is a so-called 6DoF (six degrees of freedom) compatible headset, and is equipped with sensors that detect movement in three directions: forward / backward, left / right, and up / down, as well as sensors that detect movement around three axes: roll, which is rotational movement around an axis extending forward / backward; pitch, which is rotational movement around an axis extending left / right; and yaw, which is rotational movement around an axis extending up / down. The axis extending forward / backward is the roll axis, the axis extending left / right is the pitch axis, and the axis extending up / down is the yaw axis.

[0039] The VR headset 2 is equipped with a wireless communication circuit (not shown in the diagram), such as WiFi® or Bluetooth®, and is capable of wireless communication with the virtual reality display device 3. The VR headset 2 transmits detection information indicating movement in three directions and around three axes, detected by the above-mentioned sensors, to the virtual reality display device 3 via wireless communication. The VR headset 2 also receives image data transmitted wirelessly from the virtual reality display device 3 and displays it on the display.

[0040] Furthermore, the VR headset 2 and the virtual reality display device 3 are not limited to wireless communication; they may also communicate via wired connection. Additionally, the display device only needs to be worn on the user U's head to display images representing the virtual reality space; it is not limited to goggle-type headsets, but may also be a glasses-type display device, and its form is not restricted.

[0041] The virtual reality display device 3 can be configured using a computer device such as a personal computer or a game console. The virtual reality display device 3 includes, for example, a processing unit 30, a storage device 31, and a wireless communication unit 32. The wireless communication unit 32 is a wireless communication circuit that communicates wirelessly with the VR headset 2.

[0042] The storage device 31 is, for example, a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage device 31 stores data representing the virtual reality space, a virtual reality display program according to one embodiment of the present invention, and the like.

[0043] The arithmetic unit 30 is composed of, for example, a CPU (Central Processing Unit) that performs predetermined arithmetic processing, RAM (Random Access Memory) that temporarily stores data, non-volatile memory elements, and peripheral circuits for these. By executing the virtual reality display program stored in the storage device 31, the arithmetic unit 30 functions as a virtual reality control unit 301, a guidance display processing unit 302, a voice guidance processing unit 303, and a content display processing unit 304.

[0044] The virtual reality control unit 301 transmits an image based on data representing the first virtual reality space stored in the storage device 31 to the VR headset 2 via the wireless communication unit 32, and displays it on the VR headset 2. Hereafter, the act of transmitting image data to the VR headset 2 via the wireless communication unit 32 and displaying the image on the VR headset 2 will be simply referred to as "displaying the image on the VR headset 2."

[0045] Furthermore, the virtual reality control unit 301 changes the image representing the first virtual reality space in accordance with detection information received from the VR headset 2 via the wireless communication unit 32, which indicates the roll, pitch, and yaw movements of the user U's head, as well as the forward / backward, left / right, and up / down movements of the user U. Hereafter, receiving detection information from the VR headset 2 via the wireless communication unit 32 will simply be referred to as "receiving from the VR headset 2."

[0046] The guidance display processing unit 302 displays guidance images in the first virtual reality space that guide the user U to perform at least four of the six movements, which are movements around the three axes of roll, pitch, and yaw, and movements in the three directions of forward / backward, left / right, and up / down.

[0047] The voice guidance processing unit 303 transmits data indicating voice guidance to assist guidance using guidance images to the VR headset 2 via the wireless communication unit 32, causing the VR headset 2 to output voice guidance. Hereafter, the transmission of data indicating voice guidance to the VR headset 2 via the wireless communication unit 32 and the output of voice guidance by the VR headset 2 will be simply referred to as "causing the VR headset 2 to output voice guidance."

[0048] The content display processing unit 304 displays content based on a second virtual reality space, which is different from the first virtual reality space, on the VR headset 2 when at least four of the six actions described above are performed by the user U.

[0049] Next, the operation of the virtual reality display system 1 configured as described above will be explained. Figure 2 is a flowchart showing an example of the operation of the virtual reality display system 1 shown in Figure 1. First, the virtual reality control unit 301 displays an image representing a pre-configured first virtual reality space on the headset 2 (step S1). Steps S2 to S4 are then executed in parallel or as a single process.

[0050] In step S2, the virtual reality control unit 301 changes the image representing the virtual reality space in accordance with the roll, pitch, and yaw movements of the user U's head and the forward, backward, left, right, and up and down movements of the user U, based on the detection information transmitted from the headset 2 (step S2).

[0051] As a result, when user U moves or changes the direction of their gaze by moving their head, the image of the virtual reality space displayed on the VR headset 2 changes in conjunction with user U's movements. Consequently, the image seen by user U changes as if user U were moving within the virtual reality space. However, even if the image changes are the same as if user U were moving within the virtual reality space, it does not necessarily mean that user U will immediately feel as if they are actually present within the virtual reality space.

[0052] Therefore, in order to enhance the sense that user U is actually present in the virtual reality space, the guidance display processing unit 302 displays guidance images on the headset 2 in the first virtual reality space that guide user U to perform one of the following movements: movement around the three axes of roll, pitch, and yaw, and movement in the three directions of forward / backward, left / right, and up / down (step S3).

[0053] In step S4, the voice guidance processing unit 303 outputs voice guidance to the VR headset 2 to assist in guidance using guidance images (step S4).

[0054] Figures 3 to 7 are explanatory diagrams showing examples of guidance images displayed by the guidance display processing unit 302 in the field of view of the first virtual reality space as seen by user U. In the field of view shown in Figure 3, an image Gr of a road extending forward from the feet of user U, a first image G1 that attracts user U's interest displayed at the end of the road image Gr, and a second image G2 that attracts user U's interest displayed to the right and left of the road image Gr are shown. Note that the second image G2 is not necessarily limited to being displayed on both sides of the road image Gr, but may be displayed on only one of the right or left sides.

[0055] In Figure 3, an image of a giant statue is shown as an example of the first image G1, and an image of a landscape mural is shown as an example of the second image G2. In Figure 3, walls are erected on both sides of an image Gr of a road, and murals are displayed on the walls as the second image G2. A ceiling is provided above the walls, and the image is designed to look like a tunnel-like passage through which the user U passes.

[0056] If the road image Gr extends forward from the user U's feet, the user U will be inclined to walk forward along the road image Gr, thus inducing movement in the forward-backward direction. Furthermore, since a large standing image is visible in front of the user U as the first image G1, the guiding effect of the user U moving forward to approach the first image G1 is amplified. In other words, image Gr and the first image G1 are examples of guiding images that induce movement in the forward-backward direction.

[0057] Furthermore, the voice guidance processing unit 303 assists in guiding the vehicle forward using the road image Gr and the first image G1 by outputting voice guidance such as "Please move forward."

[0058] When user U moves forward and reaches the side of the second image G2, user U turns to the side to look at the second image G2, thus inducing movement around the yaw axis. In other words, the second image G2 is an example of a guidance image that induces movement around the yaw axis. Furthermore, the voice guidance processing unit 303 assists in guiding movement around the yaw axis by outputting voice guidance such as "Please turn to the side" or "Please look at the mural" using the second image G2.

[0059] Figure 4 is a screenshot showing an example of the first image G1 as viewed from the front by user U. Figure 5 is a screenshot showing an example of the first image G1 as viewed from the side by user U.

[0060] The first image G1 is displayed as a three-dimensional image. User U, faced with the three-dimensional, standing-like first image G1, wants to view it from other angles, such as from the side or behind. User U, wanting to view the first image G1 from other angles, moves sideways to try and get around to the side or behind the first image G1, or turns their head to look around at the first image G1.

[0061] In other words, the three-dimensional first image G1 is an example of a guidance image that guides the user U's movement in the left-right direction and / or around the yaw axis. Furthermore, the voice guidance processing unit 303 assists in guiding the left-right direction and / or movement around the yaw axis by outputting voice guidance such as "Please walk around the standing image to see it."

[0062] Figure 6 is a screen view showing an example of the first image G1 as seen by user U when user U approaches the first image G1 from the front. The guidance display processing unit 302 enlarges the first image G1 as if user U were actually approaching the first image G1 as user U approaches the first image G1 in the first virtual reality space, and displays the first image G1 such that the top of the first image G1 disappears from the upper limit of user U's field of view UL when user U reaches in front of the first image G1.

[0063] As a result, user U perceives the first image G1 as larger than user U themselves, and looks up at the first image G1 to see the top of the first image G1 that has disappeared from the upper limit of the field of view UL. Consequently, the top of the first image G1, as shown in Figure 7, is displayed below the upper limit of the field of view UL.

[0064] In this way, by displaying the first image G1 such that its upper portion disappears from the upper limit of the user U's field of view UL, the user U's movement around the pitch axis is guided. Furthermore, the voice guidance processing unit 303 assists in guiding the movement around the pitch axis by outputting voice guidance such as "Please look up at the standing image."

[0065] Figures 8 and 9 are explanatory diagrams showing another example of a guidance image displayed by the guidance display processing unit 302 in the field of view of the first virtual reality space as seen by user U. In the example shown in Figures 8 and 9, the first virtual reality space is a snowy landscape with falling snow.

[0066] The guidance display processing unit 302 displays, as a guidance image for guiding movement in the forward / backward, left / right, and pitch / yaw axes, as a third image G3, which consists of multiple snowflakes floating three-dimensionally distributed in the forward / backward, left / right, and up / down directions within the first virtual reality space, within the user U's field of view.

[0067] The third image, G3, which is an image of snow, is displayed larger near user U and smaller at a distance within the first virtual reality space due to perspective. As a result, user U, who sees the image of the first virtual reality space displayed on headset 2, can perceive the vastness of the space around them, causing them to try to move forward, backward, left, and right, and to look around. Consequently, user U's movements in the forward / backward direction, left / right direction, around the pitch axis, and around the yaw axis are induced.

[0068] Furthermore, the voice guidance processing unit 303 assists in guiding the user to movement in the forward / backward, left / right directions, and around the pitch and yaw axes using the third image G3 by outputting voice guidance such as "Please move around in the snowy landscape" or "Please look around."

[0069] In the first virtual reality space shown in Figure 8, an image of a planet orbiting above user U's head is displayed as the fourth image G4. Because the fourth image G4 is moving, like orbiting, it attracts user U's attention, causing user U to look up to see the fourth image G4. As a result, user U's movement around the pitch axis is induced.

[0070] Figure 9 shows the image that user U sees when looking upwards. When user U looks upwards, they can see the fourth image G4 revolving along the orbital image Gt, beyond the third image G3 of snow floating in the first virtual reality space. When user U turns their gaze towards the fourth image G4 in an attempt to see the fourth image G4 revolving along the orbital image Gt, user U turns their head in accordance with the rotation of the fourth image G4. As a result, user U's movement around the roll axis and movement around the yaw axis are induced.

[0071] Furthermore, the voice guidance processing unit 303 assists in guiding the user to movement around the pitch axis, roll axis, and yaw axis using the fourth image G4 by outputting voice guidance such as "Look up at the sky" or "Follow the planets with your eyes."

[0072] Figure 10 is an explanatory diagram showing an example of an incoming image displayed by the guidance display processing unit 302. The incoming image Gf shown in Figure 10 is an image of a ball flying towards user U from in front of user U's field of view. When an incoming image Gf, such as a ball, flies towards user U from in front of their field of view, user U crouches down to avoid the incoming image Gf. As a result, vertical movement of user U is guided. From the viewpoint of enhancing the effect of guiding vertical movement, it is preferable that the incoming image Gf is displayed so as to fly at the height of user U's viewpoint.

[0073] Figure 11 is an explanatory diagram showing an example of an obstacle image and a low-position image displayed by the guidance display processing unit 302. The obstacle image Gs shown in Figure 11 is an image of a vertical wall displayed so as to obstruct the user U's viewpoint height. In Figure 11, the viewpoint height is indicated by a dashed line for explanatory purposes. An image of a passable hole Gh is provided at a position lower than the viewpoint height in the wall of the obstacle image Gs. As a result, it appears to the user U that it is possible to pass under the wall of the obstacle image Gs. Consequently, the user U is guided to move up and down as they attempt to pass through the hole G.

[0074] Furthermore, to the side of the hole Gh in the obstacle image Gs, a low-angle image Gu is displayed at a position lower than the user U's viewpoint, attracting the user U's interest. As a result, the user U is instructed to crouch down to get a better look at the low-angle image Gu, thus inducing vertical movement.

[0075] Next, in step S5, the content display processing unit 304 checks how many of the six actions described above the user U has performed based on the detection information transmitted from the headset 2 (step S5). If the number of actions performed by the user U is less than four (NO in step S5), steps S2 to S4 are repeated.

[0076] On the other hand, if user U performs at least four of the six actions described above (YES in step S5), the content display processing unit 304 displays content based on a second virtual reality space different from the first virtual reality space on the headset 2 (step S6).

[0077] When User U performs at least four movements from among the three axes of roll, pitch, and yaw, and the three directions of forward / backward, left / right, and up / down, at least one rotational motion from among the three axes of roll, pitch, and yaw, and at least one linear motion from among the three directions of forward / backward, left / right, and up / down, User U will inevitably perform at least one rotational motion from among the three axes of roll, pitch, and yaw, and at least one linear motion from among the three directions of forward / backward, left / right, and up / down.

[0078] In this way, when user U performs four movements that include both rotational and linear motion, the virtual reality control unit 301 changes the image of the first virtual reality space in accordance with these four movements. As a result, user U experiences a change in their field of view that makes them feel as if they are actually present in the first virtual reality space. Consequently, the user's sense of actually being present in the virtual reality space is enhanced.

[0079] Furthermore, the content display processing unit 304 does not necessarily have to check in step S5 that user U has actually performed at least four of the six movements described above. For example, in step S3, the content display processing unit 304 may, after displaying guidance images that guide user U to perform at least four of the six movements described above, proceed to step S6 assuming that user U has performed at least four of the movements.

[0080] The content based on the second virtual reality space may be, for example, a game, or medical content such as VR digital therapeutic drugs. If the content is a game, the second virtual reality space is the virtual reality space in which the VR game is played; if the content is medical content, the second virtual reality space is the virtual reality space for performing digital medical treatment.

[0081] If the content is a game, performing steps S1 to S5 before running the game enhances the user U's sense of actually being present in the virtual reality space, thereby increasing the game's realism and enhancing its enjoyment.

[0082] Furthermore, in recent years, the development of digital therapeutics has been progressing, such as the approval in Japan of a smartphone app for smoking cessation treatment as a digital therapeutic drug that treats illnesses using an app. In addition, research is being conducted on using virtual reality for psychotherapy, focusing on the "power of virtual reality to affect people's minds and bodies."

[0083] If the content is medical content, performing steps S1 to S5 before executing the medical content can enhance user U's sense of actually being present in the virtual reality space, thereby increasing the therapeutic effect of the medical content.

[0084] Furthermore, the guidance images are not limited to the first image G1, second image G2, third image G3, fourth image G4, road image Gr, and trajectory image Gt. Any guidance image is sufficient to guide the user U to perform at least four movements from among the three axes of roll, pitch, and yaw, and the three directions of forward / backward, left / right, and up / down. Various images can be used as guidance images. [Explanation of Symbols]

[0085] 1. Virtual reality display system 2 headsets 3. Virtual reality display device 30 Arithmetic section 31 Storage device 32 Wireless Communication Section 301 Virtual Reality Control Unit 302 Guidance display processing unit 303 Voice guidance processing unit 304 Content display processing unit G1 First Image G2 Second Image G3 Third Image G4 Fourth Image Gr Road images Gt orbital image U User UL field of view limit

Claims

1. A virtual reality display device for displaying an image representing a virtual reality space, wherein the display device displays an image representing a virtual reality space, A virtual reality control unit displays a pre-configured first virtual reality space on the display device and changes the image representing the first virtual reality space in accordance with the user's head movement around the three axes of roll, pitch, and yaw, and the user's movement in the three directions of forward, backward, left, right, and up and down. A guidance display processing unit that displays guidance images in the first virtual reality space that guide the user to perform at least four of the movements described above, including movements around the three axes and movements in the three directions, A virtual reality display device comprising: a content display processing unit that, when the user performs at least four of the actions described above, causes the display device to display content based on a second virtual reality space different from the first virtual reality space.

2. The virtual reality display device according to claim 1, further comprising a voice guidance processing unit that outputs voice guidance to assist in guidance using the aforementioned guidance image.

3. The virtual reality display device according to claim 1 or 2, wherein the guidance display processing unit displays an image of a path extending forward from the user's feet in the virtual reality space as a guidance image for guiding the forward and backward movement.

4. The virtual reality display device according to claim 3, wherein the guidance display processing unit displays a predetermined first image ahead of the path as a guidance image for guiding the forward and backward movement.

5. The virtual reality display device according to claim 3 or 4, wherein the guidance display processing unit displays a predetermined second image on the right and / or left side of the road as a guidance image for guiding movement around the yaw axis.

6. The guidance display processing unit guides the user's left-right movement and / or movement around the yaw axis by displaying the guidance image in three dimensions, as described in any one of claims 1 to 5.

7. The virtual reality display device according to any one of claims 1 to 6, wherein the guidance display processing unit guides movement around the pitch axis by displaying the guidance image such that the upper part of the guidance image disappears from the upper limit of the user's field of view.

8. The virtual reality display device according to any one of claims 1 to 7, wherein the guidance display processing unit displays a plurality of third images floating in the virtual reality space so as guidance images that guide movement around the pitch and yaw axes, distributed three-dimensionally in front of, behind, to the left, to the right, and up and down of the user's field of view.

9. The virtual reality display device according to any one of claims 1 to 8, wherein the guidance display processing unit displays a fourth image rotating above the user's head in the virtual reality space as a guidance image for guiding movement around the roll axis.

10. The guidance display processing unit provides the guidance image for guiding the vertical movement as follows: A virtual reality display device according to any one of claims 1 to 9, which displays at least one of the following: an incoming image of an object flying towards the user from in front of the user's field of view; an obstacle image displayed at a height near the user's viewpoint and through which the user can pass; and a low-position image of a wall extending substantially vertically, displayed at a position lower than the user's viewpoint.

11. A virtual reality display device according to any one of claims 1 to 10, A virtual reality display system comprising the aforementioned display device.

12. A virtual reality display program that causes a computer to function as a virtual reality display device according to any one of claims 1 to 10.

13. A storage medium on which a virtual reality display program is recorded that causes a computer to function as a virtual reality display device according to any one of claims 1 to 10.

14. A virtual reality display method for displaying an image representing a virtual reality space on a display device for displaying an image representing a virtual reality space, A virtual reality control process that displays a pre-configured first virtual reality space on the display device and changes the image representing the first virtual reality space in accordance with the user's head movement around the three axes of roll, pitch, and yaw, and the user's movement in the three directions of forward / backward, left / right, and up / down. A guidance display process that displays guidance images in the first virtual reality space that guide the user to perform at least four of the movements described above, including movements around the three axes and movements in the three directions, A virtual reality display method including a content display process that, when the user performs at least four of the actions described above, causes the display device to display content based on a second virtual reality space different from the first virtual reality space.

Citation Information

Patent Citations

  • Display device, control method of display device and program

    JP2016224086A

  • Simulation system

    JP2018026034A

  • Simulation system and program

    JP2019139424A

  • Virtual reality control apparatus, virtual reality head set, virtual reality control method, and program

    JP2021009647A

  • Information processing device, information processing method, and program

    WO2019225354A1