VR motion sickness mitigation system, head-mounted display, and VR motion sickness mitigation method

Abstract

Provided are a VR motion sickness mitigation system, a head-mounted display, a VR motion sickness mitigation system, and a program capable of further mitigating VR motion sickness. The VR motion sickness mitigation system includes: a head mounted display including a headband configured to surround a head of a user when worn by the user; a display portion coupled to the headband such that the display portion is located in front of the user when the head-mounted display is worn by the user; a rocking portion allowing rocking of the head of the user on which the head mounted display is mounted, in which the rocking portion is located in front of the headband; a display control section that causes the display section to display a moving image indicating a state viewed from a viewpoint; and a shake control section that controls shake of the shake section depending on an acceleration state of the viewpoint in the moving image displayed on the display section.

Description

[0001] This patent application is a divisional application of the following invention patent applications:

[0002] Application number: 201980069436.7

[0003] Application date: October 16, 2019

[0004] Invention title: VR motion sickness reduction system, head mounted display, VR motion sickness reduction method Technical Field

[0005] The present invention relates to a virtual reality (VR) motion sickness reduction system, a head mounted display, a VR motion sickness reduction method and a program. Background Art

[0006] PTL 1 describes a technique for alleviating motion sickness (referred to as VR sickness) caused by virtual reality (VR) using low-frequency vibrations that are unrelated to events in a virtual environment.

[0007] [Citation list]

[0008] [Patent Document]

[0009] [PTL 1]

[0010] U.S. Patent Application Publication No. 2015 / 0325027 Summary of the invention

[0011] [Technical issues]

[0012] The inventors have studied a technique for alleviating VR motion sickness by shaking the head of a user on which a head mounted display (HMD) is mounted using a vibration motor or the like provided on the front surface of the housing of the HMD. VR motion sickness is considered to be caused by the difference between the movement of the viewpoint and the user's experience when a moving image representing a state viewed from a viewpoint is displayed on the display portion of the HMD located in front of the user. Therefore, it is assumed that VR motion sickness can be alleviated by coordinating the displayed moving image with the shaking of the head.

[0013] However, the technology described in PTL 1 uses low-frequency vibrations that are unrelated to events in a virtual environment as described above to reduce VR motion sickness, and does not perform coordination of display and vibration on the HMD to reduce VR motion sickness.

[0014] In view of the above situation, an object of the present invention is to provide a VR motion sickness reduction system, a head mounted display, a VR motion sickness reduction method and a program that can reduce VR motion sickness.

[0015] [Solution to the problem]

[0016] To achieve the purpose, a VR motion sickness reduction system according to one aspect of the present invention includes: a head-mounted display, which includes a headband configured to surround the user's head when worn by the user; a display part, which is coupled to the headband so that the display part is located in front of the user when the head-mounted display is worn by the user; a shaking part, which allows shaking of the user's head on which the head-mounted display is mounted, wherein the shaking part is located in front of the headband; a display control part, which causes the display part to display a moving image representing a state viewed from a viewpoint; and a shaking control part, which controls shaking of the shaking part depending on the acceleration state of the viewpoint in the moving image displayed on the display part.

[0017] A VR motion sickness reduction system according to another aspect of the present invention includes: a head-mounted display, which includes a display portion located in front of the user when the head-mounted display is mounted on the user; a shaking portion that allows shaking of the user's head on which the head-mounted display is mounted; a display control portion that causes the display portion to display a moving image representing a state viewed from a viewpoint; and a shaking control portion that controls shaking of the shaking portion depending on an acceleration state of the viewpoint in the moving image displayed on the display portion.

[0018] In an aspect of the present invention, the pan control section controls whether to pan the pan section depending on whether the moving image displayed on the display section indicates a state in which the viewpoint is accelerated.

[0019] In this aspect, the display control part can cause the display part to display a moving image representing the state of the virtual space viewed from a virtual camera located in the virtual space, and also includes a determination part that determines whether the virtual camera performs accelerated motion in the virtual space, and the shaking control part can control whether to shake the shaking part depending on the determination result of the determination part.

[0020] Optionally, the system may further include: an acquisition part, which acquires shake-controlled motion image data, the shake-controlled motion image data including motion image data indicating the motion image, and shake control data allowing identification of a frame image in the motion image, the frame image indicating a situation where the viewpoint is accelerated, wherein the display control part causes the display part to display the motion image indicated by the motion image data included in the shake-controlled motion image data, and also includes a determination part, which determines whether the frame image indicating a situation where the viewpoint is accelerated is displayed on the display part based on the shake control data included in the shake-controlled motion image data, and the shake control part can control whether to shake the shake part depending on the determination result of the determination part.

[0021] In this aspect, the system may further include: a pan control data generating section that generates the pan control data based on the moving image data.

[0022] Optionally, the system may also include: a shake control motion image data generating part, which generates the shake control motion image data, the shake control motion image data including the motion image data indicating the motion image and the shake control data, the motion image representing the state of the virtual space viewed from the virtual camera located in the virtual space, and the shake control data is generated based on the result of determining whether the virtual camera is performing accelerated motion in the virtual space.

[0023] In addition, in one aspect of the present invention, the display control part causes the display part to display the moving image representing the state of the virtual space viewed from a virtual camera located in the virtual space, and also includes a determination part which determines whether the virtual camera performs accelerated motion in the virtual space, and the shaking control part controls the shaking of the shaking part based on the determination result of the determination part and the distance between the virtual camera and the virtual object located in the virtual space.

[0024] In this aspect, the pan control section may control the panning of the pan section based on the determination result of the determination section and the distance between the virtual camera and the virtual object within the viewing angle of the virtual camera.

[0025] Furthermore, the pan control section may control the panning of the pan section based on the determination result of the determination section and the distance between the virtual camera and a virtual object closest to the virtual camera.

[0026] Furthermore, the pan control section may determine whether to pan the pan section based on a determination result of the determination section and a distance between the virtual camera and a virtual object positioned in the virtual space.

[0027] Alternatively, the pan control section may control the pan amount of the pan section based on a distance between the virtual camera and a virtual object located in the virtual space.

[0028] Furthermore, in an aspect of the present invention, the pan control section controls the panning of the pan section based on a movement amount per unit time of an object in the moving image.

[0029] In this aspect, the pan control section may control whether to pan the pan section based on an amount of movement per unit time of an object in the moving image.

[0030] Alternatively, the pan control section may control the pan amount of the pan section based on a movement amount per unit time of an object in the moving image.

[0031] In addition, in one aspect of the present invention, the system also includes: an acquisition part, which acquires shake control data, the shake control data including motion image data indicating the motion image and shake control data allowing identification of the acceleration state of the viewpoint in the motion image, wherein the display control part causes the display part to display the motion image indicated by the motion image data included in the shake control motion image data, and also includes a determination part, which determines the acceleration state of the viewpoint in the motion image displayed on the display part based on the shake control data included in the shake control motion image data, and the shake control part controls the shaking of the shake control part depending on the determination result of the determination part.

[0032] In this aspect, the system may further include: a pan control data generating section that generates the pan control data based on the moving image data.

[0033] Optionally, the system may also include: a shake control motion image data generating part, which generates the shake control motion image data, the shake control motion image data includes the motion image data and the shake control data, the motion image data indicates a motion image representing the state of the virtual space viewed from a virtual camera located in the virtual space, and the shake control data is generated based on the result of determining whether the virtual camera is performing accelerated motion in the virtual space.

[0034] Here, in one aspect of the present invention, the shaking portion is provided on a front surface of a housing of the head mounted display.

[0035] Furthermore, a head-mounted display according to one aspect of the present invention includes: a headband configured to surround a head of a user when worn by the user; a display portion coupled to the headband so that the display portion is located in front of the user when the head-mounted display is worn by the user; a shaking portion that allows shaking of the user's head on which the head-mounted display is mounted, wherein the shaking portion is located in front of the headband; a display control portion that causes the display portion to display a moving image representing a state viewed from a viewpoint; and a shaking control portion that controls shaking of the shaking portion depending on an acceleration state of the viewpoint in the moving image displayed on the display portion.

[0036] A head-mounted display according to another aspect of the present invention includes: a display portion, which is located in front of the user when the head-mounted display is mounted on the user; a shaking portion that allows the user's head to be shaken; a display control portion that causes the display portion to display a moving image representing a state viewed from a viewpoint; and a shaking control portion that controls shaking of the shaking portion depending on an acceleration state of a viewpoint in the moving image displayed on the display portion.

[0037] Furthermore, a virtual motion sickness alleviating method according to an aspect of the present invention includes: positioning a headband of a head-mounted display for surrounding a user's head; causing a display portion coupled to the headband to be located in front of the user when the head-mounted display is worn by the user, and displaying a moving image representing a state viewed from a viewpoint; and controlling whether to shake a shaking portion located in front of the headband depending on an acceleration state of the viewpoint in the moving image displayed on the display portion.

[0038] According to another aspect of the present invention, a method for alleviating VR motion sickness includes the following steps: when a head-mounted display is mounted on a user, causing a display portion located in front of the user to display a moving image representing a state viewed from a viewpoint; and controlling whether to shake a shaking portion of the user's head on which the head-mounted display is mounted, depending on an acceleration state of the viewpoint in the moving image displayed on the display portion.

[0039] Furthermore, according to a non-transitory computer-readable storage medium containing a computer program according to an aspect of the present invention, when the computer program is executed by a computer, the computer is caused to perform a virtual motion sickness reduction method by executing actions, the actions including: positioning a headband of a head-mounted display for surrounding a user's head; causing a display portion coupled to the headband to be located in front of the user when the head-mounted display is worn by the user, and displaying a moving image representing a state viewed from a viewpoint; and controlling whether to shake a shaking portion located in front of the headband depending on an acceleration state of the viewpoint in the moving image displayed on the display portion.

[0040] A program according to another aspect of the present invention causes a computer to execute the following program steps: when a head-mounted display is mounted on a user, causing a display portion located in front of the user to display a moving image representing a state viewed from a viewpoint; and controlling whether to shake a shaking portion of the head of the user on which the head-mounted display is mounted, depending on an acceleration state of the viewpoint in the moving image displayed on the display portion. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 is a diagram showing a general configuration of an entertainment system according to an embodiment of the present invention.

[0042] Figure 2A is a diagram showing an example of a configuration of a head mounted display according to an embodiment of the present invention.

[0043] Figure 2B is a diagram showing an example of a configuration of an entertainment device according to an embodiment of the present invention.

[0044] Figure 3 is a diagram showing an example of a virtual space.

[0045] Figure 4 is a diagram schematically showing an example of a data structure of pan-control moving image data.

[0046] Figure 5 is a functional block diagram showing functions implemented in an entertainment device according to an embodiment of the present invention.

[0047] Figure 6 is a flowchart showing an example of the flow of processing performed in the entertainment apparatus according to the embodiment of the present invention.

[0048] Figure 7 is a flowchart showing an example of the flow of processing performed in the entertainment apparatus according to the embodiment of the present invention.

[0049] Figure 8 is a diagram showing an example of a virtual space.

[0050] Fig. 9 is a flowchart showing an example of the flow of processing performed in the entertainment apparatus according to the embodiment of the present invention.

[0051] Fig.10 is a flowchart showing an example of the flow of processing performed in the entertainment apparatus according to the embodiment of the present invention. DETAILED DESCRIPTION

[0052] Embodiments of the present invention will be described with reference to the accompanying drawings.

[0053] Figure 1 is a diagram showing an example of a general configuration of the entertainment system 10 according to the embodiment of the present invention. Figure 2A is a diagram showing a configuration example of a head mounted display (HMD) 12 according to the present embodiment. Figure 2B 1 is a diagram showing a configuration example of the entertainment device 14 according to the present embodiment.

[0054] like Figure 1 As shown, the entertainment system 10 according to the present embodiment includes an HMD, an entertainment device 14 , a relay device 16 , a display 18 , a camera microphone unit 20 , and a controller 22 .

[0055] For example, Figure 2A As shown, the HMD 12 according to the present embodiment includes a processor 30 , a storage section 32 , a communication section 34 , an input / output section 36 , a display section 38 , a sensor section 40 , and a shaking section 42 .

[0056] The processor 30 is, for example, a program-controlled device such as a microprocessor, and operates according to a program installed in the HMD 12 .

[0057] The storage section 32 includes, for example, storage elements such as a read-only memory (ROM) and a random access memory (RAM). The storage section 32 stores programs executed by the processor 30 and the like.

[0058] The communication section 34 is, for example, a communication interface such as a wireless local area network (LAN) module.

[0059] The input / output section 36 is, for example, an input / output port such as an HDMI (registered trademark) (High-Definition Multimedia Interface) port or a Universal Serial Bus (USB) port.

[0060] The display section 38 is, for example, a display such as a liquid crystal display or an organic electroluminescent (EL) display, and is caused to display a video or the like generated by the entertainment device 14. Figure 1As shown, when the HMD 12 is mounted on the user, the display section 38 is located in front of the user. The display section 38 can, for example, receive a video signal output by the entertainment device 14 and relayed by the relay device 16, and output a video represented by the video signal. By, for example, displaying an image for the left eye and an image for the right eye, the display section 38 according to the present embodiment can display a three-dimensional image. Note that the display section 38 can be configured not to display a three-dimensional image and to be able to display only a two-dimensional image.

[0061] The sensor section 40 is, for example, a sensor such as an acceleration sensor or a motion sensor. The sensor section 40 can output measurement results such as the direction, rotation amount, and movement amount of the HMD 12 to the processor 30 at a predetermined sampling rate.

[0062] In this embodiment, the shaking portion 42 is, for example, a device that shakes according to an input signal. Figure 1 As shown, in the present embodiment, the shaking part 42 is provided on the front surface of the housing 44 of the HMD 12. The shaking part 42 is, for example, a vibrator such as a vibration motor. In addition, in the case where the shaking part 42 is an eccentric motor, the shaft included in the shaking part 42 can be rotated as a shaft generally extending in the front-rear direction to vibrate the shaking part 42.

[0063] exist Figure 1 In the example in FIG. 1 , a shaking portion 42 is provided at the center of the front surface of the housing 44 of the HMD 12. In addition, the shaking portion 42 can shake the head of the user on which the HMD 12 is mounted. Note that a plurality of shaking portions 42 may be provided in the HMD 12. In addition, in this case, the plurality of shaking portions 42 may be provided laterally symmetrically.

[0064] The entertainment device 14 according to the present embodiment is, for example, a computer such as a game console, a digital versatile disc (DVD) game console, or a Blu-ray (registered trademark) game console. The entertainment device 14 according to the present embodiment generates video and sound by, for example, executing a stored game program or a game program recorded in an optical disc, reproducing stored content or content recorded in an optical disc, etc. Then, the entertainment device 14 according to the present embodiment outputs a video signal representing the generated video and a sound signal representing the generated sound to the display 18 via the relay device 16.

[0065] For example, Figure 2B As shown, the entertainment device 14 according to the present embodiment includes a processor 50 , a storage section 52 , a communication section 54 , and an input / output section 56 .

[0066] The processor 50 is, for example, a program-controlled device such as a central processing unit (CPU), which operates according to a program installed in the entertainment apparatus 14. The processor 50 according to the present embodiment includes a GPU (Graphics Processing Unit) that draws an image in a frame buffer based on graphics commands and data fed from the CPU.

[0067] The storage section 52 is, for example, a storage element such as a ROM and a RAM, a hard disk drive, etc. The storage section 52 stores programs etc. executed by the processor 50. In addition, an area of ​​a frame buffer for GPU drawing images is provided in the storage section 52 of the present embodiment.

[0068] The communication section 54 is, for example, a communication interface such as a wireless LAN module.

[0069] The input / output section 56 is an input / output port such as an HDMI (registered trademark) (High-Definition Multimedia Interface) port or a USB port.

[0070] The relay device 16 according to the present embodiment is, for example, a control section such as a computer including a control circuit, an image processing circuit, or a sound processing circuit, a storage section such as a memory, etc. The relay device 16 relays the video signal and the sound signal output from the entertainment device 14 to the HMD 12 or the display 18.

[0071] The display 18 according to the present embodiment is, for example, a liquid crystal display, and is caused to display a video represented by a video signal output from the entertainment device 14 .

[0072] The camera microphone unit 20 according to the present embodiment includes, for example, a camera 20a that outputs a captured image of a subject to the entertainment device 14, and a microphone 20b that acquires surrounding sounds, converts the sounds into sound data, and outputs the sound data to the entertainment device 14. In addition, the camera 20a according to the present embodiment is a stereo camera.

[0073] The HMD 12 and the relay device 16 can, for example, wirelessly transmit and receive data to each other. Note that the HMD 12 and the relay device 16 can be connected via a cable such as an HDMI cable or a USB cable. The entertainment device 14 and the relay device 16 are connected, for example, via an HDMI cable or a USB cable. The relay device 16 and the display 18 are connected, for example, via an HDMI cable. The entertainment device 14 and the camera microphone unit 20 are connected, for example, via an auxiliary (AUX) cable or the like.

[0074] The controller 22 according to the present embodiment is an operation input device for inputting operations to the entertainment device 14. The user can use the controller 22 to provide various operation inputs by pressing a direction key or button included in the controller 22 or tilting an operation stick. In the present embodiment, the controller 22 outputs input data associated with the operation input to the entertainment device 14. In addition, the controller 22 according to the present embodiment includes a USB port. By being connected to the entertainment device 14 via a USB cable, the controller 22 can output input data to the entertainment device 14 via the cable. In addition, the controller 22 according to the present embodiment includes a wireless communication module, etc., so that the input data can be wirelessly output to the entertainment device 14.

[0075] In the present embodiment, for example, a program for a first-person viewpoint game is executed in the entertainment device 14. Then, for example, a signal representing a position from a position Figure 3 A moving image of a state viewed from a virtual camera 62 in a virtual space 60 shown in the figure in a capturing direction 64 is provided. In this regard, for example, a frame image representing a state viewed from a position of the virtual camera 62 in a frame in the capturing direction 64 is generated at a predetermined frame rate. Figure 3 The virtual space 60 shown is a virtual three-dimensional space. The position and capture direction 64 of the virtual camera 62 change, for example, according to the player's operation of the controller 22 or the game state of the game (e.g., an event occurring in the game). The content displayed on the display portion 38 of the HMD 12 changes according to the change in the position and capture direction 64 of the virtual camera 62. The processing according to the game state of the game, including the update of the position and capture direction 64 of the virtual camera 62, the generation of a frame image, and the display of a frame image, can be performed at the above-mentioned predetermined frame rate.

[0076] In addition, in the present embodiment, for example, it is determined whether the virtual camera 62 is undergoing accelerated motion based on the movement of the virtual camera 62. Here, the accelerated motion refers to, for example, circular motion, uniform accelerated motion, variable accelerated motion, etc. Note that the motion referred to by the accelerated motion may or may not include angular acceleration motion, such as uniform accelerated motion or variable accelerated motion. For example, in a first-person viewpoint game, when the first-person viewpoint character jumps or sprints, the virtual camera 62 is determined to be undergoing accelerated motion. In this regard, for example, it can be determined whether the virtual camera 62 is undergoing accelerated motion based on the position or capture direction 64 of the virtual camera 62 in a predetermined number of the latest frames.

[0077] Then, according to the result of the determination, the shaking of the shaking part 42 is controlled (for example, whether the shaking part 42 is shaken). In this regard, in the case where the shaking part 42 is a vibration motor, the vibration motor can be controlled so that the vibration has a frequency band of 10 to 20 Hz and an acceleration value (G value) of 0.05 to 0.5G.

[0078] As described above, in the present embodiment, whether or not to pan the pan section 42 is controlled depending on whether or not the moving image displayed on the display section 38 indicates that the virtual camera 62 is accelerating.

[0079] In the case where a moving image representing a state viewed from a viewpoint is displayed on the display section 38 located in front of the user, motion sickness (referred to as VR motion sickness) of the user mounted with the HMD 12 is considered to be caused by the difference between the movement of the viewpoint and the user's experience, in the above example, the position of the viewpoint corresponds to the position of the virtual camera 62. In addition, the direction of the viewpoint corresponds to the capture direction 64. In other words, the VR motion sickness in the above example is considered to be caused by the difference between the movement of the virtual camera 62 and the user's experience. In particular, the experience of the head including the concentration of the sense organs is considered to be significantly related to VR motion sickness.

[0080] In the present embodiment, the shaking of the shaking section 42 is controlled depending on the acceleration state of the viewpoint in the moving image displayed on the display section 38. For example, as described above, whether to shake the shaking section 42 is controlled depending on whether the moving image displayed on the display section 38 represents a situation where the viewpoint is accelerated. Therefore, according to the present embodiment, the displayed moving image and the shaking of the head are coordinated so that VR motion sickness can be reduced.

[0081] Note that the present invention can be applied to a case where a moving image of a real space captured by a real camera is displayed on the display section 38, and can also be applied to a case where a moving image of a virtual space 60 captured by a virtual camera 62 is displayed on the display section 38. For example, whether to shake the shaking section 42 can be controlled depending on whether the moving image indicates that the real camera is accelerating. In addition, the present invention can be applied to general moving images, such as moving images of video content, whose images are not moving images captured by the real camera or the virtual camera 62, and represent a state viewed from a viewpoint.

[0082] In addition, as described above, the shake portion 42 according to the present embodiment is attached to the front surface of the housing 44 of the HMD 12. Therefore, the shake portion 42 can be easily attached to the HMD 12.

[0083] Note that the shaking portion 42 does not need to be provided on the front surface of the housing 44 of the HMD 12 as long as the shaking portion 42 can shake the head of the user on which the HMD 12 is mounted. For example, the shaking portion 42 may be provided on the inner surface of the housing 44. In addition, the shaking portion 42 does not need to be provided in the HMD 12.

[0084] Figure 4 Schematically shows an example of the data structure of the pan control motion image data 66 according to the present embodiment. Figure 4 The pan control motion image data 66 is shown. The pan control motion image data 66 includes, for example, motion image data 68 and pan control data 70.

[0085] The moving image data 68 is data indicating a moving image displayed on the display section 38, for example, by reproducing and expressing a state observed from a viewpoint. In this regard, for example, when a moving image generated according to the movement of the virtual camera 62 is displayed on the display section 38, the moving image data 68 indicating the moving image can be generated.

[0086] The pan control data 70 is, for example, data capable of identifying the acceleration state of the viewpoint in the moving image indicated by the moving image data 68. The pan control data 70 may be, for example, data capable of identifying a frame image showing that the viewpoint is accelerated in the moving image indicated by the moving image data 68.

[0087] In the present embodiment, for example, it is assumed that the motion image data 68 includes a plurality of frame images generated at a predetermined frame rate. In addition, in the present embodiment, it is assumed that the shake control data 70 includes a plurality of frame shake control data associated with each frame image. The frame shake control data may be a flag set to 1 when the associated frame image indicates that the viewpoint is accelerated, and a flag set to 0 when the associated frame image does not indicate that the viewpoint is accelerated. Figure 4 In the illustrated pan control data 70 , frame pan control data schematically indicated in black is associated with a frame image indicating a case where the viewpoint is accelerated, that is, its value is 1.

[0088] Note that the data format of the pan control data 70 is not limited to the above data format. For example, the pan control data 70 may be data of a frame number indicating a case where the viewpoint is accelerated.

[0089] For example, the shake control data 70 may be set according to an operation performed by the operator when viewing the moving image indicated by the moving image data 68. For example, for a frame image indicating a case where the viewpoint is accelerated determined by the operator, the operator may perform an operation of setting 1 as the value of the frame shake control data associated with the frame image. Then, according to the operation, 1 may be set as the value of the frame shake control data.

[0090] In addition, image analysis technology can be used to determine, for each frame image, whether the frame image represents a situation where the viewpoint is accelerated based on the motion image data 68. For example, it can be determined based on a predetermined number of consecutive frame images ending with the frame image of interest whether the frame image represents a situation where the viewpoint is accelerated. Then, based on the result of the recognition, the shake control data 70 can be generated.

[0091] In addition, for example, the shake control data 70 can be generated based on the determination result of the movement of the virtual camera 62, and indicates whether the virtual camera 62 is performing accelerated movement. For example, in the above example, 1 can be set as the value of the frame shake control data associated with the frame image displayed when the shake portion 42 is controlled to shake.

[0092] Then, in the present embodiment, for example, according to the reproduction of the moving image indicated by the moving image data 68 included in the shaking control moving image data 66, shaking control may be performed based on the shaking control data 70 included in the shaking control moving image data 66. For example, whether to depict a frame image representing a case where the viewpoint is accelerated on the display section 38 may be determined based on the shaking control data 70. Then, when it is determined that the frame image representing a case where the viewpoint is accelerated is to be displayed, the shaking section 42 may be controlled to shake. For example, in the case where the frame shaking control data associated with the frame image displayed on the display section 38 has a value of 1, the shaking section 42 may shake.

[0093] In addition, for example, the acceleration value or angular acceleration value of the viewpoint can be determined. Then, shaking control can be performed according to the acceleration value or angular acceleration value. For example, the shaking part 42 can be controlled so that a larger acceleration value or angular acceleration value causes the shaking part 42 to shake more violently. In addition, in contrast, when the moving image displayed on the display part 38 represents a situation where the viewpoint is accelerated, the shaking part 42 can be controlled to shake so that the shaking has a predetermined amplitude regardless of the acceleration value or angular acceleration value of the viewpoint.

[0094] In addition, in the case of game distribution, while the game is being played, the shake-control motion image data 66 may be generated or transmitted in real time to another entertainment system 10 connected via a network. Then, the entertainment system 10 that has received the shake-control motion image data 66 may display the motion image indicated by the motion image data 68 included in the shake-control motion image data 66. In addition, the entertainment system 10 that has received the shake-control motion image data 66 may control the shaking of the shaking portion 42 in coordination with the displayed motion image based on the shake control data 70 included in the shake-control motion image data 66.

[0095] Functions implemented in the entertainment apparatus 14 according to the present embodiment and processes performed by the entertainment apparatus 14 will be further described.

[0096] Figure 5 is a functional block diagram showing an example of functions implemented in the entertainment device 14 according to the present embodiment. Note that the entertainment device 14 according to the present embodiment does not need to implement Figure 5 All functions shown can be realized except Figure 5Functionality other than that shown.

[0097] like Figure 5 As shown, the entertainment device 14 according to the present embodiment includes, for example, in terms of functions, a program execution part 80, a motion image data generating part 82, a determining part 84, a shaking control data generating part 86, a shaking control motion image data generating part 88, and a shaking control motion image data storage part 90, a shaking control motion image data acquiring part 92, a display control part 94 and a shaking control part 96.

[0098] The processor 50 mainly implements a program execution section 80, a moving image data generation section 82, a determination section 84, a shake control data generation section 86, and a shake control moving image data generation section 88. A shake control moving image data storage section 90 is mainly implemented in the storage section 52. A shake control moving image data acquisition section 92 is mainly implemented in the processor 30 or the communication section 54. A display control section 94 and a shake control section 96 are mainly implemented in the processor 50 and the input / output section 56.

[0099] The above functions are implemented by the processor 50 by executing a program installed in the entertainment device 14 corresponding to the computer, the program including instructions corresponding to the functions. For example, the program is provided to the entertainment device 14 via a computer-readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, or a flash memory, or via the Internet, etc.

[0100] In the present embodiment, the program execution section 80 executes a program such as a game program, for example.

[0101] In the present embodiment, the motion image data generation section 82 generates, for example, motion image data 68 indicating a motion image corresponding to the result of the program execution section 80 executing the program, for example, a motion image corresponding to the game state of the game. The motion image data generation section 82 may generate a motion image representing the state of the virtual space 60 viewed from the virtual camera 62 located in the virtual space 60.

[0102] For example, in the present embodiment, the determination section 84 determines the acceleration state of the viewpoint in the frame image displayed on the display section 38. In this regard, the determination section 84 may determine whether a frame image representing a situation where the viewpoint is accelerated is depicted on the display section 38. For example, the determination section 84 may determine whether the virtual camera 62 performs accelerated motion in the virtual space 60. In this case, as described above, the motion referred to by the accelerated motion may or may not include angular acceleration.

[0103] For example, in the present embodiment, the pan control data generation section 86 generates the above-mentioned pan control data 70. The pan control data generation section 86 may generate the pan control data 70 based on the result of the determination made by the determination section 84, and indicate whether the virtual camera 62 located in the virtual space 60 is performing accelerated motion in the virtual space 60.

[0104] In addition, the pan control data generation section 86 can generate the pan control data 70 based on the moving image data 68 indicating the moving image showing the state viewed from the viewpoint. For example, the pan control data generation section 86 can generate the pan control data 70 based on the moving image data 68 generated by the moving image data generation section 82.

[0105] For example, in the present embodiment, the shake-control motion image data generation section 88 generates the above-mentioned shake-control motion image data 66. In this regard, the shake-control motion image data generation section 88 may generate, for example, the shake-control motion image data 66, which includes the motion image data 68 generated by the motion image data generation section 82 and the shake control data 70 generated by the shake control data generation section 86. In this case, the motion image data 68 may correspond to data indicating a motion image representing the state of the virtual space 60 viewed from the virtual camera 62, and the shake control data 70 may correspond to data corresponding to a result of determining whether the virtual camera 62 performs accelerated motion in the virtual space 60.

[0106] In addition, the motion image data 68 included in the shake control motion image data 66 does not need to be motion image data 68 indicating a motion image corresponding to the result of executing the program by the program execution section 80. As described above, the motion image data 68 included in the shake control motion image data 66 may be, for example, motion image data 68 indicating a motion image of a real space captured by a real camera. In addition, the motion image data 68 does not need to indicate a motion image corresponding to the game state of the game, and may indicate a motion image of content such as a movie. In addition, the motion image indicated by the motion image data 68 does not need to be a motion image captured by a real camera or the virtual camera 62.

[0107] In the present embodiment, for example, the pan-control moving image data storage section 90 stores the above-mentioned pan-control moving image data 66. In this regard, the pan-control moving image data storage section 90 may store the pan-control moving image data 66 generated by the pan-control moving image data generation section 88.

[0108] In addition, the pan-control moving image data 66 can be purchased by the user. The pan-control moving image data 66 purchased by the user can be stored in the pan-control moving image data storage section 90.

[0109] In the present embodiment, the shake-control motion image data acquisition section 92 acquires, for example, the shake-control motion image data 66. In this regard, the shake-control motion image data acquisition section 92 may acquire the shake-control motion image data 66 stored in the shake-control motion image data storage section 90. In addition, the shake-control motion image data acquisition section 92 may receive the shake-control motion image data 66 transmitted from another entertainment system 10.

[0110] In the present embodiment, the display control section 94, for example, causes the display section 38 to display a moving image representing a state viewed from a viewpoint. In this regard, for example, the display control section 94 may transmit the moving image to the HMD 12 via the relay device 16. Then, the HMD 12 may cause the display section 38 to display the received moving image.

[0111] In addition, the display control section 94 can cause the display section 38 to display a moving image representing the state of the virtual space 60 viewed from the virtual camera 62 located in the virtual space 60. In addition, the display control section 94 can cause the display section 38 to display a moving image representing the state of the real space viewed from the real camera located in the real space.

[0112] In addition, the display control section 94 may cause the display section 38 to display a moving image indicated by the moving image data 68 included in the pan-control moving image data 66 acquired by the pan-control moving image data acquisition section 92 .

[0113] In the present embodiment, the pan control section 96 controls the panning of the pan section 42, for example, depending on the accelerated state of the viewpoint in the moving image displayed on the display section 38. The pan control section 96 may control whether to pan the section 42 depending on whether the moving image displayed on the display section 38 and indicating the state viewed from the viewpoint indicates a situation where the viewpoint is accelerated. In this regard, for example, the pan control section 96 may transmit a control signal for controlling the pan section 42 to the HMD 12 via the relay device 16. Then, the HMD 12 may control the panning of the pan section 42 based on the received control signal.

[0114] In addition, the shake control section 96 may control whether to shake the shake section 42 depending on the result of the determination by the determination section 84 .

[0115] In addition, the determination section 84 may determine whether a frame image representing a case where the viewpoint is accelerated is depicted on the display section 38 based on the shake control data 70 included in the shake control motion image data 66 acquired by the shake control motion image data acquisition section 92. For example, in the case where the value of the frame shake control data associated with the displayed frame image is 1, the determination section 84 may determine that a frame image representing a case where the viewpoint is being accelerated is depicted on the display section 38. Then, the shake control section 96 may control whether to shake the shake section 42 depending on the determination result by the determination section 84.

[0116] Here, we will refer to Figure 6 An example of the flow of processing executed in the entertainment apparatus 14 according to the present embodiment is described with reference to the flowchart shown. Figure 6 The illustrated processing example is an example of the flow of a shake control process performed by the shake section 42 based on the movement of the virtual camera 62. Note that in the present processing example, it is assumed that the empty shake control motion image data 66 generated in advance by the shake control motion image data generating section 88 is stored in the shake control motion image data storing section 90.

[0117] In addition, the frame rate is repeated at a predetermined rate. Figure 6 The processing shown in S101 to S107.

[0118] First, the program execution section 80 changes the position and the capturing direction 64 of the virtual camera 62 based on an operation signal received from the controller 22 and a game state of the game including an event occurring in the game ( S101 ).

[0119] Then, the moving image data generation section 82 generates a frame image representing a state viewed from the virtual camera 62 in the capturing direction 64 ( S102 ).

[0120] Then, the determination section 84 determines whether the virtual camera 62 is performing accelerated motion ( S103 ).

[0121] Here, it is assumed that it is determined that the virtual camera 62 is performing accelerated motion (S103: Yes). In this case, the display control section 94 performs display control for causing the display section 38 of the HMD 12 to display the frame image generated by the process shown in S102, and the pan control section 96 performs pan control for panning the pan section 42 (S104). In this case, the pan section 42 pans.

[0122] On the other hand, it is assumed that the virtual camera 62 does not perform accelerated motion (S103: No). In this case, the display control section 94 performs display control so that the display section 38 of the HMD 12 displays the frame image generated by the process shown in S102 (S105). In this case, the shaking section 42 does not shake. Then, the shaking control section 96 can perform shaking control to prevent the shaking section 42 from shaking.

[0123] When the processing shown in S104 or S105 is finished, the shaking control data generating section 86 generates frame shaking control data corresponding to the determination result in the processing shown in S103 in this cycle (S106). In this regard, for example, in the case where the processing shown in S104 in this cycle is executed, frame shaking control data having a value of 1 is generated. In addition, for example, in the case where the processing shown in S105 in this cycle is executed, frame shaking control data having a value of 0 is generated.

[0124] Then, the shake-control motion image data generation section 88 updates the shake-control motion image data 66 stored in the shake-control motion image data storage section 90 (S107). In this regard, for example, the frame image generated by the process at S102 is added to the motion image data 68 included in the shake-control motion image data 66. In addition, for example, the frame shake control data generated by the process shown in S106 in this loop is added to the shake control data 70 included in the shake-control motion image data 66, wherein the frame shake control data is associated with the frame image. Then, the loop returns to the process shown in S101.

[0125] Note that it is not necessary to perform the processing shown in S106 and the processing shown in S107.

[0126] Next, we will refer to Figure 7 An example of the flow of another process executed in the entertainment apparatus 14 according to the present embodiment is described with reference to the flowchart shown. Figure 7 The illustrated processing example is an example of the flow of the pan control processing by the pan section 42 performed during reproduction of a moving image indicated by the moving image data 68 included in the pan control moving image data 66 acquired by the pan control moving image data acquisition section 92 .

[0127] In addition, the frame rate is repeated at a predetermined rate. Figure 7 The processing shown in S201 to S204.

[0128] First, the display control section 94 identifies a frame image indicated by the moving image data 68 included in the pan control moving image data 66 in the present cycle ( S201 ).

[0129] Then, the determination section 84 determines whether the frame image identified by the process shown in S201 indicates a case where the viewpoint is accelerated, based on the shake control data 70 included in the shake control motion image data 66 (S202). In this regard, in a case where the value of the frame shake control data associated with the frame image identified by the process shown in S201 is 1, it is determined that the frame image identified by the process shown in S201 indicates a case where the viewpoint is being accelerated. In addition, in a case where the value of the frame shake control data associated with the frame image identified by the process shown in S201 is 0, it is determined that the frame image identified by the process shown in S201 does not indicate a case where the viewpoint is being accelerated.

[0130] Here, it is assumed that the frame image identified by the process shown in S201 is determined to represent a case where the viewpoint is accelerated (S202: Yes). In this case, the display control section 94 performs display control for causing the display section 38 of the HMD 12 to display the frame image identified by the process shown in S201, and the shaking control section 96 performs shaking control for preventing the shaking section 42 from shaking (S203). In this case, the shaking section 42 shakes.

[0131] On the other hand, it is assumed that the frame image identified by the process shown in S201 is determined not to represent a case where the viewpoint is accelerated (S202: No). In this case, the display control section 94 performs display control for causing the display section 38 of the HMD 12 to display the frame image generated by the process shown in S102 (S204). In this case, the shaking section 42 does not shake. In this regard, the shaking control section 96 may perform shaking control to prevent the shaking section 42 from shaking.

[0132] Then, the loop returns to the process shown in S201.

[0133] Note that in this embodiment, the shake control section 96 may be based on the result determined by the determination section 84 and the Figure 8 The shaking of the shaking part 42 is controlled based on the distance d between the virtual object 100 and the virtual camera 62 in the virtual space 60 shown. For example, the shaking control part 96 can control whether to shake the shaking part 42 based on the determination result of the determination part 84 and the distance d between the virtual object 100 and the virtual camera 62 located in the virtual space 60.

[0134] The pan control section 96 can control the panning of the pan section 42 based on the result determined by the determination section 84 and the distance d between the virtual object 100 and the virtual camera 62 located within the viewing angle (image capturing range) of the virtual camera 62. In this regard, the pan control section 96 can determine the distance d between the position P1 of the viewpoint of the virtual camera 62 and the position P2 on the front surface of the virtual object 100, which position P2 is closest to the position P1 of the viewpoint.

[0135] In addition, the pan control section 96 may determine a distance d between the virtual camera 62 and a virtual object that is identified from among a plurality of virtual objects and that is located closest to the virtual camera 62 .

[0136] For example, assume that a plurality of virtual objects are positioned within the viewing angle of the virtual camera 62. In this case, the pan control section 96 may identify the virtual object closest to the virtual camera 62 from among the virtual objects. Then, the pan control section 96 may determine the distance d between the identified virtual object and the virtual camera 62.

[0137] Then, in the case where the determination section 84 determines that the virtual camera 62 is performing accelerated motion in the virtual space 60 and the distance d is smaller than the predetermined distance d1 , the pan control section 96 may perform pan control for the pan section 42 .

[0138] In addition, the shaking control section 96 can control the shaking amount of the shaking section 42 based on the distance d between the virtual object 100 and the virtual camera 62 located in the virtual space 60. For example, the shaking control section 96 can determine the shaking amount of the shaking section 42 based on the distance d. Then, the shaking control section 96 can control the shaking section 42 so that the shaking section 42 shakes with the determined shaking amount. In this regard, for example, the determined shaking amount increases as the distance d decreases. In this case, the shaking section 42 is controlled to shake more violently by reducing the distance d.

[0139] In addition, the shaking control section 96 can use image analysis technology to identify the object in the motion image indicated by the motion image data 68. Then, the shaking control section 96 can identify the movement amount of the identified object per unit time in the frame image. In this case, the display section 38 can display a three-dimensional image, and the shaking control section 96 can replace the three-dimensional image with a two-dimensional image to determine the movement amount of the object. In other words, when determining the movement amount of the object, it is not necessary to consider the movement of the object in the depth direction.

[0140] Then, the pan control section 96 may control the panning of the pan section 42 based on the determined movement amount.

[0141] The shake control section 96 may control whether to shake the shake section 42 based on the determined movement amount, for example. For example, the shake control section 96 may perform shake control to shake the shake section 42 in the case where the determined movement amount is greater than a predetermined movement amount.

[0142] In addition, the shake control section 96 may control the shake amount of the shake section 42 based on the determined movement amount. For example, the shake section 42 may be controlled to shake more violently as the determined movement amount increases.

[0143] For example, the distance between the center position of an object in a frame image of a certain frame and the center position of an object in a frame image of a frame before the above frame is determined. Then, based on the determined distance, the shaking of the shaking part 42 can be controlled. For example, in the case where the determined distance is greater than a predetermined distance, the shaking control part 96 can perform shaking control to shake the shaking part 42. In addition, the shaking part 42 can be controlled to shake more violently as the determined distance increases.

[0144] In addition, when multiple objects are identified in the moving image indicated by the moving image data 68, one of the objects with the largest movement amount per unit time in the frame image can be identified. Then, the shaking of the shaking section 42 can be controlled based on the movement amount per unit time of the identified object.

[0145] In addition, the shaking control part 96 may determine the difference between the pixel value of the first pixel included in the frame image of the frame and the pixel value of the second pixel included in the frame image of the previous frame, the second pixel corresponding to the first pixel. Then, the shaking control part 96 may control the shaking of the shaking part 42 based on the total amount of the difference in the pixel values ​​determined for all pixels. For example, in the case where the determined total amount is greater than a predetermined value, the shaking control part 96 may perform shaking control to shake the shaking part 42. In addition, the shaking part 42 may be controlled to shake more violently as the total amount increases.

[0146] Here, we will refer to Fig. 9 An example of the flow of another process executed in the entertainment apparatus 14 according to the present embodiment is described with reference to the flowchart shown. Fig. 9 The processing example shown is as follows Figure 6 Another example of the flow of the pan control processing of the pan section 42 based on the movement of the virtual camera 62 is shown. Note that this processing example assumes that the null pan control motion image data 66 generated in advance by the pan control motion image data generating section 88 is stored in the pan control motion image data storing section 90.

[0147] In addition, the frame rate is repeated at a predetermined rate. Fig. 9 The processing shown in S301 to S308 in .

[0148] Fig. 9 The processing shown at S301 to S303 in FIG. 1 is similar to that shown at S301 to S303 in FIG. Figure 6 The processing shown at S101 to S103 in FIG. 1 is described below and will not be described accordingly.

[0149] Assume that in the process shown in S303, it is determined that the virtual camera 62 is performing accelerated motion (S303: Yes). In this case, the shake control part 96 determines the distance d between the virtual camera 62 and the virtual object 100 as described above, and determines whether the distance d is less than the predetermined distance d1 (S304).

[0150] In the case where the distance d is less than the predetermined distance d1, the display control section 94 performs display control so that the display section 38 of the HMD 12 displays the frame image generated by the process shown in S302, and the pan control section 96 performs pan control for panning the pan section 42 (S305). In this case, the pan section 42 pans.

[0151] Assume that in the process shown in S303, it is determined that the virtual camera 62 does not perform accelerated motion (S303: No). Alternatively, assume that in the process shown in S304, the distance d is determined to be equal to or greater than the predetermined distance d1 (S304: No). In either case, the display control section 94 performs display control so that the display section 38 of the HMD 12 displays the frame image generated by the process shown in S302 (S306). In this case, the shaking section 42 does not shake. In this regard, the shaking control section 96 can perform shaking control to prevent the shaking section 42 from shaking.

[0152] When the processing shown in S305 or S306 is finished, the shaking control data generating section 86 generates frame shaking control data in this cycle corresponding to the determination results in the processing shown in S303 and S304 (S307). In this regard, for example, in the case where the processing shown in S305 is performed in this cycle, frame shaking control data having a value of 1 is generated. In addition, for example, in the case where the processing shown in S306 is performed in this cycle, frame shaking control data having a value of 0 is generated.

[0153] Then, the shake-control motion image data generation section 88 updates the shake-control motion image data 66 stored in the shake-control motion image data storage section 90 (S308). In this regard, for example, the frame image generated by the process shown in S302 is added to the motion image data 68 included in the shake-control motion image data 66. In addition, the frame shake control data in this loop generated by the process shown in S307 is added to the shake control data 70 included in the shake-control motion image data 66, and the frame shake control data is associated with the frame image. Then, the loop returns to the process shown in S301.

[0154] Note that it is not necessary to execute the processing shown in S307 and the processing shown in S308.

[0155] Now, refer to Fig.10An example of the flow of another process executed in the entertainment apparatus 14 according to the present embodiment is described with reference to the flowchart shown. Fig.10 The processing example shown is reproduced by including in Fig. 9 The processing shown in S301 to S308 is an example of the flow of the pan control processing of the pan section 42 performed during the generation of the pan-controlled moving image data 66 indicating the moving image data 68 .

[0156] In addition, the frame rate is repeated at a predetermined rate. Fig.10 The processing shown in S401 to S404 in .

[0157] First, the display control section 94 identifies a frame image in the present cycle indicated by the moving image data 68 included in the pan-control moving image data 66 ( S401 ).

[0158] The determination section 84 checks whether the value of the frame pan control data associated with the frame image identified in the process shown in S401 is 1 ( S402 ).

[0159] Here, it is assumed that the determination section 84 confirms that the value of the frame shake control data is 1 (S402: Yes). In this case, the display control section 94 performs display control for causing the display section 38 of the HMD 12 to display the frame image identified by the process shown in S201, and the shake control section 96 performs shake control for the shake section 42 (S403). In this case, the shake section 42 shakes.

[0160] On the other hand, it is assumed that the value of the frame shaking control data is determined to be 0 (S402: No). In this case, the display control section 94 performs display control for causing the display section 38 of the HMD 12 to display the frame image generated by the process shown in S102 (S404). In this case, the shaking section 42 does not shake. In this regard, the shaking control section 96 may perform shaking control to prevent the shaking section 42 from shaking.

[0161] Then, the loop returns to the process shown in S401.

[0162] In the present embodiment, the above-mentioned frame shaking control data may be data indicating the shaking amount. In this case, for example, the shaking control data generating section 86 may generate frame shaking control data indicating the shaking amount. In this regard, in the case of preventing the shaking portion 42 from shaking, the shaking control data generating section 86 may generate frame shaking control data having a value of 0. In this case, the shaking control section 96 may perform shaking control so as to shake the shaking portion 42 with the shaking amount indicated by the frame shaking control data.

[0163] Note that the present invention is not limited to the above-described embodiments.

[0164] For example, the role allocation between the HMD 12, the entertainment device 14, and the relay device 16 is not limited to the above allocation. Figure 5 Some (e.g., display control portion 94 and pan control portion 96) or all of the functions shown.

[0165] In addition, for example, the pan control section 96 may turn on and off the pan control of the pan section 42 in response to an operation by a user or the like.

[0166] In addition, the specific character strings and numerical values ​​described above and the specific character strings and numerical values ​​in the drawings are illustrative, and the present invention is not limited to these character strings or numerical values.

Claims

1. A virtual motion sickness relief system, comprising: a head mounted display comprising a headband configured to surround a head of a user when worn by the user; a display portion coupled to the headband so that the display portion is located in front of the user when the head mounted display is worn by the user; a shaking portion that allows shaking of the user's head on which the head-mounted display is mounted, wherein the shaking portion is located in front of the headband; a display control section that causes the display section to display a moving image representing a state viewed from a viewpoint; and A pan control section controls panning of the pan section depending on an acceleration state of the viewpoint in the moving image displayed on the display section.

2. The virtual motion sickness reduction system of claim 1, wherein the shaking portion is located in the center of the front of the headband.

3. The virtual motion sickness reduction system according to claim 1, wherein: The swing portion is located at a portion in front of the headband where the forehead of the user contacts the headband.

4. The virtual motion sickness reduction system according to claim 1, wherein: The swing portion is located at a portion of the front of the headband connected to the display portion.

5. The virtual motion sickness reduction system according to claim 1, wherein: The shaking portion is located on the headband above the display portion.

6. The virtual motion sickness reduction system according to claim 1, wherein: The pan control section controls whether to pan the pan section depending on whether the moving image displayed on the display section indicates a state in which the viewpoint is accelerated.

7. The virtual motion sickness reduction system according to claim 6, wherein The display control section causes the display section to display a moving image representing a state of the virtual space viewed from a virtual camera located in the virtual space, and The method further comprises a determining part, which determines whether the virtual camera is performing accelerated motion in the virtual space, and The shake control section controls whether to shake the shake section depending on a determination result of the determination section.

8. The virtual motion sickness reduction system according to claim 6, further comprising: an acquisition section that acquires shake-controlled moving image data, the shake-controlled moving image data including moving image data indicating the moving image and shake control data that allows identification of a frame image in the moving image, the frame image indicating a case where the viewpoint is accelerated, wherein The display control section causing the display section to display a moving image indicated by the moving image data included in the pan-control moving image data, and further comprising a determination section that determines whether the frame image representing a case where the viewpoint is accelerated is displayed on the display section based on the shake control data included in the shake control motion image data, and The shake control section controls whether to shake the shake section depending on a determination result of the determination section.

9. The virtual motion sickness reduction system of claim 8, further comprising: A pan control data generating section generates the pan control data based on the moving image data.

10. The virtual motion sickness reduction system according to claim 8, further comprising: A shake control motion image data generating part, which generates the shake control motion image data, the shake control motion image data includes the motion image data indicating the motion image and the shake control data, the motion image represents the state of the virtual space viewed from a virtual camera located in the virtual space, and the shake control data is generated based on the result of determining whether the virtual camera performs accelerated motion in the virtual space.

11. The virtual motion sickness reduction system according to claim 1, wherein The display control section causing the display section to display the moving image representing the state of the virtual space viewed from a virtual camera located in the virtual space, and The method further comprises a determining part, which determines whether the virtual camera is performing accelerated motion in the virtual space, and The pan control section controls panning of the pan section based on a determination result by the determination section and a distance between the virtual camera and a virtual object located in the virtual space.

12. The virtual motion sickness alleviating system according to claim 11, wherein the shaking control section controls shaking of the shaking section based on the determination result of the determination section and the distance between the virtual camera and the virtual object within the viewing angle of the virtual camera.

13. The virtual motion sickness alleviating system according to claim 11, wherein the shaking control section controls shaking of the shaking section based on a determination result of the determination section and a distance between the virtual camera and a virtual object closest to the virtual camera.

14. The virtual motion sickness alleviating system according to claim 11, wherein the shaking control section determines whether to shake the shaking section based on a determination result of the determination section and a distance between the virtual camera and a virtual object positioned in the virtual space.

15. The virtual motion sickness alleviating system according to claim 11, wherein the panning control section controls a panning amount of the panning section based on a distance between the virtual camera and a virtual object located in the virtual space.

16. The virtual motion sickness alleviating system according to claim 1, wherein the shaking control section controls shaking of the shaking section based on a movement amount per unit time of an object in the moving image. 17 . The virtual motion sickness alleviating system according to claim 16 , wherein the shaking control section controls whether to shake the shaking section based on an amount of movement per unit time of an object in the moving image.

18. The virtual motion sickness alleviating system according to claim 16, wherein the shaking control section controls the shaking amount of the shaking section based on a movement amount per unit time of an object in the moving image.

19. The virtual motion sickness reduction system of claim 1, further comprising: an acquisition section that acquires shake-controlled moving image data including moving image data indicating the moving image and shake control data allowing recognition of an acceleration state of a viewpoint in the moving image, wherein The display control section causing the display section to display a moving image indicated by the moving image data included in the pan-control moving image data, and further comprising a determination section that determines an acceleration state of a viewpoint in the moving image displayed on the display section based on the shake control data included in the shake control moving image data, and The shake control section controls the shake of the shake control section depending on a determination result of the determination section.

20. The virtual motion sickness reduction system of claim 19, further comprising: A pan control data generating section generates the pan control data based on the moving image data.

21. The virtual motion sickness reduction system of claim 19, further comprising: A shake control motion image data generating part, which generates the shake control motion image data, the shake control motion image data includes the motion image data and the shake control data, the motion image data indicates a motion image representing the state of the virtual space viewed from a virtual camera located in the virtual space, and the shake control data is generated based on the result of determining whether the virtual camera performs accelerated motion in the virtual space.

22. The virtual motion sickness alleviating system according to claim 1, wherein the shaking portion is provided on a front surface of a housing of the head mounted display.

23. A head mounted display, comprising: a headband configured to encircle a user's head when worn by the user; a display portion coupled to the headband so that the display portion is located in front of the user when the head mounted display is worn by the user; a shaking portion that allows shaking of the user's head on which the head-mounted display is mounted, wherein the shaking portion is located in front of the headband; a display control section that causes the display section to display a moving image representing a state viewed from a viewpoint; and A pan control section controls panning of the pan section depending on an acceleration state of the viewpoint in the moving image displayed on the display section.

24. A method for alleviating virtual motion sickness, comprising: positioning a headband of the head mounted display for surrounding a user's head; causing a display portion coupled to the headband to be located in front of the user when the head mounted display is worn by the user, and displaying a moving image representing a state viewed from a viewpoint; as well as Whether to shake a shaking portion located in front of the headband is controlled depending on an acceleration state of the viewpoint in the moving image displayed on the display portion.

25. A non-transitory computer-readable storage medium containing a computer program, which, when executed by a computer, causes the computer to perform a virtual motion sickness reduction method by performing actions, the actions comprising: positioning a headband of the head mounted display for surrounding a user's head; causing a display portion coupled to the headband to be located in front of the user when the head mounted display is worn by the user, and displaying a moving image representing a state viewed from a viewpoint; as well as Whether to shake a shaking portion located in front of the headband is controlled depending on an acceleration state of the viewpoint in the moving image displayed on the display portion.

Images