Virtual reality experience control device, method, and program

Abstract

According to one aspect of the present invention, when a feeling of moving on a mobile object is presented to a user in a virtual space, information indicating the moving speed and moving direction of the mobile object is acquired, and the moving average over a predetermined time of an angle indicating the acquired moving direction is calculated. Then, video data in which the acquired moving speed and the calculated moving average of the angle of the moving direction are reflected in a moving position and a line-of-sight direction in the virtual space is generated, and the generated video data is presented to the user.

Description

Virtual reality experience control device, method, and program

[0001] One aspect of the present invention relates to a virtual reality experience control device, method, and program that uses a virtual space to provide a user with the sensation of moving using a moving object such as a bicycle.

[0002] In simulation systems that use computers or dedicated devices to simulate the sensation of movement in a moving object such as a car, various techniques that stimulate people's perception of bodily movement are being investigated to provide people with the sensation of movement even when they are not actually moving.

[0003] For example, Patent Document 1 describes a technology for a mobile body simulation device that simulates the sensation of movement when riding in a mobile body such as an automobile, in which electrode members are attached to the temporal region behind both ears of a passenger and an electric signal is supplied to the electrode members in response to the movement of the mobile body, thereby enabling the passenger to obtain a sense of balance that is actually felt by the passenger. Also, Patent Document 2 describes a technology for giving the passenger a sense of left-right and front-rear acceleration and a sense of impact by attaching electrodes to the forehead in addition to the rear of both ears of the passenger and passing an electric current through the electrodes.

[0004] Japanese Patent Publication No. 2004-151365 Japanese Patent Publication No. 2006-288621

[0005] However, the techniques described in the cited documents 1 and 2 both require the wearer to wear electrode members, which can be bothersome and uncomfortable for the wearer.

[0006] On the other hand, modern virtual reality experience systems use information tracked by the user's position in real space to set the virtual user's viewpoint and line of sight in the virtual space, making it possible to generate more realistic images that reflect the user's movements.

[0007] However, the technologies described in the above Patent Documents 1 and 2 do not consider how to generate images to approximate the difference in the user's operating sensation caused by "not driving in real space" to the actual operating sensation when the user simulates movement in a virtual space while changing the driving direction by operating the vehicle himself.

[0008] The present invention has been made in light of the above circumstances, and aims to provide a technique that enables the user's operational sensation in real space to be reproduced more accurately in virtual space.

[0009] In order to solve the above problems, one aspect of a virtual reality experience control device or method according to the present invention, when presenting a user with the sensation of traveling on a moving object in a virtual space, acquires information representing the traveling speed and traveling direction of the moving object, calculates a moving average of the angle representing the acquired traveling direction over a predetermined time, generates video data in which the acquired traveling speed and the calculated moving average of the angle representing the traveling direction are reflected in the moving position and line of sight direction in the virtual space, and presents the generated video data to the user.

[0010] According to one aspect of the present invention, it is possible to present to a user an image of a virtual space that is generated so that the movement position changes in accordance with the movement speed and the line of sight direction changes in accordance with the moving average of the angle indicating the movement direction over a predetermined period of time.

[0011] Furthermore, by controlling the direction of movement in the virtual space using the moving average of the direction of movement, it is possible to slow down the reaction speed of the line of sight direction in the virtual space to changes in the direction of movement, making it possible to express in the virtual space a sensation similar to the moment of inertia that occurs when a user performs an operation to change the direction of movement in the real world.

[0012] That is, according to one aspect of the present invention, it is possible to provide a technology that enables the user's operational sensation in real space to be reproduced more accurately in virtual space.

[0013] FIG. 1 is a diagram showing an example of the configuration of a virtual reality experience system using a bicycle according to a first embodiment of the present invention. FIG. 2 is a block diagram showing an example of the hardware configuration of a virtual reality experience control device provided in the system shown in FIG. 1. FIG. 3 is a block diagram showing an example of the software configuration of the virtual reality experience control device provided in the system shown in FIG. 1. FIG. 4 is a flowchart showing an example of the processing procedure and processing content of virtual reality experience control executed by a control unit of the virtual reality experience control device shown in FIG. 3. FIG. 5 is a flowchart showing an example of the processing procedure and processing content of running direction adjustment processing in the virtual reality experience control shown in FIG. 4. FIG. 6 is a flowchart showing an example of the processing procedure and processing content of virtual space data generation processing in the virtual reality experience control shown in FIG. 4. FIG. 7 is a flowchart showing an example of the processing procedure and processing content of running direction adjustment processing executed by a control unit of a virtual reality experience control device according to a second embodiment of the present invention. FIG. 8 is a flowchart showing an example of the processing procedure and processing content of virtual space data generation processing executed by a control unit of a virtual reality experience control device according to the second embodiment of the present invention. FIG. 9 is a flowchart showing an example of the processing procedure and processing content of running direction adjustment processing executed by a control unit of a virtual reality experience control device according to a third embodiment of the present invention. FIG. 10 is a flowchart showing an example of the processing procedure of the virtual space data generation processing executed by the control unit of the virtual reality experience control apparatus according to the third embodiment of the present invention.

[0014] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0015] First Embodiment (Configuration Example) (1) System FIG. 1 is a diagram showing an example of the configuration of a virtual reality experience system according to a first embodiment of the present invention.

[0016] The virtual reality experience system according to the first embodiment of the present invention enables a user US to experience the sensation of riding a bicycle in a virtual space, and includes a virtual reality experience control device CS and a simulated bicycle SM. The simulated bicycle SM has a frame equipped with handlebars and pedals mounted on a pair of bases corresponding to the front and rear wheels, and the user US experiences the sensation of riding a bicycle in the virtual space while riding the simulated bicycle SM.

[0017] The simulated bicycle SM is equipped with a sensor unit SS that detects the traveling speed and direction of travel. The sensor that detects the traveling speed, for example, uses a magnetic sensor to detect the number of pedal revolutions and converts the detected number of revolutions into data representing the traveling speed and outputs it. The sensor that detects the traveling direction, for example, uses an angle sensor attached to the handlebars to detect the operating angle and outputs the detected operating angle as data representing the traveling direction.

[0018] Instead of the simulated bicycle SM, a bicycle that runs on rollers, such as a room trainer, may be used. In this case, the running speed is measured by a speed sensor attached to the rear wheel or roller of the bicycle.

[0019] Meanwhile, around the simulated bicycle SM are arranged a video playback device PJ that plays virtual space images, a sound playback device SP that plays running sounds, and an environment reproduction device EV that reproduces the riding environment. The video playback device PJ is, for example, a video projector, and projects virtual space images in front of the user US. The sound playback device SP has, for example, multiple speakers arranged to surround the user US, and reproduces road noise during riding and sounds generated around the riding path. The environment reproduction device EV reproduces the riding environment, such as wind and vibrations, that the user US experiences while riding.

[0020] The video reproduction device PJ and the sound reproduction device SP may be built into an HMD (Head Mount Display). The environment reproduction device EV may be a smell, water vapor, or the like. In short, the environment reproduction device EV may be anything that allows the user to perceive the driving environment using the user's five senses, such as sight, hearing, touch, or smell.

[0021] (2) Virtual Reality Experience Control Device CS FIGS. 2 and 3 are block diagrams showing an example of the hardware configuration and software configuration of the virtual reality experience control device CS, respectively.

[0022] The virtual reality experience control device CS is, for example, a personal computer, and includes a control unit 1 that uses a hardware processor such as a central processing unit (CPU). A storage unit having a program storage unit 2 and a data storage unit 3, an input / output interface (hereinafter, interface will be abbreviated as I / F) unit 4, and a sensor I / F unit 5 are connected to the control unit 1 via a bus 6.

[0023] The sensor I / F section 5 is connected to the sensor unit SS, and receives the traveling speed data and traveling direction data output from the sensor unit SS.

[0024] The aforementioned video reproduction device PJ, sound reproduction device SP, and environment reproduction device EV are connected to the input / output I / F unit 4. The input / output I / F unit 4 outputs video data, running sound data, and running environment data contained in virtual space data generated by the control unit 1 (described later) to the video reproduction device PJ, sound reproduction device SP, and environment reproduction device EV, respectively.

[0025] An input device IN is connected to the input / output I / F unit 4. The input / output I / F unit 4 receives operation information such as an experience start / end request inputted to the input device IN and inputs it to the control unit 1. The input device IN may be provided with a display device for displaying the operating status of the system, etc.

[0026] The program storage unit 2 is configured by combining, for example, a nonvolatile memory such as a solid state drive (SSD) as a storage medium that can be written to and read from at any time, and a nonvolatile memory such as a read only memory (ROM), and stores application programs necessary for executing various processes according to the first embodiment, in addition to middleware such as an operating system (OS). Hereinafter, the OS and each application program will be collectively referred to as a program.

[0027] The data storage unit 3 is, for example, a combination of a non-volatile memory such as an SSD that can be written to and read from at any time as a storage medium, and a volatile memory such as a RAM (Random Access Memory), and its storage area includes a sensing data storage unit 31, a video space data storage unit 32, an acoustic space data storage unit 33, an environmental space data storage unit 34, and a virtual space data storage unit 35.

[0028] The sensing data storage unit 31 is used to temporarily store the traveling speed data and traveling direction data output from the sensor unit SS.

[0029] The video space data storage unit 32 stores video data of the real space recorded during a preliminary drive for each driving course that the user wishes to experience, in association with an address indicating the driving position and driving direction.

[0030] The acoustic space data storage unit 33 stores real space running sound data collected during a preliminary run for each of the above running courses, in association with addresses indicating the running position and running direction.

[0031] The environmental space data storage unit 34 stores driving environment data, such as wind and vibrations in the real space, measured during a preliminary drive for each of the driving courses, in association with addresses indicating the driving position and driving direction. Note that the environmental space data storage unit 34 may also store data generated by simulating the environment in the real space.

[0032] The virtual space data storage unit 35 temporarily stores the virtual space data generated by the control unit 1 during the driving experience until it is presented to the user US.

[0033] The control unit 1 includes a sensing data acquisition processing unit 11, a driving direction adjustment processing unit 12, a virtual space data generation processing unit 13, and a virtual space presentation processing unit 14 as processing functions necessary to implement the first embodiment of this invention.

[0034] These processing units 11 to 14 are all realized by causing a hardware processor in the control unit 1 to execute an application program stored in the program storage unit 2. Note that some or all of the processing units 11 to 14 may be realized using hardware such as an LSI (Large Scale Integration) or an ASIC (Application Specific Integrated Circuit).

[0035] The sensing data acquisition processing unit 11 acquires, at a predetermined sampling period, the running speed data and running direction data output from the sensor unit SS during the experience via the sensor I / F unit 5. Then, the acquired running speed data and running direction data are stored in the sensing data storage unit 31 in a state where they are associated in chronological order.

[0036] The driving direction adjustment processing unit 12 reads the driving speed data and driving direction data from the sensing data storage unit 31. Then, it calculates a moving average of the angle representing the driving direction for each driving speed range over a certain period of time.

[0037] The virtual space data generation processing unit 13 reads video data at the corresponding driving position from the video space data storage unit 32 based on the driving speed data read from the sensing data storage unit 31, and generates video data of the virtual space by changing the display orientation of the read video data in accordance with the moving average over a certain period of time of the angle representing the driving direction calculated by the driving direction adjustment processing unit 12.

[0038] Based on the driving speed data and driving direction data, the virtual space data generation processing unit 13 reads out driving sound data and driving environment data corresponding to the corresponding driving positions from the acoustic space data storage unit 33 and the environmental space data storage unit 34. The virtual space data generation processing unit 13 then generates virtual space data by combining the read driving sound data and driving environment data with the video data of the virtual space, and stores the generated virtual space data in the virtual space data storage unit 35.

[0039] The virtual space presentation processing unit 14 reads the virtual space data from the virtual space data storage unit 35 in chronological order, and outputs the virtual space video data, driving sound data, and driving environment data contained in the read virtual space data from the input / output I / F unit 4 to the video playback device PJ, the sound playback device SP, and the environment reproduction device EV, respectively.

[0040] (Example of Operation) Next, an example of operation of the virtual reality experience control device CS configured as above will be described.

[0041] FIG. 4 is a flowchart showing an example of the processing procedure and processing content of the control processing executed by the control unit 1 of the virtual reality experience control device CS.

[0042] When experiencing indoor cycling, the user US gets on the simulated bicycle SM and then operates the input device IN to input a request to start the experience to the virtual reality experience control device CS.

[0043] (1) Acquisition of Sensing Data When the user US starts riding the simulated bicycle SM, the sensor unit SS measures the riding speed V(t) and detects the riding direction angle θ(t) based on the handlebar angle. The detected riding speed data and riding direction data are then output to the virtual reality experience control device CS.

[0044] In response to this, when the control unit 1 of the virtual reality experience control device CS detects the input of the experience start request in step S10, it receives the running speed data and running direction data output from the sensor unit SS via the sensor I / F unit 5 under the control of the sensing data acquisition processing unit 11. Then, the sensing data acquisition processing unit 11 samples the received running speed data and running direction data at a predetermined sampling period, and then temporarily stores both data in the sensing data storage unit 31 in a state where they are associated in chronological order.

[0045] Thereafter, the sensing data acquisition processing unit 11 similarly continues the process of acquiring the traveling speed data and traveling direction data in step S20 until a request to end the experience is input in step S60.

[0046] (2) Adjustment of Driving Direction When the experience driving starts, the control unit 1 of the virtual reality experience control device CS then adjusts the driving direction in the virtual space in step S30 under the control of the driving direction adjustment processing unit 12 as follows.

[0047] FIG. 5 is a flowchart showing an example of the processing procedure and processing content of the traveling direction adjustment processing executed by the traveling direction adjustment processing unit 12.

[0048] That is, in steps S31 and S32, the traveling direction adjustment processing unit 12 first reads the traveling speed data and traveling direction data from the sensing data storage unit 31. Next, in step S33, the traveling direction adjustment processing unit 12 compares the traveling speed V(t) represented by the read traveling speed data with a threshold value V to determine whether the traveling speed V(t) is equal to or greater than the threshold value V. That is, it determines whether the user US is traveling the simulated bicycle SM at a high speed or a low speed.

[0049] As a result of this determination, it is assumed that the traveling speed V(t) is less than the threshold value V. In this case, in step S34, the traveling direction adjustment processing unit 12 calculates a moving average of the traveling direction angle θ(t) represented by the read traveling direction data over the past t seconds, thereby calculating a moving average value θ(t) of the traveling direction angle θ(t) during low-speed traveling over t seconds.

[0050] On the other hand, if the traveling speed V(t) is equal to or greater than the threshold value V, in this case, the traveling direction adjustment processing unit 12 calculates, in step S35, a moving average of the traveling direction angle θ(t) represented by the traveling direction data over the past t seconds, thereby calculating the moving average value θ(t) of the traveling direction angle θ(t) during high-speed traveling over t seconds, where t>t.

[0051] (3) Generation of Virtual Space Data Next, in step S40, the control unit 1 of the virtual reality experience control device CS generates virtual space data under the control of the virtual space data generation processing unit 13 as follows.

[0052] FIG. 6 is a flowchart showing an example of the processing procedure and processing content of the virtual space data generation processing executed by the virtual space data generation processing unit 13.

[0053] That is, in step S41, the virtual space data generation processing unit 13 first generates video data of the virtual space corresponding to the traveling position and traveling direction that reflects the traveling speed V(t) and the moving average value θ1(t) or θ2(t) of the traveling direction.

[0054] More specifically, the virtual space data generation processing unit 13 accesses the image space data storage unit 32 using the travel position when traveling at the travel speed V(t) after starting travel as an address, thereby reading out image data for the travel position when traveling at the travel speed V(t). Then, image data is generated in which the display orientation of the read-out image data is changed in accordance with the moving average value θ(t) or θ(t) of the travel direction. Thus, image data corresponding to the travel position in the virtual space and the user's line of sight when the user US changes the travel direction angle θ(t) or θ(t) while traveling at the travel speed V(t) is generated.

[0055] Next, in step S42, the virtual space data generation processing unit 13 reads from the acoustic space data storage unit 33 and the environmental space data storage unit 34, respectively, running sound data and running environment data in the virtual space when the running direction is changed in accordance with the moving average value θ(t) or θ(t) while running at the running speed V(t). The running sound data and acoustic space data are read by accessing the acoustic space data storage unit 33 and the environmental space data storage unit 34 using the running position when running at the running speed V(t) and the moving average value θ(t) or θ(t) of the running direction as addresses, as in the case of the video data. Then, in step S43, the virtual space data generation processing unit 13 combines the read running sound data and running environment data with the virtual space video data to generate virtual space data, and temporarily stores the generated virtual space data in the virtual space data storage unit 35.

[0056] (4) Presentation of Virtual Space Data Next, in step S50, the control unit 1 of the virtual reality experience control device CS reads the virtual space data from the virtual space data storage unit 35 under the control of the virtual space presentation processing unit 14. Then, the virtual space presentation processing unit 14 outputs the virtual space video data, driving sound data, and driving environment data contained in the read virtual space data from the input / output I / F unit 4 to the video playback device PJ, the sound playback device SP, and the environment reproduction device EV, respectively.

[0057] As a result, the video playback device PJ presents to the user US an image corresponding to the driving position and line of sight in the virtual space, and also presents to the user US driving sounds corresponding to the driving position and line of sight in the virtual space, as well as information representing the driving environment such as wind and vibrations.

[0058] (Effects) As described above, in the first embodiment, based on the traveling speed V(t) and the traveling direction angle θ(t) acquired during the trial driving, a moving average θ1(t) or θ2(t) of the traveling direction angle θ(t) over a predetermined time t1 or t2 is calculated for a case where the traveling speed is low or high. Then, based on the traveling speed V(t) and the moving average θ1(t) or θ2(t) of the traveling direction angle θ(t), video data of a virtual space reflecting these is generated, and the generated video data of the virtual space is presented to the user US together with traveling sound data and traveling environment data corresponding to the traveling speed V(t) and the traveling direction moving average θ1(t) or θ2(t).

[0059] Therefore, it becomes possible to present to the user US a virtual space image in which the running position changes in response to the running speed V(t) and the display orientation changes in response to the moving average θ1(t) or θ2(t) of the running direction angle θ(t) over a predetermined time t1 or t2, along with the corresponding running sounds and running environment.

[0060] Furthermore, when the driving speed V(t) is slow, the time length for calculating the moving average of the driving direction angle θ(t) is set to a short t1, thereby speeding up the response speed of the display orientation of the virtual space image to steering wheel operation, while when the driving speed is fast, the time length for calculating the moving average of the driving direction angle θ(t) is set to a longer t2 than t1, thereby slowing down the response speed of the display orientation of the virtual space image to steering wheel operation.This makes it possible to express in virtual space the same sensation of the moment of inertia that occurs when changing driving direction in real space.

[0061] [Second embodiment] In a second embodiment of the present invention, when calculating a moving average of the angle of the traveling direction over a predetermined time period, a window function of a predetermined time length is set for each traveling speed band, and the angle of the traveling direction is multiplied by the window function to calculate a weighted moving average of the angle of the traveling direction.

[0062] In addition, in the second embodiment, except for the processing contents of the running direction adjustment processing unit 12 and the virtual space data generation processing unit 13, the other processing functions of the virtual reality experience control device CS are the same as those in the first embodiment, so the second embodiment will also be explained using Figure 3.

[0063] FIG. 7 is a flowchart showing an example of the processing procedure and processing content of the traveling direction adjustment processing executed by the traveling direction adjustment processing unit 12 in the second embodiment.

[0064] The driving direction adjustment processing unit 12 pre-sets window functions W1(t) and W2(t) of time lengths t1 and t2 corresponding to low-speed driving and high-speed driving, respectively. As the window functions W1(t) and W2(t), for example, a rectangular window that takes a simple moving average may be used, or other window functions such as a Hanning window or a Hamming window may be used.

[0065] The traveling direction adjustment processing unit 12 then reads the traveling speed data and the traveling direction data from the sensing data storage unit 31 in steps S31 and S32, respectively. Then, in step S33, the traveling speed V(t) represented by the read traveling speed data is compared with a threshold value V1 to determine whether the traveling speed V(t) is equal to or greater than the threshold value V1 or less.

[0066] As a result of the above comparison, if the traveling speed V(t) is less than the threshold value V, the traveling direction adjustment processing unit 12 determines that the vehicle is traveling at a low speed, and in step S34', calculates a weighted moving average θ(t)' of the traveling direction angle θ(t) corresponding to low speed traveling by multiplying the traveling direction angle θ(t) represented by the traveling direction data by a window function W(t) for low speed traveling.

[0067] On the other hand, if the traveling speed V(t) is equal to or greater than the threshold value V, the traveling direction adjustment processing unit 12 determines that the vehicle is traveling at high speed, and in step S35', calculates a weighted moving average θ(t)' of the traveling direction angle θ(t) corresponding to high speed traveling by multiplying the traveling direction angle θ(t) represented by the traveling direction data by a window function W(t) for high speed traveling.

[0068] The virtual space data generation processing unit 13 reads out from the image space data storage unit 32 image data corresponding to the driving position when driving at the above driving speed V(t), and generates image data to be displayed in virtual space by changing the display orientation of the read out image data in accordance with the weighted moving average θ1(t)' or θ2(t)' of the angle θ(t) of the above driving direction.

[0069] FIG. 8 is a flowchart showing an example of the processing procedure and processing content of the virtual space data generation processing executed by the virtual space data generation processing unit 13.

[0070] That is, in step S41', the virtual space data generation processing unit 13 accesses the image space data storage unit 32 using the driving position when driving at the driving speed V(t) as an address to read the corresponding image data. Then, the display orientation of the read image data is changed according to the weighted moving average value θ(t)' or θ(t)' of the driving direction angle to generate image data in the virtual space. In this way, image data corresponding to the driving position in the virtual space and the user's line of sight when the user US changes his or her driving direction while driving at the driving speed V(t) is generated.

[0071] Next, in step S42, the virtual space data generation processing unit 13 reads out from the acoustic space data storage unit 33 and the environmental space data storage unit 34 the running sound data and running environment data obtained when the running direction is changed in accordance with the moving average value θ(t)' or θ(t)' while running at the running speed V(t). As in the case of the video data, the running sound data and running environment data are read out by accessing the acoustic space data storage unit 33 and the environmental space data storage unit 34 using the running position when running at the running speed V(t) as an address. Then, in step S43, the virtual space data generation processing unit 13 combines the read running sound data and running environment data with the virtual space video data to generate virtual space data, and temporarily stores the generated virtual space data in the virtual space data storage unit 35.

[0072] The virtual space presentation processing unit 14 reads the synthesized virtual space data from the virtual space data storage unit 35 in real time, and outputs the virtual space video data, driving sound data, and driving environment data contained in the read virtual space data from the input / output I / F unit 4 to the video playback device PJ, the sound playback device SP, and the environment reproduction device EV, respectively.

[0073] As described above, in the second embodiment, when calculating the moving average over time of the traveling direction angle θ(t), if the vehicle is traveling at a low speed, the traveling direction angle θ(t) is multiplied by the window function W1(t) for low-speed traveling to calculate a weighted moving average θ1(t)' of the traveling direction angle θ(t) corresponding to low-speed traveling, while if the vehicle is traveling at a high speed, the traveling direction angle θ(t) is multiplied by the window function W2(t) for high-speed traveling to calculate a weighted moving average θ2(t)' of the traveling direction angle θ(t) corresponding to low-speed traveling.

[0074] Therefore, the response characteristics of the display orientation of the virtual space image in response to steering wheel operation change according to the weighted moving average θ(t)' or θ(t)' of the driving direction angle θ(t) calculated using the window function W(t) or W(t). Therefore, by appropriately setting the characteristics of the window functions W(t) and W(t) according to the characteristics of steering wheel operation, it is possible to express in the virtual space a sensation that is closer to the moment of inertia that acts when changing the driving direction in the real world.

[0075] In the first and second embodiments, the length of the time window for calculating the moving average of the angle of the traveling direction over a predetermined time period is set to a fixed value for low-speed traveling and for high-speed traveling, respectively. In contrast, in the third embodiment of the present invention, the length of the time window for calculating the moving average of the angle of the traveling direction over a predetermined time period is adaptively set to a variable value depending on the traveling speed at each time.

[0076] In the third embodiment, the other processing functions of the virtual reality experience control device CS are the same as those in the first embodiment, except for the processing contents of the running direction adjustment processing unit 12 and the virtual space data generation processing unit 13, so this embodiment will also be explained using Figure 3.

[0077] FIG. 9 is a flowchart showing an example of the processing procedure and processing content of the traveling direction adjustment processing executed by the traveling direction adjustment processing unit 12 in the third embodiment.

[0078] The traveling direction adjustment processing unit 12 reads the traveling speed data and the traveling direction data at predetermined time intervals from the sensing data storage unit 31 in steps S31 and S32, respectively. Then, every time the traveling speed data is read, the traveling direction adjustment processing unit 12 calculates in step S36 a window function width Tw(V(t)) corresponding to the traveling speed V(t) represented by the traveling speed data. Here, Tw is a monotonically increasing function of V(t).

[0079] Subsequently, in step S37, the traveling direction adjustment processing unit 12 multiplies the traveling direction angle θ(t) represented by the traveling direction data by a window function Wtw(t) having the time width Tw(V(t)) calculated according to the traveling speed V(t), thereby calculating a weighted moving average θout(t) of the traveling direction angle θ(t) corresponding to the traveling speed V(t) at each moment.

[0080] The virtual space data generation processing unit 13 reads out from the image space data storage unit 32 image data corresponding to the traveling position when traveling at the traveling speed V(t), and generates image data of the virtual space by changing the display direction of the read out image data in accordance with the weighted moving average θout(t) of the angle θ(t) of the traveling direction calculated using a window function Wtw(t) having a time width Tw(V(t)) corresponding to the traveling speed V(t).

[0081] FIG. 10 is a flowchart showing an example of the processing procedure and processing content of the virtual space data generation processing executed by the virtual space data generation processing unit 13.

[0082] That is, in step S44, the virtual space data generation processing unit 13 reads from the image space data storage unit 32 image data corresponding to the traveling position when traveling at the traveling speed V(t). Then, image data is generated in which the display orientation of the read image data is changed according to the weighted moving average value θout(t) of the traveling direction. Thus, when the user US changes the traveling direction while traveling at the traveling speed V(t), image data is generated in which these are reflected in the traveling position in the virtual space and the user's line of sight direction.

[0083] Next, in step S42, the virtual space data generation processing unit 13 reads out the running sound data and running environment data in the virtual space when the running direction is changed in accordance with the moving average value θout(t) while running at the running speed V(t) from the acoustic space data storage unit 33 and the environmental space data storage unit 34, respectively. Then, in step S43, the virtual space data generation processing unit 13 combines the read running sound data and running environment data with the virtual space video data to generate virtual space data, and temporarily stores the generated virtual space data in the virtual space data storage unit 35.

[0084] The virtual space presentation processing unit 14 reads out virtual space data from the virtual space data storage unit 35, and outputs the virtual space video data, driving sound data, and driving environment data contained in the read out virtual space data from the input / output I / F unit 4 to the video playback device PJ, the sound playback device SP, and the environment reproduction device EV, respectively.

[0085] As described above, in the third embodiment, the window function width Tw(V(t)) corresponding to the traveling speed V(t) at each time is calculated, and the traveling direction angle θ(t) is multiplied by the window function Wtw(t) having the time width Tw(V(t)), thereby calculating the weighted moving average θout(t) of the traveling direction angle θ(t) corresponding to the traveling speed V(t) at that time.

[0086] Therefore, the response characteristics of the display orientation of the virtual space image in response to steering wheel operation change according to the weighted moving average θout(t) calculated using a window function Wtw(t) in which a time width Tw(V(t)) is set according to the current driving speed V(t). Therefore, the display orientation of the virtual space image is variably controlled according to the characteristics reflecting the optimal weighted moving average θout(t) set according to the current driving speed V(t). Therefore, it is possible to express in the virtual space a sensation similar to the moment of inertia that occurs when changing the driving direction in real space, taking into account the current driving speed.

[0087] [Other Embodiments] (1) In the first and second embodiments, two times t1 and t2 are provided as time lengths for calculating the moving average of the steering wheel operating angle θ(t), one for low-speed driving and one for high-speed driving. However, the number of times is not necessarily limited to two, and three or more times may be set corresponding to the driving speed ranges. In this case, it is possible not to calculate the moving average of the angle θ(t) of the moving direction in the slowest speed range.

[0088] (2) In the first and second embodiments, when the traveling speed V(t) is low, that is, less than the threshold value V, a moving average of the traveling direction angle θ(t) over the past t seconds is calculated. When the traveling speed V(t) is high, that is, equal to or greater than V, a moving average of the traveling direction angle θ(t) over the past t seconds is calculated.

[0089] However, the traveling direction adjustment processing unit 12 may constantly calculate both a moving average θ1(t) of the traveling direction angle θ(t) over the past t1 seconds and a moving average θ2(t) over the past t2 seconds. The traveling speed V(t) acquired in this state may then be compared with a threshold value V1, and if the traveling speed V(t) is less than the threshold value V1, the moving average θ1(t) corresponding to low-speed traveling may be selected and output, and if the traveling speed V(t) is equal to or greater than the threshold value V1, the moving average θ2(t) corresponding to high-speed traveling may be selected and output.

[0090] (3) In each of the first to third embodiments, the virtual reality experience control device CS is provided in a personal computer, but it may also be provided in a server computer installed on the web or in the cloud. Furthermore, the processing functions of the virtual reality experience control device CS may be distributed across multiple information processing devices.

[0091] (4) In each of the first to third embodiments, the example of experiencing riding a bicycle in a virtual space has been described. However, other moving objects may be used, such as motorcycles, four-wheeled automobiles, trains, aircraft, and ships (including yachts and windsurfing boats). Various modifications may be made to the processing functions, processing procedures, and processing contents of the virtual reality experience control device CS, as well as the types of moving objects, without departing from the spirit and scope of the present invention.

[0092] Although the embodiments of the present invention have been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, when implementing the present invention, specific configurations according to the embodiments may be appropriately adopted.

[0093] In short, this invention is not limited to the above-described embodiments, and in the implementation stage, the components can be modified and embodied without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments. For example, some components may be omitted from all the components shown in the embodiments. Furthermore, components from different embodiments may be appropriately combined.

[0094] CS...Virtual reality experience control device SM...Simulated bicycle SS...Sensor unit IN...Input device PJ...Video playback device SP...Sound playback device EV...Environment reproduction device 1...Control unit 2...Program memory unit 3...Data memory unit 4...Input / output I / F unit 5...Sensor I / F unit 6...Bus 11...Sensing data acquisition processing unit 12...Traveling direction adjustment processing unit 13...Virtual space data generation processing unit 14...Virtual space presentation processing unit 31...Sensing data memory unit 32...Video space data memory unit 33...Sound space data memory unit 34...Environment space data memory unit 35...Virtual space data memory unit

Claims

1. A virtual reality experience control device that presents a user with the sensation of moving on a moving object in a virtual space, comprising: a first processing unit that acquires information representing the moving speed and direction of the moving object; a second processing unit that calculates a moving average of an angle indicating the moving direction over a predetermined period of time; a third processing unit that generates video data that reflects the moving position and line of sight direction in the virtual space based on the moving average of the moving speed and the angle of the moving direction; and a fourth processing unit that presents the generated video data to the user.

2. The virtual reality experience control device described in claim 1, wherein the second processing unit divides the movement speed into a plurality of speed bands, sets the time width of the specified time for each speed band, and calculates the moving average by averaging the angle indicating the movement direction over the specified time having a time width corresponding to the acquired movement speed.

3. The virtual reality experience control device described in claim 1, wherein the second processing unit divides the movement speed into a plurality of speed bands, sets a window function having a predetermined time width for each speed band, and calculates the moving average weighted by the window function by multiplying the angle indicating the movement direction by the window function having the time width corresponding to the speed band of the acquired movement speed.

4. The virtual reality experience control device described in claim 1, wherein the second processing unit calculates a window function having a time width corresponding to the acquired movement speed, and calculates the moving average weighted by the window function by multiplying the angle indicating the movement direction by the window function having the calculated time width.

5. A virtual reality experience control method in which an information processing device executes a process of presenting to a user in a virtual space the sensation of moving by a moving object, the method comprising the steps of: acquiring information representing the moving speed and direction of movement of the moving object; calculating a moving average of an angle indicating the moving direction over a predetermined period of time; generating video data in which the moving average of the moving speed and the angle of the moving direction is reflected in the moving position and line of sight direction in the virtual space; and presenting the generated video data to the user.

6. A program that causes a processor provided in a virtual reality experience control device to execute at least one of the processes performed by the first processing unit, the second processing unit, the third processing unit, and the fourth processing unit provided in a virtual reality experience control device described in any one of claims 1 to 4.

Images