Virtual experience delivery system, virtual experience delivery method, and program

The virtual experience system improves entertainment and realism by integrating user-operated rideable vehicles with omnidirectional wheels and event-driven commands, addressing the limitations of conventional systems in handling user center of gravity shifts and virtual events.

JP2026069263APending Publication Date: 2026-04-23HONDA MOTOR CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
HONDA MOTOR CO LTD
Filing Date
2024-10-11
Publication Date
2026-04-23

AI Technical Summary

Technical Problem

Conventional virtual experience systems lack sufficient enhancement in entertainment and realism, particularly when events such as rough roads or collisions occur, leading to suboptimal integration of user center of gravity shifts and vehicle movements.

Method used

A virtual experience system that generates and prioritizes movement commands based on both user operation and predetermined events, using a rideable vehicle with omnidirectional wheels and sensors to enhance realism and entertainment by integrating user input with predefined virtual events.

Benefits of technology

Enhances the entertainment value and sense of presence in virtual spaces by prioritizing movement commands based on predefined events, ensuring smoother integration of user interactions and virtual environment responses.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026069263000001_ABST
    Figure 2026069263000001_ABST
Patent Text Reader

Abstract

To further enhance the entertainment value and sense of realism of virtual spaces. [Solution] The virtual experience provision system of the embodiment allows a user riding in a rideable vehicle to experience a virtual space. The virtual experience provision system generates a first movement command based on the user's operation of the rideable vehicle, determines whether a predetermined event has occurred in the virtual space, and if the predetermined event has occurred, generates a predetermined second movement command according to the predetermined event, and moves the rideable vehicle based on one of a plurality of movement commands, including the first movement command and the second movement command. Furthermore, if both the first movement command and the second movement command have been generated, the virtual experience provision system prioritizes moving the rideable vehicle based on the second movement command over moving the rideable vehicle based on the first movement command.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a virtual experience providing system, a virtual experience providing method, and a program.

Background Art

[0002] A technique for moving a riding mobile body by shifting the center of gravity of a user is known (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional technology, in a virtual space, when an event such as reaching a rough road or an uphill or colliding with another user occurs, while prioritizing the movement by shifting the center of gravity of the user, acceleration, deceleration, etc. are performed according to the event. However, in the conventional technology, there is room for further improving the entertainment and realism of the virtual space.

[0005] Aspects of the present invention have been made in consideration of such circumstances, and an object thereof is to provide a virtual experience providing system, a virtual experience providing method, and a program that can further improve the entertainment and realism of a virtual space.

Means for Solving the Problems

[0006] The virtual experience providing system, the virtual experience providing method, and the program according to this invention employ the following configurations. (1) A first aspect of the present invention is a virtual experience provision system that allows a user riding in a rideable vehicle to experience a virtual space, comprising: a first generation unit that generates a first movement command, which is a command for moving the rideable vehicle, based on the user's operation of the rideable vehicle; a determination unit that determines whether or not a predetermined event has occurred in the virtual space; a second generation unit that, if the predetermined event has occurred, generates a second movement command, which is a command predetermined in accordance with the predetermined event and is a command for moving the rideable vehicle; and a vehicle control unit that moves the rideable vehicle based on any one of a plurality of movement commands, including the first movement command and the second movement command, wherein, if both the first movement command and the second movement command have been generated, the vehicle control unit prioritizes moving the rideable vehicle based on the second movement command over moving the rideable vehicle based on the first movement command.

[0007] (2) A second aspect of the present invention is that, in the first aspect, the predetermined event includes the rideable vehicle and / or the user coming into contact with a predetermined object in the virtual space.

[0008] (3) A third aspect of the present invention is that, in the first or second aspect, the predetermined event includes the rideable vehicle and / or the user reaching a predetermined location in the virtual space.

[0009] (4) A fourth aspect of the present invention is that, in the first or second aspect, the operation is performed by shifting the user's center of gravity, and the first generation unit generates the first movement command based on the shifting of the center of gravity detected by a sensor mounted on the rideable mobile body.

[0010] (5) A fifth aspect of the present invention is, in the first or second aspect, the first generation unit, in addition to generating the first movement command based on the control operation, further generates a balance control command, which is a command for controlling the attitude of the rideable mobile body, based on the control operation, and the mobile body control unit, when the first movement command, the second movement command, and the balance control command are generated, moves the rideable mobile body based on the second movement command, and further controls the attitude of the rideable mobile body based on the balance control command.

[0011] (6) A sixth aspect of the present invention is a virtual experience provision method using a virtual experience provision system that allows a user riding in a rideable vehicle to experience a virtual space, the method comprising: generating a first movement command, which is a command to move the rideable vehicle, based on the user's operation of the rideable vehicle; determining whether or not a predetermined event has occurred in the virtual space; if the predetermined event has occurred, generating a second movement command, which is a command predetermined in accordance with the predetermined event and is a command to move the rideable vehicle; moving the rideable vehicle based on any one of a plurality of movement commands, including the first movement command and the second movement command; and if both the first movement command and the second movement command have been generated, prioritizing moving the rideable vehicle based on the second movement command over moving the rideable vehicle based on the first movement command.

[0012] (7) A seventh aspect of the present invention is a program to be executed by a computer of a virtual experience provision system that allows a user riding in a rideable vehicle to experience a virtual space, the program comprising: generating a first movement command, which is a command to move the rideable vehicle, based on the user's operation of the rideable vehicle; determining whether a predetermined event has occurred in the virtual space; if the predetermined event has occurred, generating a second movement command, which is a command predetermined in accordance with the predetermined event and is a command to move the rideable vehicle; moving the rideable vehicle based on any one of a plurality of movement commands, including the first movement command and the second movement command; and if both the first movement command and the second movement command have been generated, prioritizing moving the rideable vehicle based on the second movement command over moving the rideable vehicle based on the first movement command. [Effects of the Invention]

[0013] According to the above embodiment, the entertainment value and sense of presence of the virtual space can be further enhanced. [Brief explanation of the drawing]

[0014] [Figure 1] This is a diagram showing the configuration of the virtual experience provision system 1 of the embodiment. [Figure 2] This diagram illustrates the configuration and operation of the omnidirectional wheels 120 of the rideable mobile vehicle 100. [Figure 3] This is a diagram showing the configuration of the rideable mobile body 100 according to the embodiment. [Figure 4] This is a configuration diagram of the content control device 300 according to the embodiment. [Figure 5] This is a flowchart illustrating the sequence of processes performed by the virtual experience provisioning system 1 of the embodiment. [Figure 6] This is a diagram illustrating an example of a predetermined event. [Figure 7] This is a diagram illustrating an example of a predetermined event. [Figure 8]It is a diagram showing an example of a predetermined event. [Figure 9] It is a diagram showing an example of a predetermined event. [Figure 10] It is a diagram showing an example of a predetermined event. [Figure 11] It is a diagram showing an example of a predetermined event. [Figure 12] It is a diagram showing an example of a predetermined event. [Figure 13] It is a diagram showing an example of a predetermined event.

Embodiments for Carrying Out the Invention

[0015] Hereinafter, with reference to the drawings, embodiments of a virtual experience providing system, a virtual experience providing method, and a program according to the present invention will be described. The virtual experience providing system is, for example, a system that provides a virtual experience using a vehicle-type moving body on which a user rides. The virtual experience providing system provides a virtual experience as a service to a user within a virtual space representing the real world or an imaginary world. In the virtual experience providing system, for example, a virtual experience such as a game world separated from reality can be provided. This service is provided, for example, in a virtual experience facility. The virtual space experience is, for example, an experience in which a user participates in a game as a player within the game. The virtual experience facility is, for example, a facility having a traveling space in which a vehicle-type moving body travels. Hereinafter, the virtual experience may be referred to as content, and the user who experiences a game as a player within the virtual space may be referred to as an avatar for explanation.

[0016] [Virtual Experience Providing System] Figure 1 is a configuration diagram of a virtual experience provision system 1 of an embodiment. The virtual experience provision system 1 includes, for example, a rideable mobile body 100, a head-mounted display 200, and a content control device 300. At least the rideable mobile body 100 and the content control device 300, and the head-mounted display 200 and the content control device 300 are capable of communicating wirelessly or by other means. The rideable mobile body 100 includes a base 110 and omnidirectional wheels 120.

[0017] In this embodiment, the rideable mobile device 100 is controlled to automatically move in accordance with the progression of content provided by, for example, the head-mounted display 200. The rideable mobile device 100 also moves through balance control in response to steering operations caused by the user P's shift in center of gravity. In other words, the rideable mobile device 100 moves in accordance with both the progression of the content and the user P's shift in center of gravity. It is preferable that the content has a degree of freedom that allows for movement at the user P's discretion. For example, it is preferable that the rideable mobile device 100 has a degree of freedom such that if the user P performs a steering operation indicating the intention to "reverse" in a scene where the user P should move forward in the content flow, the rideable mobile device 100 will decelerate or stop, and if the user P performs a steering operation indicating the intention to "turn left or right," the rideable mobile device 100 will deviate to a side path.

[0018] The head-mounted display 200 is, for example, a VR (Virtual Reality) goggle. The head-mounted display 200 receives data for displaying virtual reality images (hereinafter referred to as content data) from the content control device 300 and displays the virtual reality images. The head-mounted display 200 may also be an MR (Mixed Reality) goggle or an AR (Augmented Reality) goggle. The method of implementing the head-mounted display 200 is not limited to a specific method, as long as it allows the user P to perceive a similar sensation. For example, the projection method of the head-mounted display 200 may be a retinal projection method, a virtual image projection method, or any other method. Also, for example, the head-mounted display 200 may be an open type or an occluded type.

[0019] The content control device 300 generates content data and transmits it to the head-mounted display 200. The content control device 300 instructs the rideable mobile device 100 to operate in synchronization with the virtual reality image displayed on the head-mounted display 200. In this way, the rideable mobile device 100 can be operated in conjunction with the virtual reality image displayed on the head-mounted display 200, and user P can have a virtual experience as a player in the virtual reality image. The content control device 300 may be installed in a virtual experience facility, or it may be a cloud server that communicates via a network such as the internet. Alternatively, the content control device 300 may be implemented as an application program executed by user P's terminal device (e.g., a smartphone).

[0020] [Piloted vehicle] Figure 2 is a diagram illustrating the configuration and operation of the omnidirectional wheels 120 of the rideable mobile vehicle 100. The omnidirectional wheels 120 are wheels that enable the vehicle to immediately move in any direction (360 degrees) from its current position without performing any preparatory movements such as turning. The omnidirectional wheels 120 include, for example, a large-diameter wheel 120A as the front wheel and a turning wheel 120C as the rear wheel, and multiple small-diameter wheels 120B are provided on the contact area (radial edge) of the large-diameter wheel 120A. The large-diameter wheel 120A is a wheel that mainly enables straight-line movement in the forward and backward direction. The small-diameter wheels 120B are wheels that mainly enable lateral movement in place by rotating around the rotation direction (circumferential direction) of the large-diameter wheel 120A as an axis. On the other hand, the rear swivel wheel 120C has a smaller diameter than the large-diameter wheel 120A and rotates on an axis perpendicular to the rotation axis of the large-diameter wheel 120A, primarily enabling swivel movement. The omnidirectional wheel 120 is equipped with motors (not shown) that can independently control the rotation of the large-diameter wheel 120A, the small-diameter wheel 120B, and the swivel wheel 120C. With this configuration, the omnidirectional wheel 120 can move not only in various directions such as directly to the side or diagonally, but also nimbly move such as turning and turning in place, by utilizing the difference in lateral movement speed between the front and rear wheels, in addition to forward and backward movement.

[0021] Here, the forward direction of the rideable mobile body 100 is the positive y-axis direction in Figure 1 (the direction from the back of the page to the front of the page, hereinafter referred to as the +y-axis direction), and the backward direction is the negative y-axis direction (the direction from the front of the page to the back of the page, hereinafter referred to as the -y-axis direction). For example, as shown in the operation example M1 (forward / reverse) in Figure 2, the omnidirectional mobile wheel 120 moves forward by rotating the large-diameter wheel 120A in the direction of arrow A1, and moves backward by rotating it in the direction of arrow A2.

[0022] Furthermore, as shown in the operation example M2 (left-right movement) in Figure 2, the omnidirectional wheel 120 can move to the left in place without changing direction by rotating the small-diameter wheel 120B in the direction of arrow A3. In this case, the swivel wheel 120C may be configured to rotate naturally in the direction of arrow A4 in accordance with the left-right movement, or it may be controlled to rotate in the direction of arrow A4 in accordance with the amount of rotation of the small-diameter wheel 120B. Also, the omnidirectional wheel 120 can move to the right in place without changing direction by rotating the small-diameter wheel 120B in the opposite direction to arrow A3. Note that the left direction here is the left direction in Figure 1 and corresponds to the negative direction of the x-axis (-x-axis direction), and the right direction is the right direction in Figure 1 and corresponds to the positive direction of the x-axis (+x-axis direction). Note that the multiple small-diameter wheels 120B may be configured so that all wheels rotate simultaneously, or only the wheels at the contact point with the ground may rotate.

[0023] As shown in the operation example M3 (turning in place) in Figure 2, the omnidirectional wheel 120 can turn in place in the direction of arrow A6 around the contact point P1 of the large-diameter wheel 120A by rotating the turning wheel 120C in the direction of arrow A5, and can turn in place in the opposite direction to arrow A6 by rotating it in the opposite direction to arrow A5.

[0024] As shown in the operation example M4 (turning movement) in Figure 2, the omnidirectional wheel 120 can move forward while turning in the direction of arrow A9 by rotating the large-diameter wheel 120A in the direction of arrow A7 and the turning wheel 120C in the direction of arrow A8 (turning movement). The omnidirectional wheel 120 can also move backward while turning in the opposite direction of arrow A9 by rotating the large-diameter wheel 120A in the opposite direction of arrow A7 and rotating the turning wheel 120C in the direction of arrow A8. In this example, the omnidirectional wheel 120 can move forward or backward with the turning center to the right by rotating the turning wheel 120C in the opposite direction of arrow A8.

[0025] The method for realizing the omnidirectional wheels 120 is not limited to the method shown in Figure 2. The omnidirectional wheels 120 may be realized using any existing technology. Furthermore, the rideable mobile body 100 may be equipped with one omnidirectional wheel 120 or multiple omnidirectional wheels 120. In addition, the rideable mobile body 100 may be equipped with conventional wheels as auxiliary wheels in addition to the omnidirectional wheels 120. The operation of the omnidirectional wheels 120 is controlled by a control unit (not shown) mounted on the rideable mobile body 100 (for example, installed inside the seat section 21), and the control unit changes the operation of the omnidirectional wheels 120 (direction of movement and speed) based on control signals input from the content control device 300.

[0026] Figure 3 is a diagram of the configuration of the rideable mobile body 100 according to the embodiment. The rideable mobile body 100 includes, for example, a communication device 130, a sensor 140, and a control device 150 within a base body 110. The base body 110 is provided with a seat 180. The communication device 130 communicates with the content control device 300. The communication device 130 performs wireless communication based on, for example, Wi-Fi, DSRC (Dedicated Short Range Communication), Bluetooth (registered trademark), or other communication standards. The communication device 130 periodically transmits the amount of movement and position of the rideable mobile body 100, controlled by the control device 150, to the content control device 300.

[0027] The sensor 140 includes, for example, an acceleration sensor 142 and an angular velocity sensor 144. The acceleration sensor 142 is attached to one or more arbitrary locations on the base 110 or the seating portion 180, and detects the acceleration acting on the attachment location and outputs it to the control device 150. Similarly, the angular velocity sensor 144 is attached to one or more arbitrary locations on the base 110 or the seating portion 180, and detects the angular velocity acting on the attachment location and outputs it to the control device 150.

[0028] The control device 150 includes, for example, a center of gravity estimation unit 152, a center of gravity movement command generation unit 154, a balance control command generation unit 156, and a motor control unit 158. These components are realized, for example, by a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Processing Unit), or SOC (System On Chip), or by the cooperation of software and hardware. The program may be stored in advance in a storage device such as an HDD (Hard Disk Drive) or flash memory (a storage device with a non-transient storage medium), or it may be stored in a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium) and installed in the storage device when the storage medium is mounted in a drive device.

[0029] The components of the control device 150 will be described after the functions of the content control device 300 have been explained.

[0030] [Content control device] Figure 4 is a configuration diagram of the content control device 300 according to the embodiment. The content control device 300 includes, for example, a communication device 310, a processing device 320, and a storage unit 330.

[0031] The communication device 310 communicates with the rideable mobile body 100 and with the head-mounted display 200. Alternatively, the communication device may be integrated into either the rideable mobile body 100 or the head-mounted display 200, and the rideable mobile body 100 may, for example, transfer information received from the content control device 300 to the head-mounted display 200 via wired or wireless connection as appropriate.

[0032] The processing unit 320 includes, for example, a content provision unit 322, an event occurrence determination unit 324, and an event action command generation unit 326. These components are realized, for example, by a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, GPU, or SOC, or by the cooperation of software and hardware. The program may be stored in advance in a storage device such as an HDD or flash memory (a storage device with a non-transient storage medium), or it may be stored in a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium) and installed in the storage device when the storage medium is mounted in a drive device.

[0033] The storage unit 330 is, for example, an HDD or flash memory. The storage unit 330 stores content data 332. The content data 332 includes map information of the virtual space (including the positions of virtually existing objects), basic movement information that defines the direction and speed at which user P and the rideable mobile device 100 should move in the virtual space as time progresses, the types of events that occur as time progresses, and the types of events that occur depending on the position where user P and the rideable mobile device 100 are located in the virtual space (calculated by obtaining information from the rideable mobile device 100 as described above).

[0034] The content provider unit 322 transmits the content data 332 to the head-mounted display 200 using the communication device 310. The content data may include audio data in addition to video data.

[0035] The event occurrence determination unit 324 determines whether or not a predetermined event has occurred in the virtual space. The event occurrence determination unit 324 is an example of a "determination unit".

[0036] A predetermined event is one in which the conditions for occurrence are set in advance so that it occurs based on the environment in which the ridden mobile object is placed in the virtual space (typically meaning location, elapsed time, or a combination thereof).

[0037] For example, a predetermined event may include the avatar of user P, who is riding in the rideable mobile device 100, coming into contact with a predetermined object in the virtual space, or the avatar reaching a predetermined location in the virtual space.

[0038] In other words, the event occurrence determination unit 324 may determine that a predetermined event has occurred in the virtual space if the user P's avatar comes into contact with a predetermined object in the virtual space, or if the user P's avatar reaches a predetermined location in the virtual space.

[0039] The event action command generation unit 326 generates a command (hereinafter referred to as an event action command) corresponding to the type of predetermined event when it determines that a predetermined event has occurred in the virtual space. The event action command generation unit 326 is an example of a "second generation unit," and the event action command is an example of a "second movement command."

[0040] An event action command is a command to move the rideable mobile device 100 in the forward / backward direction, left / right direction, and / or in the turning direction (rotation direction), or to temporarily suspend such movement, in order to notify the user P that a predetermined event has occurred.

[0041] The event action command generation unit 326 transmits the event action command to the rideable mobile unit 100 using the communication device 310.

[0042] The functions of each part of the control device 150 of the rideable mobile body 100 will be explained below. The center of gravity estimation unit 152 estimates the center of gravity of the object, including the user P, the base 110, and the seating unit 180, based on the outputs of the acceleration sensor 142 and the angular velocity sensor 144.

[0043] The center of gravity movement command generation unit 154 generates a command (hereinafter referred to as the "center of gravity movement command") for moving the rideable mobile body 100 based on the center of gravity estimated by the center of gravity estimation unit 152. The center of gravity movement command generation unit 154 and the balance control command generation unit 156, which will be described later, together constitute an example of the "first generation unit." The center of gravity movement command is an example of the "first movement command."

[0044] The center of gravity movement command is a command to move the rideable mobile body 100 in the forward / backward direction, left / right direction, and / or in the turning direction (rotation direction), or to temporarily suspend such movement.

[0045] The balance control command generation unit 156 generates a balance control command based on the center of gravity estimated by the center of gravity estimation unit 152.

[0046] The balance control command is a command for controlling the attitude of the rideable mobile unit 100.

[0047] For example, the balance control command generation unit 156 generates a balance control command to return the position of the center of gravity estimated by the center of gravity estimation unit 152 back to the reference position (the position of the center of gravity in a stationary state). For example, if the position of the center of gravity is deviated to the right and rearward from the reference position, the balance control command generation unit 156 generates a balance control command that instructs acceleration toward the right and rearward.

[0048] Furthermore, the balance control command generation unit 156 may generate balance control commands to control the posture of the rideable mobile body 100 so that it does not tip over when the rideable mobile body 100 moves or stops in response to an event action command.

[0049] For example, if the event action command is accelerated forward and the center of gravity is behind the reference position, the balance control command generation unit 156 may generate a balance control command that suppresses acceleration or causes the vehicle to move backward once to guide the center of gravity forward before starting accelerated forward, so as not to cause the center of gravity to shift further backward due to accelerated forward movement.

[0050] The motor control unit 158 ​​individually controls each motor attached to the omnidirectional wheels 120 based on one of several movement commands, including a center of gravity movement command and an event action command. When the motors are controlled based on a center of gravity movement command, user P can move the rideable mobile body 100 in a desired direction by changing the center of gravity in the desired direction through a change in their own posture. In other words, the rideable mobile body 100 recognizes user P's center of gravity movement as a control operation directed at the rideable mobile body 100 and performs a movement operation in accordance with the control operation.

[0051] Furthermore, the motor control unit 158 ​​may individually control each motor attached to the omnidirectional wheels 120 based on balance control commands. This controls the attitude of the rideable mobile body 100. The motor control unit 158 ​​and the motors attached to the omnidirectional wheels 120 together constitute an example of a "mobile body control unit".

[0052] [Processing flow of the virtual experience delivery system] The following describes the flow of processing by the virtual experience provision system 1 using a flowchart. Figure 5 is a flowchart showing the flow of processing by the virtual experience provision system 1 of this embodiment. The processing in this flowchart is performed, for example, when a virtual space experience is provided to a user P who is riding a rideable mobile device 100 and wearing a head-mounted display 200 within a virtual experience facility. In other words, the processing in this flowchart may be performed when a game is started in the virtual space.

[0053] First, the center of gravity movement command generation unit 154 generates a center of gravity movement command in accordance with the center of gravity movement of the user P who is riding on the rideable mobile body 100 (step S100). At this time, the balance control command generation unit 156 generates a balance control command in accordance with the center of gravity movement of the user P.

[0054] As described above, the center of gravity movement command is a command to move the rideable mobile body 100 in the forward / backward direction, left / right direction, and / or in the turning direction (rotation direction), or to temporarily suspend such movement, while the balance control command is a command to control the attitude of the rideable mobile body 100.

[0055] Next, the motor control unit 158 ​​controls the motors of the omnidirectional wheels 120 based on the center of gravity movement command and the balance control command. As a result, the rideable mobile body 100 moves in the forward / backward, left / right, and / or turning directions based on the movement control command, and its posture is controlled based on the balance control command (step S102).

[0056] Next, the event occurrence determination unit 324 determines whether a predetermined event has occurred in the virtual space while the rideable mobile body 100 is moving within the virtual experience facility based on the center of gravity movement command (step S104).

[0057] If the specified event has not occurred, processing returns to S100. As a result, the rideable mobile unit 100 continues to be controlled by the user P's shift in center of gravity.

[0058] On the other hand, when a predetermined event occurs, the event action command generation unit 326 generates an event action command corresponding to the type of predetermined event (step S106). The event action command generation unit 326 then transmits the event action command to the rideable mobile unit 100 using the communication device 310.

[0059] Next, when the communication device 130 receives an event action command from the content control device 300, the motor control unit 158 ​​controls the motors of the omnidirectional wheels 120 based on the event action command. As a result, the rideable mobile body 100 moves in the forward / backward direction, left / right direction, and / or in the turning direction based on the event action command (step S108).

[0060] While the rideable mobile device 100 is being controlled based on an event action command, the center of gravity of the user P riding in the rideable mobile device 100 may also shift. In other words, in addition to the event action command, a center of gravity shift command and a balance control command may be generated.

[0061] In such a case, the motor control unit 158 ​​prioritizes moving the rideable mobile body 100 based on an event action command over moving the rideable mobile body 100 based on a center of gravity movement command, in order to mediate between the two types of movement commands.

[0062] In this case, the motor control unit 158 ​​may use a balance control command to control the posture of the rideable mobile body 100 while it is moving based on an event action command. This makes it possible to prevent the rideable mobile body 100 from tipping over or to adjust the posture of the user P riding on the rideable mobile body 100 when the rideable mobile body 100 is moving in response to the occurrence of a predetermined event.

[0063] Next, the content control device 300 determines whether the virtual space experience has ended (step S110). If the virtual space experience has not ended, it returns to S104 and continues to provide the user P with the virtual space experience using the head-mounted display 200 and the rideable mobile device 100.

[0064] On the other hand, if the virtual reality experience ends, the process in this flowchart will terminate.

[0065] [Examples of specified events] Below, we will explain an example of a predetermined event, referring to several figures. Figures 6 to 13 are diagrams that illustrate an example of a predetermined event.

[0066] In the example in Figure 6, an object OB1 representing a thunderstorm appears in the virtual space. As shown in Figure 7, suppose that user P's avatar A reaches the area R in front of object OB1 in the virtual space where object OB1 has appeared. In such a case, it is determined that a predetermined event has occurred, and an event action command (e.g., pause) corresponding to object OB1 is generated. As a result, the rideable mobile device 100 will stop in place, even if user P's center of gravity shifts.

[0067] In the example shown in Figure 8, an object OB2 representing a spiderweb appears in the virtual space. In this case, suppose avatar A touches object OB2 in the virtual space or reaches the area R directly below object OB2. In this case, as shown in Figure 9, it is determined that a predetermined event has occurred, and an event action command (e.g., rotation) corresponding to object OB2 is generated. As a result, the rideable mobile device 100 rotates in place, even if the user P's center of gravity shifts. This allows user P to have a virtual experience of being entangled in a spiderweb.

[0068] In the example shown in Figure 10, an object OB3 representing a river appears in the virtual space. In this case, suppose avatar A touches object OB3 in the virtual space or reaches the region R where object OB3 was created. In this case, as shown in Figure 11, it is determined that a predetermined event has occurred, and an event action command corresponding to object OB3 (for example, moving along the direction of extension of object OB3) is generated. As a result, the rideable mobile device 100 will move along the river even if the user P's center of gravity shifts. This allows user P to have a virtual experience of being carried along by the river.

[0069] In the example shown in Figure 12, an object OB4 representing a vortex appears in the virtual space. In this case, suppose avatar A touches object OB4 in the virtual space or reaches the area R directly below object OB4. In this case, as shown in Figure 13, it is determined that a predetermined event has occurred, and an event action command (e.g., rotation) corresponding to object OB4 is generated. As a result, the rideable mobile device 100 rotates in place, even if the user P's center of gravity shifts. This allows user P to have a virtual experience of being caught up in the rotation of the vortex.

[0070] According to the embodiment described above, the virtual experience provision system 1 generates a center of gravity movement command (an example of a "first movement command") and a balance control command based on the user P's operation (center of gravity movement) of the rideable mobile body 100. The virtual experience provision system 1 determines whether a predetermined event has occurred in the virtual space, and if a predetermined event has occurred in the virtual space, it generates an event action command (an example of a "second movement command") which is a command predetermined according to the type of predetermined event. The virtual experience provision system 1 moves the rideable mobile body 100 based on either the center of gravity movement command or the event action command. If both the center of gravity movement command and the event action command have been generated, the virtual experience provision system 1 prioritizes moving the rideable mobile body 100 based on the event action command over moving it based on the center of gravity movement command. With this configuration, the entertainment value and sense of realism of the virtual space can be further enhanced.

[0071] (Other embodiments) Other embodiments will be described below. In the embodiments described above, the control device 150 of the rideable mobile body 100 was described as moving the rideable mobile body 100 based on either a center of gravity movement command or an event action command, but it is not limited to this. For example, the control device 150 may move the rideable mobile body 100 based on an emergency evacuation movement command. An emergency evacuation movement command is a movement command to move the rideable mobile body 100 to a predetermined location (a safe place) when a disaster alert is issued by the national or local government during a disaster such as an earthquake, heavy rain, or flood. Thus, the rideable mobile body 100 may move according to an emergency evacuation movement command instead of a center of gravity movement command or an event action command. In other words, the control device 150 may prioritize moving the rideable mobile body 100 based on an emergency evacuation movement command over moving the rideable mobile body 100 based on a center of gravity movement command or an event action command.

[0072] Although embodiments for carrying out the present invention have been described above using examples, the present invention is not limited in any way to these embodiments, and various modifications and substitutions can be made without departing from the spirit of the present invention. [Explanation of Symbols]

[0073] 1. Virtual Experience Provisioning System 100 passenger-type mobile vehicles 110 Base 120 omnidirectional moving wheels 130 Communication equipment 140 sensors 142 Accelerometer 144 Angular velocity sensor 150 Control device 152 Center of gravity estimation part 154 Center of gravity movement command generation unit 156 Balance control command generation unit 158 Motor Control Unit 180 Seating area 200 head-mounted displays 300 Content Control Device 310 Communication equipment 320 Processing Units 322 Content Provision Department 324 Event Occurrence Determination Unit 326 Event Action Command Generation Unit 330 Storage section 332 Content Data

Claims

1. A virtual experience provision system that allows users aboard a mobile vehicle to experience a virtual space, A first generation unit generates a first movement command, which is a command for moving the rideable mobile body, based on the user's operation of the rideable mobile body. A determination unit that determines whether or not a predetermined event has occurred within the virtual space, When the predetermined event occurs, a second generation unit generates a second movement command, which is a command predetermined in response to the predetermined event and is a command for moving the rideable mobile body. The system includes a mobile body control unit that moves the rideable mobile body based on any one of a plurality of mobile commands, including the first mobile command and the second mobile command, When both the first movement command and the second movement command are generated, the mobile unit control unit prioritizes moving the mobile unit based on the second movement command over moving the mobile unit based on the first movement command. A system for providing virtual experiences.

2. The predetermined event includes the rideable vehicle and / or the user coming into contact with a predetermined object in the virtual space. The virtual experience provision system according to claim 1.

3. The predetermined event includes the rideable vehicle and / or the user reaching a predetermined location in the virtual space. A virtual experience provision system according to claim 1 or 2.

4. The aforementioned steering operation is performed by shifting the user's center of gravity, The first generation unit generates a first movement command based on the movement of the center of gravity detected by a sensor mounted on the rideable mobile body. A virtual experience provision system according to claim 1 or 2.

5. In addition to generating the first movement command based on the control operation, the first generation unit further generates a balance control command, which is a command for controlling the attitude of the rideable mobile body, based on the control operation. When the first movement command, the second movement command, and the balance control command are generated, the mobile unit control unit moves the rideable mobile unit based on the second movement command and also controls the attitude of the rideable mobile unit based on the balance control command. A virtual experience provision system according to claim 1 or 2.

6. A method for providing a virtual experience using a virtual experience provision system that allows users riding in a mobile vehicle to experience a virtual space, Based on the user's operation of the rideable mobile body, a first movement command is generated, which is a command for moving the rideable mobile body. To determine whether a predetermined event has occurred within the virtual space, When the aforementioned predetermined event occurs, a second movement command is generated, which is a command predetermined in response to the aforementioned predetermined event and is a command for moving the rideable mobile body. To move the rideable mobile body based on any one of a plurality of movement commands, including the first movement command and the second movement command, If both the first movement command and the second movement command are generated, priority will be given to moving the rideable mobile body based on the second movement command rather than moving the rideable mobile body based on the first movement command. A method for providing virtual experiences, including the provision of virtual experiences.

7. A program to be executed on the computer of a virtual experience provision system that allows users aboard a mobile vehicle to experience a virtual space, Based on the user's operation of the rideable mobile body, a first movement command is generated, which is a command for moving the rideable mobile body. To determine whether a predetermined event has occurred within the virtual space, When the aforementioned predetermined event occurs, a second movement command is generated, which is a command predetermined in response to the aforementioned predetermined event and is a command for moving the rideable mobile body. To move the rideable mobile body based on any one of a plurality of movement commands, including the first movement command and the second movement command, If both the first movement command and the second movement command are generated, priority will be given to moving the rideable mobile body based on the second movement command rather than moving the rideable mobile body based on the first movement command. A program that includes this.

Citation Information

Patent Citations

  • Virtual experience provision system, virtual experience provision method, and program

    JP2023006960A