Interface device and board-based sports experience system

The interface device with a tilting mechanism and force sensors enhances the realism of board sports in virtual spaces by simulating dynamic board interactions, offering a more immersive experience.

JP2024170195APending Publication Date: 2024-12-06SINTOKOGIO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023087221
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

Conventional input devices for board sports in virtual spaces lack realism, failing to simulate the dynamic interactions between the board and the user, such as weight shifts and surface conditions, resulting in an unrealistic experience.

Method used

An interface device with a tilting mechanism and force sensors that detect user interactions and surface conditions to dynamically adjust the board's tilt, coupled with a simulation device that generates a responsive virtual environment.

Benefits of technology

Enhances the realism of board sports experiences in virtual spaces by simulating the dynamic movements and interactions of real-world board sports, providing a more immersive experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024170195000001_ABST
    Figure 2024170195000001_ABST
Patent Text Reader

Abstract

To allow a user to experience more realistic board operations in board-based sports in a virtual space.SOLUTION: An interface device (1) for providing a user (U) with board-based sports in a virtual space includes: a board (111) on which the user rides; a tilting mechanism (12) that supports the board so that it can be tilted from below; a force sensor (112) that is mounted on the board or the tilting mechanism and that detects the force and moment acting on the board from the user; and an input / output unit (14) that provides a signal representing the force and moment to a simulation device (2) that generates a virtual space, and obtains a control signal for controlling the tilting mechanism so that the board tilts, from the simulation device.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an interface device and a board sports experience system. [Background technology]

[0002] Conventionally, an input device for a game simulating a board sport such as skateboarding is known, as described in Patent Document 1. This input device includes a platform on which a player stands with both feet, and a support mechanism that supports the platform so that it can swing freely. The input device provides the game machine with swing information when the player swings the platform. The support mechanism is a mechanism in which the central axis of the swing motion is located below or below the platform. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 10-225573 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, virtual space (metaverse) technology has been actively developed. If this virtual space technology is applied to a game that imitates the above-mentioned board sports, it is possible to obtain a sense of realism as if the player were actually experiencing the game. However, the conventional input device described in Patent Document 1 only functions as a controller that unilaterally transmits control signals from the input device to a simulation device that generates a virtual space in order to operate the characters and board displayed on the screen. For this reason, the reality of the board's movements is insufficient when a conventional input device is used for board sports in a virtual space, and the experience obtained is far from that obtained in real board sports.

[0005] One aspect of the present invention has been made in consideration of the above-mentioned problems, and aims to enable a user to experience more realistic board movements in board sports in a virtual space. [Means for solving the problem]

[0006] Real board sports generally involve the movement of the board. Therefore, the board sways in response to changes in the condition of the road surface, etc., in addition to the swinging in response to the user's operation, weight shift, etc. The inventors discovered that by allowing the user to experience swinging in response to changes in the condition of the road surface, etc., the reality of the board sports experience in a virtual space can be increased, leading to the present invention.

[0007] In order to solve the above problems, an interface device according to one embodiment of the present invention is an interface device for providing a user with a board-based sports experience in a virtual space, and includes a board on which the user rides, a tilting mechanism that supports the board so that it can be tilted from below, a force sensor mounted on the board or the tilting mechanism and detects the force and moment acting on the board from the user, and an input / output unit that provides signals representing the force and moment to a simulation device that generates the virtual space, and obtains control signals from the simulation device for controlling the tilting mechanism so that the board tilts.

[0008] In addition, in order to solve the above problems, a board sports experience system according to another aspect of the present invention includes the above-mentioned interface device and the simulation device, and the simulation device determines the tilt direction and tilt angle of the board based on the state of the virtual space and the posture of the user determined from the force and the moment. Effect of the Invention

[0009] According to each aspect of the present invention, a user can experience more realistic board movements in board sports in a virtual space. [Brief description of the drawings]

[0010] [Figure 1] 1 is a perspective view showing an example of a board sports experience system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing the electrical configuration of the system. [Diagram 3] 1 is a flowchart showing the flow of operations of the system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0012] <Board sports experience system configuration> The board sports experience system (hereinafter, system S) according to this embodiment provides a user U with a board sports experience in a virtual space. The term "board sports" refers to sports in general that the user U rides on a board. Board sports include surfing, snowboarding, skateboarding, and the like. As shown in Figs. 1 and 2, the system S includes an interface device 1, a simulation device 2, and a head mounted display (hereinafter, HMD 3). As shown in Fig. 2, the devices 1 to 3 are connected to each other so as to be able to communicate with each other by wire or wirelessly. Note that the system S may include a plurality of interface devices 1 and HMDs 3. In this case, the plurality of interface devices 1 may be installed in the same room, or may be installed in different locations.

[0013] [Interface device] The interface device 1 is for providing a user U with a board sports experience in a virtual space. As shown in Fig. 1, the interface device 1 includes a force plate 11 and a tilting mechanism 12. In addition, as shown in Figs. 1 and 2, the interface device 1 according to this embodiment further includes a plurality of photodetectors 13 and an input / output unit 14.

[0014] [Tilt mechanism] 1, the tilting mechanism 12 supports the force plate 11 from below so that the force plate 11 can tilt. The tilting mechanism 12 according to this embodiment is a parallel link.

[0015] The tilt mechanism 12 includes a base 121 fixed to the floor surface and a plurality of movable links 122 .

[0016] (movable link) The lower ends of the multiple movable links 122 are each connected to the periphery of the base 121. Each lower end is a movable joint (such as a ball joint). Therefore, each movable link 122 can tilt around its lower end. Each movable link 122 is configured as a piston and a cylinder. Therefore, each movable link 122 can expand and contract so that its lower end and upper end move closer to or farther away from each other. Furthermore, each upper end of the multiple movable links 122 is a movable joint similar to the upper end.

[0017] The tilting mechanism 12 is not limited to the above-mentioned configuration. For example, the tilting mechanism may be configured so that each movable link can be bent and stretched. The force plate 11 may be tilted by adjusting the bending angle of the lower end of each movable link using power such as a motor. The tilting mechanism may be configured so that the lower end of the rod-shaped movable link can move along the upper surface of the base 121. The force plate 11 may be tilted by moving the upper end of the movable link up and down by moving the lower end of the movable link.

[0018] [Force Plate] The force plate 11 is provided on a tilting mechanism 12. The force plate 11 includes a board 111 and a force sensor 112. That is, the force sensor 112 according to this embodiment is mounted on the board 111. Moreover, the force plate 11 according to this embodiment includes a plurality of force sensors 112.

[0019] (board) The board 111 is for the user U to board. The top surface of the board is the boarding surface on which the user U boards. The board 111 according to this embodiment has a rectangular shape in a plan view. Note that the shape of the board in a plan view may be a shape corresponding to the board sports experience provided by the system S.

[0020] (Force sensor) The force sensor 112 detects the force and moment acting on the force plate 11 from the user U. The multiple force sensors 112 according to this embodiment are three-axis force sensors, and are built into each of the four corners of the board 111. Each force sensor 112 repeats detection of the force and moment acting on the board 111 at a predetermined period. Note that the force sensor 112 may not be built into the board 111, but may be attached to the surface of the board 111 (it does not have to constitute a force plate), or may be mounted on the tilting mechanism 12. The force sensor 112 may also be a six-axis force sensor.

[0021] The force plate 11 configured as described above measures forces (floor reaction forces) generated by the interaction between the board 111 and the user U standing on the board 111. Specifically, the force plate 11 measures the translational forces (F x , F y , F z ) is detected. Then, based on the detection results, the center of pressure (COP) on the riding surface, the moment (free moment) generated around the Z axis passing vertically through the center of pressure due to friction, center of gravity sway, etc. are calculated. This allows the force plate 11 or a simulation device 2 (described later) to identify the user U's posture, how the user is putting their weight on it, which direction the user U is trying to point the board, etc.

[0022] In addition, the force plate 11 is connected at its lower peripheral edge to each of the upper ends of a plurality of movable links 122. The force plate 11 tilts in accordance with the degree of expansion and contraction of each of the movable links 122.

[0023] [Photodetector] The photodetector 13 detects light emitted by the HMD 3 described later. A plurality of photodetectors 13 are arranged to surround the interface device 1. The photodetector 13 according to this embodiment is arranged on a wall of a room in which the interface device 1 is installed. The photodetectors 13 according to this embodiment are arranged in a matrix at predetermined intervals. The photodetectors 13 may be arranged, for example, diagonally or randomly.

[0024] [Input / output section] The input / output unit 14 provides a detection signal to the simulation apparatus 2. The detection signal is a signal representing a force and a moment. The input / output unit 14 also acquires a control signal for controlling the tilting mechanism 12 so as to tilt the force plate 11 from the simulation apparatus 2. The input / output unit 14 is composed of a communication module for communicating with the simulation apparatus 2 in a wired or wireless manner, or a terminal for connecting to the simulation apparatus 2 in a wired manner.

[0025] The input / output unit 14 according to this embodiment provides the simulation device 2 with identification information (ID, attachment position, etc.) of the photodetector 13 that detected the light irradiated by the HMD 3.

[0026] [Simulation device] The simulation device 2 generates a virtual space. If the board sports experience provided by the system S is a surfing experience, the virtual space is a space simulating an ocean surface. If the board sports experience is a snowboarding experience, the virtual space is a space simulating a surface of snow. If the board sports experience is a skateboarding experience, the virtual space is a space simulating a surface of a road or the like. As shown in FIG. 2, the simulation device 2 includes a processor 21 and a memory 22.

[0027] (Memory) The memory 22 stores a control program for operating the simulation device 2. The memory 22 according to this embodiment also stores image data for generating a virtual space.

[0028] (Processor) The processor 21 generates a virtual reality (VR) image that reproduces the scenery of a virtual space (sea, snowy mountain, skateboard park, etc.) corresponding to the board-based sport experience provided by the system S, based on image data obtained by photographing a place where the board-based sport is actually experienced. The processor 21 also generates an image of a virtual space in which the surface below the force plate 11 and the surrounding scenery move backward (the user U appears to be moving forward). The processor 21 according to this embodiment also identifies the direction of the user U's face based on the identification information of the photodetector 13 that detects light, and rotates the virtual space according to the direction of the user U's face. The processor 21 then transmits the generated data of the virtual space to the HMD 3 via a communication module (not shown).

[0029] The processor 21 according to this embodiment generates data of minute vibrations when the board moves. If the board-based sports experience provided by the system S is a surfing experience, the vibrations include vibrations that occur when the tip of the board cuts through the waves. If it is a snowboarding experience, the vibrations include vibrations that occur when the snowboard rubs against the snow surface. If it is a skateboarding experience, the sound includes vibrations that occur when the wheels of the skateboard roll on the road surface. Then, the processor 21 transmits the generated vibration data to the interface device 1 via the communication module.

[0030] The processor 21 also determines the tilt direction and tilt angle of the force plate 11 based on the state of the virtual space and the posture of the user U determined from the force and moment. The "state of the virtual space" refers to the state of at least the surface located below the force plate 11 in the virtual space. If the board-based sports experience provided by the system S is a surfing experience, the state of the virtual space refers to the state of the sea surface. If it is a snowboarding experience, the state of the virtual space refers to the state of the snow surface. If it is a skateboarding experience, the state of the virtual space refers to the state of the road surface. The "state" refers to the presence or absence of unevenness (waves in the case of the sea surface), the depth of the recess, the height of the protrusion, the inclination of the surface leading to the bottom of the recess or the top of the protrusion, etc. The processor 21 repeats detection of the force and moment acting on the board 111 at a predetermined period. As a result, the processor 21 determines a different tilt direction and tilt angle each time according to the change over time in the state of the virtual space (movement of the surface and scenery below the force plate 11 in the virtual space).

[0031] The processor 21 may be configured to obtain, for example, data of a video of an athlete actually playing a board sport taken by a wearable camera attached to the athlete, and to create a VR video based on the data. In this way, the user U can feel as if he or she is experiencing a high-level board sport played by the athlete. The processor 21 may also be configured to obtain data of a video of the athlete actually playing a board sport taken from a location away from the athlete, and to generate a virtual space based on the data. In this way, the user U feels as if he or she is playing a board sport alongside the athlete, resulting in a more interesting experience.

[0032] Furthermore, when a plurality of interface devices 1 and a plurality of HMDs 3 are connected, the processor 21 may be configured to generate a virtual space in which an avatar of a user other than the user wearing each HMD is shown as a virtual space to be provided to each HMD. For example, when a first user and a second user wear HMDs 3 and experience board sports with different interface devices 1, data of a virtual space in which an avatar of the second user (the avatar of the first user) is shown is provided to the HMD 3 of the first user (the second user). In this way, in the virtual space, a plurality of users can enjoy board sports together and compete with each other in board sports. If the number of users becomes large, a competition with a prize can be held in the virtual space.

[0033] Furthermore, the processor 21 may be configured to generate a virtual space that is not a VR image and an avatar of the user U existing in the virtual space. In this case, the processor 21 may be configured to change the posture of the avatar based on the state of the virtual space and the posture of the user U.

[0034] The processor 21 may also be configured to generate sounds in the virtual space and transmit them to the HMD 3. If the board-based sports experience provided by the system S is a surfing experience, the sounds include the sound of waves. If it is a snowboarding experience, the sounds include the sound generated when a snowboard rubs against the snow surface. If it is a skateboarding experience, the sounds include the sound generated when the wheels of a skateboard roll on the road surface.

[0035] [Head-mounted display] The HMD3 displays an image representing the virtual space acquired from the simulation device 2. The HMD3 is also worn on the head of the user U when the user U boards the force plate 11. This allows the user U to feel as if he or she is present in the virtual space. Since the simulation device 2 according to this embodiment generates VR images, the user U wearing the HMD3 can feel as if he or she is present in a more realistic virtual space. Furthermore, since the simulation device 2 according to this embodiment generates an image of the virtual space in which the surrounding scenery moves backwards, the user U wearing the HMD3 can feel as if he or she is moving forward.

[0036] The HMD 3 according to this embodiment irradiates light in the direction in which the user U faces at least while the user U is experiencing a board sport. The light may be visible light, infrared light, or the like, as long as it is different from the indoor light in the room in which the interface device 1 is installed. The light irradiated from the HMD 3 is detected by one of a plurality of photodetectors 13 arranged around the interface device 1.

[0037] The HMD 3 may have a built-in speaker. In that case, the HMD 3 may be configured to emit sound in the virtual space acquired from the simulation device 2.

[0038] <Board sports experience system (interface device) operation> The system S configured as described above starts operation when a predetermined start condition is satisfied. The start condition may be when the power of the system S (interface device 1) is turned on, when the user U stands on the force plate 11, when the user U performs a predetermined start operation, etc.

[0039] When the system S starts operating, as shown in Fig. 3, first, the simulation device 2 generates a virtual space (step A1) and provides the data to the HMD 3 worn by the user U (step A2). Then, the HMD 3 that has received the virtual space data displays an image of the virtual space on the display unit (step B1). Then, the scenery in the virtual space starts to move, and the experience of the board sport begins.

[0040] While the virtual space is displayed on the HMD 3, the interface device 1 repeatedly detects the forces and moments acting on the force plate 11 at a predetermined cycle (step C1). Then, every time the interface device 1 detects a force and a moment, it provides a detection signal to the simulation device 2 (step C2).

[0041] The simulation device 2, which has acquired the detection signal, then repeatedly determines the tilt direction and tilt angle of the force plate 11 based on the state of the generated virtual space and the posture of the user U identified from the detection signal (step A3). Every time the tilt direction and tilt angle are determined, the simulation device 2 provides a control signal indicating the determined tilt direction and tilt angle to the interface device 1 (step A4). The interface device 1, which has acquired the control signal, then controls the tilt mechanism to tilt the force plate 11 in the tilt direction and tilt angle indicated by the control signal (step C3).

[0042] <Effects of the board sports experience system> Real board sports generally involve the movement of the board. Therefore, the board sways in response to changes in the condition of the road surface, etc., in addition to the swaying in response to the operation and weight shift of the user U. The interface device 1 described above not only functions as a controller for moving the user U and the board in the virtual space, but can also tilt the board in response to the condition of the virtual space. Therefore, the interface device 1 or the system S allows the user U to experience more realistic board movements in board sports in the virtual space.

[0043] <Modification> The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. In other words, embodiments obtained by appropriately combining the technical means disclosed in the different embodiments are also included in the technical scope of the present invention.

[0044] For example, the system S may be provided with a cushioning material surrounding the interface device 1. In this way, even if the user U loses balance on the force plate 11 and falls off the force plate 11, the user U can be prevented from being injured by collision with the floor surface. In addition, in this way, handrails for the user U to hold on to, which are provided in conventional board-type input devices, become unnecessary. As a result, the board sports experience in the virtual space can be made closer to the situation when experiencing a real board sports.

[0045] Furthermore, instead of the function of emitting light, the HMD 3 may be provided with a sensor (such as a gyro sensor) that detects the movement of the head of the user U. In that case, the interface device 1 does not need to include the photodetector 13.

[0046] The system S may also include a blower (not shown). This blower is disposed in front of the user U so as to blow air toward the user U. The blower is also connected to the simulation device 2, and adjusts the wind speed according to the speed at which the user U moves in the virtual space. In this way, the user U receives wind according to his / her movements, and the reality of the board sports experience in the virtual space can be further improved.

[0047] In addition, some or all of the functions of the processor may be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of each of the control blocks may be realized by, for example, a quantum computer.

[0048] 〔summary〕 The interface device of aspect 1 of the present invention is an interface device for providing a user with a board-based sports experience in a virtual space, and comprises a board on which the user rides, a tilting mechanism that supports the board so that it can be tilted from below, a force sensor mounted on the board or the tilting mechanism and detects the force and moment acting on the board from the user, and an input / output unit that provides signals representing the force and moment to a simulation device that generates the virtual space, and obtains control signals from the simulation device for controlling the tilting mechanism so that the board tilts.

[0049] An interface device according to a second aspect of the present invention may be configured in such a way that in the first aspect, the tilt mechanism is a parallel link.

[0050] A board sports experience system comprising an interface device of aspect 3 of the present invention and the simulation device, wherein the simulation device determines the tilt direction and tilt angle of the board based on the state of the virtual space and the posture of the user determined from the force and the moment, may be configured in aspect 1 or 2 above to include the interface device described in claim 1 or 2 and the simulation device, wherein the simulation device determines the tilt direction and tilt angle of the board based on the state of the virtual space and the posture of the user determined from the force and the moment.

[0051] A board sports experience system according to aspect 4 of the present invention may be configured in such a way that, in the above-mentioned aspect 3, it further includes a head-mounted display that displays an image representing the virtual space obtained from the simulation device. [Explanation of symbols]

[0052] S: Board sports experience system, 1: Interface device, 11: Force plate, 111: Board, 112: Force sensor, 12: Tilting mechanism, 121: Base, 122: Movable link, 13: Photodetector, 14: Input / output unit, 2: Simulation device, 21: Processor, 22: Memory, 3: Head-mounted display, U: User

Claims

1. An interface device for providing a user with a board sport experience in a virtual space, comprising: A board on which the user boards; a tilting mechanism that supports the board from below so that the board can be tilted; a force sensor mounted on the board or the tilt mechanism and configured to detect a force and a moment acting on the board from the user; an input / output unit that provides a signal representing the force and the moment to a simulation device that generates the virtual space, and obtains a control signal from the simulation device for controlling the tilting mechanism so that the board tilts.

1. An interface device comprising:

2. The tilt mechanism is a parallel link.

2. The interface device according to claim 1 .

3. An interface device according to claim 1 or 2; The simulation device, the simulation device determines a tilt direction and a tilt angle of the board based on a state of the virtual space and a posture of the user identified from the force and the moment; A board sports experience system.

4. Further comprising a head mounted display that displays an image representing the virtual space acquired from the simulation device.

4. The board sports experience system according to claim 3.

5. The board sport experience is surfing, The simulation device comprises: generating said virtual space simulating an ocean surface; determining a tilt direction and a tilt angle of the board based on a state of the sea surface in the virtual space and the posture of the user determined from the force and the moment; The board sports experience system according to claim 3.

Citation Information

Patent Citations

  • Input device, data processing device, data processing method, and game device

    JP1998225573A