Interface device and on-board exercise experience system

By using an interface device and a simulation device equipped with a force sensing sensor in the virtual space, the inclination direction and angle of the board is determined according to the virtual space status and user posture, the problem of unrealistic movement experience on the virtual space board in the prior art is solved, and the realization of the realization of the realization of the motion experience on the virtual space board is achieved. A higher virtual space board sports experience.

CN119015691APending Publication Date: 2024-11-26SINTOKOGIO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410650798.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-26
Filing Date
2024-05-24
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The existing game input devices that imitate the movement of the board such as skateboard can only send control signals and cannot fully provide the realism of the board movement in the virtual space, resulting in a large difference between the board movement experience and reality in the virtual space.

Method used

An interface device is designed, including a plate, an inclination mechanism and a force sensing sensor. By detecting the user's force and torque to the plate, it provides a signal to the virtual space simulation device, and determines the inclination direction and angle of the board according to the virtual space state and the user's posture. , enhance the on-board sports experience in virtual space.

Benefits of technology

In the virtual space, users can experience a higher sense of realistic board movements, which is close to the experience of realistic board movements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119015691A_ABST
    Figure CN119015691A_ABST
Patent Text Reader

Abstract

The invention relates to an interface device and an on-board exercise experience system. An interface device (1) for providing a user (U) with an on-board exercise experience in a virtual space, the interface device (1) being provided with: a board (111) on which the user is boarding; a tilting mechanism (12) that supports the plate from below the plate so that the plate can be tilted; a force sensor (112) that is mounted on the plate or the tilting mechanism and detects a force and a torque acting on the plate from a user; and an input / output unit (14) that supplies expressive force and torque signals to a simulation device (2) for generating a virtual space, and acquires, from the simulation device, a control signal for controlling the tilting mechanism to tilt the plate.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an interface device and a board sports experience system. Background Art

[0002] In the past, there is known an input device for a game that imitates sports on a board such as a skateboard, as described in Patent Document 1. The input device includes a platform on which a player sits with both feet, and a support mechanism that supports the platform in a manner that allows the platform to swing freely. Furthermore, the input device gives swing information when the player swings the platform to the game machine. In addition, the support mechanism is a mechanism that allows the swinging movement center axis to be located at the bottom or below the platform.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Publication No. 10-225573 Summary of the invention

[0006] Problem that the invention aims to solve

[0007] In recent years, the development of virtual space (metaverse) technology is gaining popularity. If the virtual space technology is applied to games that imitate board sports as described above, it is possible to obtain a sense of presence that one is actually experiencing. However, the existing input device described in Patent Document 1 only functions as a controller, and only unilaterally sends a control signal from the input device to the simulation device for generating the virtual space to make the characters and boards projected on the screen move. Therefore, if only the existing input device is used for board sports in the virtual space, the realism of the board movements is insufficient, and only an experience that is far different from the experience obtained in real board sports can be obtained.

[0008] One aspect of the present invention has been made in view of the above-mentioned problems, and an object of the present invention is to enable a user to experience the movement of a board with a higher sense of reality when moving on a board in a virtual space.

[0009] Solutions for solving problems

[0010] Real board sports generally involve the movement of the board. Therefore, the board not only sways in response to the user's operation, weight shift, etc., but also sways in response to changes in the state of the road surface, etc. The inventors came up with the following insight: enabling the experience of such swaying in response to changes in the state of the road surface, etc., will increase the sense of realism in the board sports experience in the virtual space.

[0011] In order to solve the above-mentioned problem, an interface device involved in one embodiment of the present invention is an interface device for providing a user with a board movement experience in a virtual space, and the interface device comprises: a board on which the user rides; a tilting mechanism that supports the board from below in a manner that enables the board to be tilted; a force sensor mounted on the board or the tilting mechanism to detect the force and torque acting on the board from the user; and an input-output unit that provides a signal representing the force and the torque to a simulation device for generating the virtual space, and obtains a control signal from the simulation device for controlling the tilting mechanism to tilt the board.

[0012] In addition, in order to solve the above-mentioned problems, the board sports experience system involved in other embodiments of the present invention includes the above-mentioned interface device and the simulation device, wherein the simulation device determines the tilt direction and tilt angle of the board based on the state of the virtual space and the posture of the user determined according to the force and the torque.

[0013] Effects of the Invention

[0014] According to each aspect of the present invention, when moving on a board in a virtual space, a user can experience the movement of the board with a higher sense of reality. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is a perspective view showing an example of a board sports experience system according to an embodiment of the present invention.

[0016] Figure 2 is a block diagram showing the electrical structure of the system.

[0017] Figure 3 This is a flowchart showing the flow of operations of the system. DETAILED DESCRIPTION

[0018] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0019] <Structure of the board sports experience system>

[0020] The board sports experience system (hereinafter referred to as system S) involved in this embodiment is used to provide a board sports experience in a virtual space to the user U. The term "board sports" refers to all sports performed by the user U riding on a board. Board sports include, for example, surfing, snowboarding, skateboarding, etc. Figure 1 , 2 As shown, the system S includes an interface device 1, a simulation device 2, and a head mounted display 3 (hereinafter referred to as HMD 3). Figure 2As shown, the devices 1 to 3 are connected to each other by wire or wireless so as to be able to communicate with each other. In addition, the system S may include a plurality of interface devices 1 and HMD 3. In this case, the plurality of interface devices 1 may be installed in the same room or in different places.

[0021] [Interface device]

[0022] The interface device 1 is used to provide the user U with a board sports experience in a virtual space. Figure 1 As shown in FIG. 1 , the interface device 1 includes a force plate 11 and a tilt mechanism 12. Figure 1 , 2 As shown, the interface device 1 according to the present embodiment further includes an input / output unit 14 and a plurality of photodetectors 13 .

[0023] 〔Tilt mechanism〕

[0024] like Figure 1 As shown, the tilt mechanism 12 supports the force plate 11 from below the force plate 11 so as to be able to tilt the force plate 11. The tilt mechanism 12 according to the present embodiment is a parallel link mechanism.

[0025] The tilt mechanism 12 includes a base 121 fixed to the floor surface and a plurality of movable links 122 .

[0026] (Movable connecting rod)

[0027] The lower ends of the plurality of movable connecting rods 122 are respectively connected to the peripheral portion of the base 121. Each lower end is a movable joint (such as a ball joint, etc.). Therefore, each movable connecting rod 122 can be tilted with the lower end as the center. In addition, each movable connecting rod 122 is respectively composed of a piston and a cylinder. Therefore, each movable connecting rod 122 can be extended and retracted in a manner that the lower end and the upper end are close to or away from each other. In addition, each upper end of the plurality of movable connecting rods 122 is a movable joint similar to the lower end.

[0028] In addition, the tilting mechanism 12 is not limited to the above-mentioned structure. For example, the tilting mechanism may be configured in a manner that each movable link can bend and stretch. Furthermore, the force plate 11 may be tilted by adjusting the bending angle of the lower end of each movable link using the power of a motor or the like. In addition, the tilting mechanism may be configured in a manner that enables the lower end of a rod-shaped movable link to move along the upper surface of the base 121. Furthermore, the force plate 11 may be tilted by utilizing the movement of the lower end of the movable link to cause the upper end to move up and down.

[0029] 〔Force plate〕

[0030] The force plate 11 is provided on the tilt mechanism 12. The force plate 11 includes a plate 111 and a force sensor 112. That is, the force sensor 112 according to the present embodiment is mounted on the plate 111. In addition, the force plate 11 according to the present embodiment includes a plurality of force sensors 112.

[0031] (plate)

[0032] The board 111 is a member for the user U to ride on. The upper surface of the board is a riding surface for the user U to ride on. The board 111 involved in this embodiment has a rectangular shape when viewed from above. In addition, the board's top view shape may also be a shape corresponding to the board sports experience provided by the system S.

[0033] (Force sensor)

[0034] The force sensor 112 detects the force and torque acting on the force plate 11 from the user U. The multiple force sensors 112 involved in this embodiment are three-axis force sensors, which are respectively built into the four corners of the plate 111. Each force sensor 112 repeatedly detects the force and torque acting on the plate 111 at a predetermined period. In addition, the force sensor 112 may not be built into the plate 111, but may be installed on the surface of the plate 111 (it may not constitute a force plate), and may also be mounted on the tilt mechanism 12. In addition, the force sensor 112 may also be a six-axis force sensor.

[0035] The force plate 11 constructed as described above measures the force (ground reaction force) generated by the interaction between the plate 111 and the user U riding on the plate 111. Specifically, the force plate 11 detects the translation forces (Fx, Fy, Fz) in the three-axis directions acting on the riding surface of the plate 111 due to the movement of the user U on the plate 111. And based on the detection results, the center of pressure (COP) of the riding surface, the moment (free moment) generated around the Z axis passing through the center of pressure in the vertical direction due to friction, the center of gravity fluctuation, etc. are calculated. Thus, the force plate 11 or the simulation device 2 described later can determine the posture of the user U, the way of applying weight, the direction in which the user U wants to point the plate, etc.

[0036] The force plate 11 is connected at its lower surface peripheral portion to the upper end portions of the plurality of movable links 122. The force plate 11 is tilted in accordance with the extension and contraction degree of the movable links 122.

[0037] 〔Photodetector〕

[0038] The photodetector 13 is used to detect light emitted by the HMD 3 described later. A plurality of photodetectors 13 are arranged so as to surround the interface device 1. The photodetectors 13 involved in this embodiment are arranged on the wall of the room where the interface device 1 is installed. In addition, the photodetectors 13 involved in this embodiment are arranged in a matrix at predetermined intervals. In addition, the arrangement of the photodetectors 13 may be, for example, an oblique arrangement or a random arrangement.

[0039] 〔Input and output section〕

[0040] The input / output unit 14 provides a detection signal to the simulation device 2. The detection signal is a signal expressing force and moment. In addition, the input / output unit 14 obtains a control signal for controlling the tilt mechanism 12 to tilt the force plate 11 from the simulation device 2. The input / output unit 14 is composed of a communication module for communicating with the simulation device 2 by wire or wireless, or a terminal for connecting to the simulation device 2 by wire.

[0041] The input / output unit 14 according to the present embodiment provides the simulation device 2 with identification information (ID, mounting position, etc.) of the photodetector 13 that detects the light emitted from the HMD 3 .

[0042] [Simulation device]

[0043] The simulation device 2 is used to generate a virtual space. When the board sports experience provided by the system S is a surfing experience, the virtual space is a space obtained by simulating the space on the sea. When it is a snowboarding experience, the virtual space is a space obtained by simulating the space on the snow. When it is a skateboarding experience, the virtual space is a space obtained by simulating the space on the road, etc. Figure 2 As shown, the simulation device 2 includes a processor 21 and a memory 22 .

[0044] (Memory)

[0045] The memory 22 stores a control program for operating the simulation device 2. The memory 22 according to the present embodiment also stores image data for generating a virtual space.

[0046] (processor)

[0047] The processor 21 generates a VR (Virtual Reality) image that reproduces the scenery of a virtual space (e.g., the sea, snow-capped mountains, skateparks, etc.) corresponding to the board sports experience provided by the system S. The processor 21 generates the VR image based on image data obtained by photographing a place for actually experiencing board sports. In addition, the processor 21 generates an image of a virtual space in which the surface below the force plate 11 and the surrounding scenery move backward (it looks like the user U is moving forward). In addition, the processor 21 involved in this embodiment determines the direction of the face of the user U based on the recognition information of the photodetector 13 that detects light, and rotates the virtual space to match the direction of the face of the user U. Moreover, the processor 21 sends the data of the generated virtual space to the HMD 3 via a communication module not shown.

[0048] The processor 21 involved in this embodiment generates data of subtle vibrations when the board moves. In the case where the board sports experience provided by the system S is a surfing experience, the vibration includes the vibration generated when the front end of the board pushes away the waves. In the case of a snowboarding experience, the vibration includes the vibration generated when the snowboard rubs against the snow surface. In the case of a skateboarding experience, the vibration includes the vibration generated when the wheels of the skateboard roll on the road surface. In addition, the processor 21 sends the generated vibration data to the interface device 1 via the communication module.

[0049] In addition, the processor 21 determines the tilt direction and tilt angle of the force plate 11 based on the state of the virtual space and the posture of the user U determined by the force and torque. The "state of the virtual space" refers to the state of the surface at least below the force plate 11 in the virtual space. In the case where the board sports experience provided by the system S is a surfing experience, the state of the virtual space refers to the state of the sea surface. In the case of a snowboarding experience, the state of the virtual space refers to the state of the snow surface. In the case of a skateboarding experience, the state of the virtual space refers to the state of the road surface. "State" refers to the presence or absence of concavities (waves in the case of the sea surface), the depth of the concave part, the height of the convex part, the inclination of the surface reaching the bottom of the concave part or the top of the convex part, etc. The processor 21 repeatedly detects the force and torque acting on the plate 111 at a predetermined cycle. As a result, the processor 21 determines a different tilt direction and tilt angle each time according to the temporal change of the state of the virtual space (the movement of the surface below the force plate 11 and the scenery in the virtual space).

[0050] In addition, the processor 21 can also be configured to, for example, obtain image data captured by a wearable camera worn by an athlete when the athlete actually performs board sports, and create a VR image based on the data. In this way, the user U can immerse himself in the feeling of experiencing the high-level board sports performed by the athlete. In addition, the processor 21 can also be configured to obtain image data captured from the place where the athlete left when the athlete actually performed board sports, and generate a virtual space based on the data. In this way, the user U feels like he is performing board sports in parallel with the athlete, which becomes a more interesting experience.

[0051] In addition, when the processor 21 is connected to a plurality of interface devices 1 and a plurality of HMDs 3, the processor 21 may be configured to generate a virtual space in which the virtual images of other users other than the user wearing the HMD are displayed as a virtual space provided to each HMD. For example, when a first user and a second user wear HMDs 3 respectively and experience board sports through different interface devices 1, data of a virtual space in which the virtual image of the second user (the virtual image of the first user) is displayed is provided to the HMD 3 of the first user (the second user). In this way, in the virtual space, a plurality of users can enjoy board sports together or compete in board sports skills. If the number of users is large, a competition for prize money can also be held in the virtual space.

[0052] In addition, the processor 21 may be configured to generate a virtual space that is not a VR video and an avatar of the user U existing in the virtual space. In this case, the processor 21 may be configured to change the posture of the avatar based on the state of the virtual space and the posture of the user U.

[0053] In addition, the processor 21 may also be configured to generate sounds in the virtual space and send the sounds to the HMD 3. When the board sports experience provided by the system S is a surfing experience, the sounds include the sound of waves. When it is a snowboarding experience, the sounds include the sound generated when the snowboard rubs against the snow surface. When it is a skateboarding experience, the sounds include the sound generated when the wheels of the skateboard roll on the road surface.

[0054] [Head-mounted display]

[0055] The HMD 3 displays an image representing a virtual space obtained from the simulation device 2. In addition, the HMD 3 is worn on the head of the user U when the user U rides on the force plate 11. As a result, the user U can obtain a sense of presence as if he or she is in the virtual space. The simulation device 2 involved in this embodiment generates a VR image, so the user U wearing the HMD 3 can immerse himself or herself in a virtual space with a higher sense of reality. In addition, the simulation device 2 involved in this embodiment generates an image of a virtual space in which the surrounding scenery moves backward, so the user U wearing the HMD 3 can immerse himself or herself in a feeling of moving forward.

[0056] The HMD 3 involved in this embodiment irradiates light in the direction in which the face of the user U is facing at least while the user U is moving on the experience board. The light can be visible light or infrared light as long as it is different from the indoor light of the room where the interface device 1 is installed. The light irradiated from the HMD 3 is detected by some of the multiple photodetectors 13 arranged around the interface device 1.

[0057] In addition, the HMD 3 may have a built-in speaker. In this case, the HMD 3 may be configured to emit the sound in the virtual space acquired from the simulation device 2.

[0058] <Operation of the board sports experience system (interface device)>

[0059] When a predetermined start condition is satisfied, the system S configured as described above starts operating. Examples of the start condition include powering on the system S (interface device 1 ), the user U riding on the force plate 11 , and the user U performing a predetermined start operation.

[0060] When the system S starts to act, Figure 3 As shown, first, the simulation device 2 generates a virtual space (step A1), and provides the data of the virtual space to the HMD 3 worn by the user U (step A2). Then, the HMD 3 that receives the data of the virtual space displays the image of the virtual space on the display unit of the HMD 3 (step B1). Then, the scenery in the virtual space starts to move, and the experience of the board movement starts.

[0061] While the HMD 3 displays the virtual space, the interface device 1 repeatedly detects the force and moment acting on the force plate 11 at a predetermined cycle (step C1). Each time a force and moment are detected, the interface device 1 supplies a detection signal to the simulation device 2 (step C2).

[0062] Then, the simulation device 2 that has obtained the detection signal repeatedly determines the tilt direction and tilt angle of the force plate 11 based on the state of the generated virtual space and the posture of the user U determined from the detection signal (step A3). Moreover, each time the tilt direction and tilt angle are determined, the simulation device 2 provides a control signal indicating the determined tilt direction and tilt angle to the interface device 1 (step A4). Then, the interface device 1 that has obtained the control signal controls the tilt mechanism to tilt the force plate 11 in the tilt direction and tilt angle indicated by the control signal (step C3).

[0063] <Effects of the board sports experience system>

[0064] Real board sports are generally accompanied by the movement of the board. Therefore, in addition to swaying in accordance with the operation of the user U, the weight shift, etc., the board also sways in accordance with the state changes of the road surface, etc. The interface device 1 described above can not only function as a controller for moving the user U and the board in the virtual space, but also can tilt the board in accordance with the state of the virtual space. Therefore, according to the interface device 1 or the system S, during board sports in the virtual space, the user U can experience the movement of the board with a higher sense of reality.

[0065] <Modification>

[0066] The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims. That is, embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.

[0067] For example, the system S may also include a cushioning material surrounding the interface device 1. In this way, even if the user U loses balance on the force plate 11 and falls from the force plate 11, the user U can be prevented from being injured by colliding with the floor surface. In addition, in this way, the handrails for the user U to grasp, which are provided in the conventional board-type input device, are not required. As a result, the board sports experience in the virtual space can be made close to the situation when experiencing real board sports.

[0068] In addition, the HMD 3 may include a sensor (gyro sensor, etc.) for detecting the movement of the head of the user U instead of the light irradiation function. In this case, the interface device 1 may not include the photodetector 13 .

[0069] In addition, the system S may also include an air blower (not shown). The air blower is arranged in front of the user U so as to blow air toward the user U. In addition, the air blower is connected to the simulation device 2 to adjust the wind speed in accordance with the speed at which the user U moves in the virtual space. In this way, the user U is blown by the wind in accordance with the movement of the user U, and the realism of the board sports experience in the virtual space can be further improved.

[0070] Furthermore, part or all of the functions of the above-mentioned processor may be realized by a logic circuit.

[0071] 〔Summarize〕

[0072] The interface device involved in mode 1 of the present invention is an interface device for providing a user with an experience of moving on a board in a virtual space, and the structure of the interface device is provided with: a board on which the user rides; a tilting mechanism that supports the board from below the board in a manner that enables the board to be tilted; a force sensor mounted on the board or the tilting mechanism to detect the force and torque acting on the board from the user; and an input-output unit that provides a signal representing the force and the torque to a simulation device for generating the virtual space, and obtains a control signal from the simulation device for controlling the tilting mechanism to tilt the board.

[0073] The interface device according to aspect 2 of the present invention may be configured such that, in aspect 1 described above, the tilt mechanism is a parallel link mechanism.

[0074] The structure of the board sports experience system involved in Mode 3 of the present invention can also be set to include: the interface device recorded in the above-mentioned Mode 1 or 2; and the simulation device, wherein the simulation device determines the tilt direction and tilt angle of the board based on the state of the virtual space and the posture of the user determined according to the force and the torque.

[0075] The structure of the board sports experience system involved in the fourth aspect of the present invention may also be set as, in the above-mentioned third aspect, further including a head-mounted display, and the head-mounted display displays the image representing the virtual space obtained from the simulation device.

Claims

1. An interface device for providing a user with a board sports experience in a virtual space, the interface device being characterized by: a board for the user to ride on; a tilting mechanism that supports the plate from below the plate so as to tilt the plate; a force sensor mounted on the board or the tilt mechanism to detect force and moment applied to the board by the user; as well as An input-output unit supplies a signal expressing the force and the moment to a simulation device for generating the virtual space, and acquires a control signal for controlling the tilt mechanism to tilt the board from the simulation device.

2. The interface device according to claim 1, It is characterized in that The tilting mechanism is a parallel connecting rod mechanism.

3. A board sports experience system, It is characterized in that include: The interface device according to claim 1 or 2; as well as The simulation device, The simulation device determines the tilt direction and tilt angle of the board based on the state of the virtual space and the posture of the user determined according to the force and the moment.

4. The board sports experience system according to claim 3, It is characterized in that It also includes a head-mounted display, which displays an image representing the virtual space acquired from the simulation device.

5. The board sports experience system according to claim 3, It is characterized in that The board sports experience is surfing, The simulation device generates the virtual space simulating the sea, The simulation device determines the tilt direction and tilt angle of the board based on the state of the sea surface in the virtual space and the posture of the user determined from the force and the moment.