Interface device and suspension type gliding experience system

By designing a tiltable control rod and force sensor in a simulated suspension gliding device, detecting the user's force and torque, the problem of insufficient realism in the control rod movement in the prior art is solved, and a higher level of in vivo space is achieved. Realistic experience.

CN119015690APending Publication Date: 2024-11-26SINTOKOGIO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410652080.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-26
Filing Date
2024-05-24
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The existing simulated suspension gliding device cannot provide a realistic control rod action experience in the virtual space because the members of the control rod are fixed to the support member and cannot be tilted relative to the user.

Method used

An interface device is designed, including a tiltable control rod, a force sensing sensor and an input and output unit. By detecting the user's force and torque to the control rod, a signal is generated to control the tilt mechanism, so that the control rod is relative to the user in a virtual space. tilt.

Benefits of technology

Improves the realism of the hanging gliding experience in virtual space, allowing users to accelerate and change directions through the tilting operation of the lever as in reality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119015690A_ABST
    Figure CN119015690A_ABST
Patent Text Reader

Abstract

The invention relates to an interface device and a suspension type gliding experience system. An interface device (1) for providing a suspended gliding experience in a virtual space to a user, the interface device (1) being provided with: a lever (11) to be held by the user; a tilting mechanism (12) that supports the lever from above the lever so that the lever can be tilted; a force sensor (13) that is mounted on the tilt mechanism and detects a force and a torque acting on the lever from a user; and an input / output unit (15) that supplies expressive force and torque signals to a simulation device (2) for generating a virtual space, and acquires, from the simulation device, a control signal for controlling the tilt mechanism to tilt the lever.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an interface device and a hang gliding experience system. Background Art

[0002] Conventionally, there is known a simulation device for simulating the experience of hang gliding as described in Patent Document 1. The simulation device is used together with an image display device capable of displaying an image corresponding to the orientation of the user's face. In addition, the simulation device has a somatosensory drive unit that controls the user's posture in accordance with the image displayed on the image display device. In addition, the somatosensory drive unit has a control device that tilts a portion supporting the user in accordance with the inclination of the user's body sensed by the image displayed on the image display device.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Publication No. 2010-12290 Summary of the invention

[0006] Problem that the invention aims to solve

[0007] In real hang gliding, the user of the machine is suspended under the machine in a swingable manner. Therefore, the joystick fixed to the machine can be tilted relative to the user. As a result, the user can accelerate or decelerate the machine, or change direction by tilting the joystick forward, backward, left, or right. However, in existing simulation devices such as that described in Patent Document 1, a member equivalent to the joystick is fixed to a member for supporting the user. Therefore, the user of the simulation device cannot tilt the joystick relative to himself. That is, if only the existing simulation device is used in hang gliding in a virtual space, the realism of the movement of the joystick is insufficient, and only an experience far different from that obtained in real hang gliding can be obtained.

[0008] One aspect of the present invention has been made in view of the above-mentioned problems, and an object of the present invention is to enable a user to experience a more realistic operation of a joystick during hang gliding in a virtual space.

[0009] Solutions for solving problems

[0010] In order to solve the above-mentioned problem, an interface device involved in one embodiment of the present invention is an interface device for providing a user with a hang gliding experience in a virtual space, and the interface device comprises: a joystick for the user to hold; a tilt mechanism that supports the joystick from above in a manner that enables the joystick to be tilted; a force sensor mounted on the tilt mechanism to detect the force and torque acting from the user on the joystick; and an input-output unit that provides a signal representing the force and the torque to a simulation device for generating the virtual space, and obtains a control signal from the simulation device for controlling the tilt mechanism to tilt the joystick.

[0011] In addition, in order to solve the above-mentioned problem, the hang gliding experience system involved in other embodiments of the present invention includes the above-mentioned interface device and the simulation device, wherein the simulation device determines the tilt direction and tilt angle of the control rod based on the state of the atmosphere in the virtual space and the posture of the user determined according to the force and the torque.

[0012] Effects of the Invention

[0013] According to various aspects of the present invention, a user can experience the movement of a joystick with a higher sense of reality during hang gliding in a virtual space. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a perspective view showing an example of the hang gliding experience system according to the embodiment of the present invention.

[0015] Figure 2 is a block diagram showing the electrical structure of the system.

[0016] Figure 3 This is a flowchart showing the flow of operations of the system. DETAILED DESCRIPTION

[0017] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0018] <Structure of the hang gliding experience system>

[0019] The hang gliding experience system (hereinafter referred to as system S) involved in this embodiment is used to provide a hang gliding experience in a virtual space to a user U. Figure 1 , 2 As shown, the system S includes an interface device 1, a simulation device 2, and a head mounted display 3 (hereinafter referred to as HMD 3). Figure 2As shown, the devices 1 to 3 are connected to each other by wire or wireless communication. In addition, the system S may include a plurality of interface devices 1 and HMD 3. In this case, the plurality of interface devices 1 may be installed in the same room or in different locations.

[0020] [Interface device]

[0021] The interface device 1 is used to provide the user U with a hang gliding experience in a virtual space. Figure 1 As shown in FIG. 1 , the interface device 1 includes a control lever 11, a tilt mechanism 12, and a force sensor 13. Figure 1 , 2 As shown, the interface device 1 according to the present embodiment further includes a plurality of photodetectors 14 , an input / output unit 15 , a swing line 16 , and a hanging bag 17 .

[0022] 〔Tilt mechanism〕

[0023] like Figure 1 As shown, the tilting mechanism 12 supports the control rod 11 from above the control rod 11 in a manner that enables the control rod 11 to be tilted. Therefore, the tilting mechanism 12 is arranged above a predetermined distance (about several meters) from the floor surface. The tilting mechanism 12 involved in this embodiment is fixed to the ceiling of the room where the system S is installed. The tilting mechanism 12 involved in this embodiment is a parallel connecting rod mechanism. Therefore, the tilting mechanism 12 involved in this embodiment includes a tilting body 123, a plurality of movable connecting rods 122, and a base 121 fixed to the ceiling.

[0024] (Movable connecting rod)

[0025] The upper ends of the plurality of movable connecting rods 122 are respectively connected to the peripheral portion of the base 121. Each upper end is a movable joint (such as a ball joint, etc.). Therefore, each movable connecting rod 122 can be tilted with the upper end as the center. In addition, each movable connecting rod 122 is respectively composed of a piston and a cylinder. Therefore, each movable connecting rod 122 can be extended and retracted in a manner that the upper end and the lower end are close to or away from each other. In addition, each lower end of the plurality of movable connecting rods 122 is a movable joint similar to the upper end.

[0026] (Tilt)

[0027] The tilting body 123 is connected to each lower end of the plurality of movable links 122 at the peripheral edge of the upper surface thereof. The tilting body 123 can be tilted in accordance with the extension and contraction degree of each movable link 122.

[0028] In addition, the tilting mechanism 12 is not limited to the above-mentioned structure. For example, the tilting mechanism may be configured in a manner that each movable link can bend and stretch. Furthermore, the tilting body 123 may be tilted by adjusting the bending angle of the upper end of each movable link using the power of a motor or the like. In addition, the tilting mechanism may be configured in a manner that the upper end of a rod-shaped movable link can be moved along the lower surface of the base 121. Furthermore, the tilting body 123 may be tilted by moving the upper end of the movable link to move the lower end up and down.

[0029] 〔Control lever〕

[0030] In addition, the control rod 11 is provided under the tilt mechanism 12. The control rod 11 according to the present embodiment includes a base rod 112 and a pair of vertical rods 111.

[0031] (Pole)

[0032] The upper ends of the pair of upright rods 111 are fixed to the tilting body 123 of the tilting mechanism 12 , and extend downward and to the left and right in a manner separated from each other.

[0033] (Base rod)

[0034] The base rod 112 is a member for the user to hold. The left and right ends of the base rod 112 are respectively fixed to the lower ends of the pair of vertical rods 111. The base rod 112 involved in this embodiment has one or more operating parts 112a that can be operated by the user U. The operating part 112a can be a button or a sheet-like sensor attached to the base rod 112.

[0035] In this way, the control rod 11 (particularly the base rod 112 ) connected to the plurality of movable links 122 tilts according to the tilt of the tilting body 123 of the tilting mechanism 12 .

[0036] (Force sensor)

[0037] The force sensor 13 is used to detect the force and moment acting on the control rod 11 from the user U. The plurality of force sensors 13 according to the present embodiment are electrostatic capacitance force sensors, and are mounted on the tilt mechanism 12. In addition, the force sensor 13 according to the present embodiment is attached to the base 121 of the tilt mechanism 12. The force sensor 13 detects the strain generated in the base 121 due to the user U trying to move the base rod 112. And based on the detection result, the force acting on the base rod 112 of the control rod 11, the moment acting on the base rod 112 around the X-axis passing through the tilt mechanism 12 in the front-back direction, and the moment acting on the base rod 112 around the Y-axis passing through the tilt mechanism 12 in the left-right direction are calculated. Thus, the simulation device 2 described later can determine the posture of the user U (whether the user U wants to push the base rod 112 or pull the base rod 112), the way of applying the body weight (in which direction of the left and right the body is wanted to be rotated), etc. Each force sensor 13 repeatedly detects the strain generated in the base 121 and the force and moment acting on the control rod 11 at a predetermined cycle. The force sensor 13 may be a strain gauge type force sensor.

[0038] Cycloid

[0039] The cycloid 16 is a member for hanging the hanging bag 17 described later. The cycloid 16 can be a rope-shaped member or a rod-shaped member that can swing around the upper end. The upper end of the cycloid 16 is fixed to the central part of the lower surface of the tilting body 123 of the tilting mechanism 12, and the cycloid 16 extends downward. The lower end of the cycloid 16 is provided with a snap-fitting portion (safety hook) that snaps the hanging bag 17 in a detachable manner. In addition, the cycloid 16 can also be provided at a location (ceiling, etc.) where the tilting mechanism 12 is provided, and at a position to the side (rear) of the tilting mechanism 12.

[0040] 〔Hanging bag〕

[0041] The hanging bag 17 is suspended by the cycloid 16 and supports the user's trunk and legs. The type of the hanging bag 17 is not particularly limited. That is, the hanging bag 17 can be an apron type, a sky floating type, or a front zipper type. The center of the upper surface of the hanging bag 17 is provided with an engaged portion for engaging with the engaging portion of the cycloid 16.

[0042] 〔Photodetector〕

[0043] The photodetector 14 is used to detect light emitted by the HMD 3 described later. A plurality of photodetectors 14 are arranged so as to surround the interface device 1. The photodetectors 14 involved in this embodiment are arranged on the wall of the room where the interface device 1 is installed. In addition, the photodetectors 14 involved in this embodiment are arranged in a matrix at predetermined intervals. In addition, the arrangement of the photodetectors 14 may be, for example, an oblique arrangement or a random arrangement.

[0044] 〔Input and output section〕

[0045] The input / output unit 15 provides a detection signal to the simulation device 2. The detection signal is a signal expressing force and torque. In addition, the input / output unit 15 obtains a control signal for controlling the tilt mechanism 12 to tilt the control rod 11 from the simulation device 2. The input / output unit 15 is composed of a communication module for communicating with the simulation device 2 by wire or wireless, or a terminal for connecting to the simulation device 2 by wire.

[0046] The input / output unit 15 according to the present embodiment provides the simulation device 2 with identification information (ID, installation position, etc.) of the photodetector 14 that detects the light emitted from the HMD 3. In addition, the input / output unit 15 according to the present embodiment provides the simulation device 2 with a switching signal corresponding to the operation performed on the operation unit 112a of the joystick 11.

[0047] [Simulation device]

[0048] The simulation device 2 is used to generate a virtual space. The simulation device 2 involved in this embodiment generates a virtual space obtained by simulating the air. Figure 2 As shown, the simulation device 2 includes a processor 21 and a memory 22 .

[0049] (Memory)

[0050] The memory 22 stores a control program for operating the simulation device 2. The memory 22 according to the present embodiment also stores image data for generating a virtual space.

[0051] (processor)

[0052] The processor 21 generates a VR (Virtual Reality) image that reproduces the scenery in the air. The processor 21 generates the VR image based on image data obtained by photographing a place for actually experiencing hang gliding. In addition, the processor 21 generates an image of a virtual space in which the surrounding scenery moves backward (it looks like the user U is flying). In addition, the processor 21 involved in this embodiment determines the direction of the face of the user U based on the identification information of the photodetector 14 that detects light, and rotates the virtual space to match the direction of the face of the user U. Moreover, the processor 21 sends the generated virtual space data to the HMD 3 via a communication module not shown. In addition, when the processor 21 obtains a switching signal from the interface device 1, it changes at least one of the place (location), altitude, flight speed and sound in the virtual space to the content corresponding to the switching signal.

[0053] The processor 21 according to the present embodiment generates data of minute vibrations of the aircraft body during gliding, and transmits the generated vibration data to the interface device 1 via the communication module.

[0054] In addition, the processor 21 determines the tilt direction and tilt angle of the joystick 11 based on the state of the atmosphere in the virtual space and the posture of the user U determined by the force and torque. "State" refers to the direction of wind / airflow, the strength of wind / airflow, etc. For example, when the user U pushes (pull back) the arm (the force sensor 13 detects the force on the joystick 11 toward the front (back)), the processor 21 provides the interface device 1 with a control signal instructing to tilt the joystick 11 toward the front (back). In addition, when the user U applies weight to the right (left) (the force sensor 13 detects the force on the right end (left end) of the joystick 11 toward the bottom), the processor 21 provides the interface device 1 with a control signal instructing to tilt the joystick 11 in a right-down (left-down) manner. The processor 21 repeatedly detects the force and torque acting on the joystick 11 at a predetermined cycle. As a result, the processor 21 determines a different tilt direction and tilt angle each time according to the temporal change of the state of the atmosphere in the virtual space (the movement of the scenery in the virtual space).

[0055] In addition, the processor 21 may also be configured to, for example, obtain image data captured by a wearable camera worn by an expert in hang gliding when the expert is actually hang gliding, and to create a VR image based on the data. In this way, the user U can immerse himself in the feeling of experiencing the high-level hang gliding performed by the expert. In addition, the processor 21 may also be configured to obtain image data captured from a place where the expert has left when the expert is actually hang gliding, and to generate a virtual space based on the data. In this way, the user U feels like he is hang gliding in parallel with the expert, which becomes a more interesting experience.

[0056] In addition, when the processor 21 is connected to a plurality of interface devices 1 and a plurality of HMDs 3, the processor 21 may be configured to generate a virtual space in which the virtual images of other users other than the user wearing the HMD are displayed as a virtual space provided to each HMD. For example, when a first user and a second user wear HMDs 3 respectively and experience hang gliding through different interface devices 1, data of a virtual space in which the virtual image of the second user (the virtual image of the first user) is displayed is provided to the HMD 3 of the first user (the second user). In this way, in the virtual space, a plurality of users can enjoy hang gliding together or compete in hang gliding skills. If the number of users is large, a competition for prize money can also be held in the virtual space.

[0057] In addition, the processor 21 may be configured to generate a virtual space that is not a VR image and an avatar of the user U existing in the virtual space. In this case, the processor 21 may be configured to change the posture of the avatar based on the state of the atmosphere of the virtual space and the posture of the user U.

[0058] The processor 21 may also be configured to generate sounds in the virtual space and transmit the sounds to the HMD 3. The sounds include the sound of the aircraft or the user breaking through the wind, the sound of the aircraft's sails fluttering in the wind, and wireless communication with people on the ground.

[0059] [Head-mounted display]

[0060] The HMD 3 displays an image representing a virtual space acquired from the simulation device 2. In addition, the HMD 3 is worn on the head of the user U when the user U rides on the joystick 11. As a result, the user U can obtain a sense of presence as if he or she is in the virtual space. The simulation device 2 involved in this embodiment generates a VR image, so the user U wearing the HMD 3 can immerse himself or herself in a virtual space with a higher sense of reality. In addition, the simulation device 2 involved in this embodiment generates an image of a virtual space in which the surrounding scenery moves backward, so the user U wearing the HMD 3 can immerse himself or herself in a feeling of moving forward. In addition, the HMD 3 involved in this embodiment is configured to display flight information indicating at least one of a location, an altitude, and a flight speed in the virtual space (at the end of the display unit of the HMD 3) based on the information acquired from the simulation device 2. When the simulation device 2 changes at least one of the location, the altitude, and the flight speed according to the switching signal, the HMD 3 changes the displayed flight information.

[0061] The HMD 3 involved in this embodiment irradiates light in the direction in which the face of the user U is facing at least during the hang gliding experience of the user U. The light can be visible light or infrared light as long as it is different from the indoor light of the room where the interface device 1 is installed. The light irradiated from the HMD 3 is detected by some of the multiple photodetectors 14 arranged around the interface device 1.

[0062] In addition, the HMD 3 may have a built-in speaker. In this case, the HMD 3 may be configured to emit the sound in the virtual space acquired from the simulation device 2.

[0063] <Operation of the hang gliding experience system (interface device)>

[0064] When a predetermined start condition is satisfied, the system S configured as described above starts operating. Examples of the start condition include powering on the system S (interface device 1), the user U holding the joystick 11, and the user U performing a predetermined start operation.

[0065] When the system S starts to act, Figure 3 As shown, first, the simulation device 2 generates a virtual space (step A1), and provides the data of the virtual space to the HMD 3 worn by the user U (step A2). Then, the HMD 3 that receives the data of the virtual space displays the image of the virtual space on the display unit of the HMD 3 (step B1). Then, the scenery in the virtual space starts to move, and the hang gliding experience begins.

[0066] While the HMD 3 displays the virtual space, the interface device 1 repeatedly detects the force and torque acting on the joystick 11 at a predetermined cycle (step C1). Each time a force and torque are detected, the interface device 1 provides a detection signal to the simulation device 2 (step C2).

[0067] Then, the simulation device 2 that has received the detection signal repeatedly determines the tilt direction and tilt angle of the control rod 11 based on the state of the atmosphere in the generated virtual space and the posture of the user U determined based on the detection signal (step A3). Moreover, each time the tilt direction and tilt angle are determined, the simulation device 2 provides a control signal indicating the determined tilt direction and tilt angle to the interface device 1 (step A4). Then, the interface device 1 that has received the control signal controls the tilt mechanism to tilt the control rod 11 in the tilt direction and tilt angle indicated by the control signal (step C3).

[0068] <Effects of the hang gliding experience system>

[0069] The interface device 1 according to this embodiment tilts the joystick 11 by the tilt mechanism 12. Therefore, the user can tilt the joystick relative to the user. Therefore, according to the interface device 1 or the system S, the user can experience the movement of the joystick with a higher sense of reality during hang gliding in a virtual space.

[0070] <Modification>

[0071] The present invention is not limited to the above-mentioned embodiments, and various modifications can be made within the scope of the claims. That is, embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the protection scope of the present invention.

[0072] For example, the HMD 3 may include a sensor (gyro sensor, etc.) for detecting the movement of the head of the user U instead of the light irradiation function. In this case, the interface device 1 may not include the photodetector 14 .

[0073] In addition, the system S may also include an air blower not shown. The air blower is arranged in front of the user U in a manner to blow air toward the user U. In addition, the air blower is connected to the simulation device 2 to adjust the wind speed in accordance with the speed at which the user U flies in the virtual space. In this way, the user U is blown by the wind in accordance with the movements of the user U, and the realism of the hang gliding experience in the virtual space can be further improved. In addition, the system S may also be configured to be able to change the direction of the wind sent to the user U. Specifically, for example, the air blower may also be configured to be able to move around the user U, and an air blower may be arranged on the side in addition to the air blower arranged in front of the user U. In this case. The simulation device 2 may also be configured to tilt the control rod 11 in accordance with the change in wind direction. In this way, the generation of side winds, etc. can also be reproduced, so the user U can experience hang gliding with a higher degree of difficulty.

[0074] In addition, the system S may also be provided with a cushioning material below the interface device 1 (the floor surface of the room where the system S is installed, etc.). In this way, when the user U falls due to damage to the cycloid 16 or the hanging bag 17, poor engagement between the cycloid 16 and the hanging bag 17, etc., the cushioning material catches the user U, thereby preventing the user U from being injured.

[0075] Furthermore, part or all of the functions of the above-mentioned processor may be realized by a logic circuit.

[0076] 〔Summarize〕

[0077] The interface device involved in mode 1 of the present invention is used to provide a user with a hang gliding experience in a virtual space, and the structure of the interface device is provided with: a joystick for the user to hold; a tilt mechanism that supports the joystick from above the joystick in a manner that enables the joystick to be tilted; a force sensor mounted on the tilt mechanism to detect the force and torque acting from the user on the joystick; and an input-output unit that provides a signal representing the force and the torque to a simulation device for generating the virtual space, and obtains a control signal from the simulation device for controlling the tilt mechanism to tilt the joystick.

[0078] The interface device according to aspect 2 of the present invention may be configured such that, in aspect 1 described above, the tilt mechanism is a parallel link mechanism.

[0079] The structure of the hang gliding experience system involved in Mode 3 of the present invention can also be set to include: the interface device recorded in the above-mentioned Mode 1 or 2; and the simulation device, wherein the simulation device determines the tilt direction and tilt angle of the control rod based on the state of the atmosphere in the virtual space and the posture of the user determined according to the force and the torque.

[0080] The hang gliding experience system according to aspect 4 of the present invention may be configured such that, in aspect 3, it further includes a head mounted display for displaying an image representing the virtual space acquired from the simulation device.

Claims

1. An interface device for providing a user with a hang gliding experience in a virtual space, the interface device being characterized by: a control lever for the user to hold; a tilting mechanism that supports the control rod from above the control rod so that the control rod can be tilted; a force sensor mounted on the tilt mechanism to detect force and torque applied to the control rod by the user; as well as An input-output unit supplies a signal expressing the force and the moment to a simulation device for generating the virtual space, and acquires a control signal for controlling the tilt mechanism to tilt the joystick from the simulation device.

2. The interface device according to claim 1, characterized in that: The tilting mechanism is a parallel connecting rod mechanism.

3. A hang gliding experience system, characterized in that: include: The interface device according to claim 1 or 2; as well as The simulation device, The simulation device determines the tilt direction and tilt angle of the joystick based on the state of the atmosphere in the virtual space and the posture of the user determined according to the force and the torque.

4. The hang gliding experience system according to claim 3, characterized in that: It also includes a head-mounted display, which displays an image representing the virtual space acquired from the simulation device.