Interface device and hang gliding experience system
The interface device with a tilting mechanism and force sensor, combined with a simulation device controlling virtual space atmosphere, addresses the lack of realism in conventional hang glide simulations by enabling users to tilt the control bar and interact with simulated conditions, thereby enhancing the virtual experience.
Patent Information
- Application Number
- JP2023087222
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-26
- Publication Date
- 2024-12-06
AI Technical Summary
Conventional hang glide simulation devices lack the realism of control bar operation, as the control bar is fixed and cannot be tilted relative to the user, unlike in real hang gliding.
An interface device with a tilting mechanism that supports a control bar tiltably, equipped with a force sensor to detect user inputs, and a simulation device that controls virtual space atmosphere to determine tilting directions and angles based on user posture and forces.
Enables a more realistic hang glide experience in a virtual space by allowing users to tilt the control bar and interact with simulated atmospheric conditions, enhancing immersion and realism.
Smart Images

Figure 2024170196000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an interface device and a hang gliding experience system. [Background technology]
[0002] Conventionally, a simulation device for simulating the experience of hang gliding, as described in Patent Document 1, is known. This simulation device is used together with an image display device that can display an image according to the orientation of the user's face. This simulation device also has a bodily sensation drive unit that controls the user's posture in accordance with the image displayed on the image display device. The bodily sensation drive unit also has a control device that tilts a part supporting the user in accordance with the inclination of the user's body as experienced by the image displayed on the image display device. [Prior art documents] [Patent documents]
[0003] [Patent Document 2] JP 2010-12290 A Summary of the Invention [Problem to be solved by the invention]
[0004] In real hang gliding, the user of the aircraft is suspended swingably under the aircraft. Therefore, the control bar fixed to the aircraft can be tilted relative to the user. This allows the user to accelerate or decelerate the aircraft or change direction by tilting the control bar back and forth and left and right. However, in a conventional simulation device such as that described in Patent Document 1, a member corresponding to the control bar is fixed to a member supporting the user. Therefore, the user of the simulation device cannot tilt the control bar relative to himself or herself. In other words, if a conventional simulation device is used for hang gliding in a virtual space, the reality of the control bar's movement is not sufficient, and an experience far from that obtained in real hang gliding can only be obtained.
[0005] One aspect of the present invention has been made in consideration of the above-mentioned problems, and aims to enable a user to experience more realistic control bar movement during hang gliding in a virtual space. [Means for solving the problem]
[0006] In order to solve the above problems, an interface device according to one embodiment of the present invention is an interface device for providing a user with a hang gliding experience in a virtual space, and includes a control bar held by the user, a tilting mechanism for supporting the control bar so that it can be tilted from above, a force sensor mounted on the tilting mechanism for detecting the force and moment acting on the control bar from the user, and an input / output unit for providing signals representing the force and moment to a simulation device that generates the virtual space, and for obtaining control signals from the simulation device for controlling the tilting mechanism so that the control bar tilts.
[0007] In addition, in order to solve the above-mentioned problems, a hang gliding experience system according to another aspect of the present invention includes the above-mentioned interface device and the simulation device, and the simulation device determines the tilt direction and tilt angle of the control bar based on the atmospheric conditions in the virtual space and the user's posture determined from the force and the moment. Effect of the Invention
[0008] According to each aspect of the present invention, a user can experience more realistic control bar movement during hang gliding in a virtual space. [Brief description of the drawings]
[0009] [Figure 1] 1 is a perspective view showing an example of a hang gliding experience system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing the electrical configuration of the system. [Diagram 3] 1 is a flowchart showing the flow of operations of the system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
[0011] <Configuration of the Hang Glide Experience System> The hang gliding experience system (hereinafter, system S) according to this embodiment provides a user U with a hang gliding experience in a virtual space. As shown in Figs. 1 and 2, the system S includes an interface device 1, a simulation device 2, and a head mounted display (hereinafter, HMD 3). As shown in Fig. 2, the devices 1 to 3 are connected to each other so as to be able to communicate with each other by wire or wirelessly. Note that the system S may include a plurality of interface devices 1 and HMDs 3. In this case, the plurality of interface devices 1 may be installed in the same room, or may be installed in different locations.
[0012] [Interface device] The interface device 1 is for providing a user U with a hang gliding experience in a virtual space. As shown in Fig. 1, the interface device 1 includes a control bar 11, a tilting mechanism 12, and a force sensor 13. In addition, as shown in Figs. 1 and 2, the interface device 1 according to this embodiment further includes a plurality of photodetectors 14, an input / output unit 15, a swing line 16, and a harness 17.
[0013] [Tilt mechanism] As shown in FIG. 1, the tilting mechanism 12 supports the control bar 11 from above so that it can be tilted. For this reason, the tilting mechanism 12 is provided a predetermined distance (approximately several meters) above the floor surface. The tilting mechanism 12 according to this embodiment is fixed to the ceiling of the room in which the system S is installed. The tilting mechanism 12 according to this embodiment is a parallel link. For this reason, the tilting mechanism 12 according to this embodiment includes a base 121 fixed to the ceiling, a plurality of movable links 122, and a tilting body 123.
[0014] (movable link) The upper ends of the multiple movable links 122 are each connected to the periphery of the base 121. Each upper end is a movable joint (such as a ball joint). Therefore, each movable link 122 can tilt around its upper end. Each movable link 122 is configured as a piston and a cylinder. Therefore, each movable link 122 can expand and contract so that its upper and lower ends move closer to and away from each other. Furthermore, each lower end of the multiple movable links 122 is a movable joint similar to the upper ends.
[0015] (tilting body) The tilting body 123 is connected at its lower surface peripheral edge to each lower end of the plurality of movable links 122. The tilting body 123 is capable of tilting according to the degree of expansion and contraction of each movable link 122.
[0016] The tilting mechanism 12 is not limited to the above-mentioned configuration. For example, the tilting mechanism may be configured so that each movable link can be bent and stretched. The tilting mechanism may be configured so that the bending angle of the upper end of each movable link can be adjusted by power such as a motor, thereby tilting the tilting body 123. The tilting mechanism may be configured so that the upper end of the rod-shaped movable link can move along the upper surface of the base 121. The tilting mechanism may be configured so that the lower end of the movable link can be moved up and down by moving the upper end of the movable link, thereby tilting the tilting body 123.
[0017] [Control Bar] In addition, the control bar 11 is provided below the tilting mechanism 12. The control bar 11 according to this embodiment includes a pair of uprights 111 and a base bar 112.
[0018] (Upright) The pair of uprights 111 have their upper ends fixed to the tilting bodies 123 of the tilting mechanism 12, and extend downward and to the left and right so as to be separated from each other.
[0019] (Base bar) The base bar 112 is held by the user. Both left and right ends of the base bar 112 are fixed to the lower ends of the pair of uprights 111, respectively. The base bar 112 according to this embodiment includes one or more operation units 112a that can be operated by the user U. The operation units 112a may be buttons, or may be sheet-like sensors or the like attached to the base bar 112.
[0020] The control bar 11 (particularly the base bar 112 ) connected to the multiple movable links 122 in this manner tilts in response to the tilting of the tilting body 123 of the tilting mechanism 12 .
[0021] (Force sensor) The force sensor 13 detects the force and moment acting on the control bar 11 from the user U. The force sensors 13 according to this embodiment are capacitance type force sensors and are mounted on the tilting mechanism 12. The force sensor 13 according to this embodiment is attached to the base 121 of the tilting mechanism 12. The force sensor 13 detects the distortion caused in the base 121 by the user U trying to move the base bar 112. Based on the detection result, the force acting on the base bar 112 of the control bar 11, the moment acting on the base bar 112 about the X-axis passing through the tilting mechanism 12 in the front-rear direction, and the moment acting on the base bar 112 about the Y-axis passing through the tilting mechanism 12 in the left-right direction, are calculated. This allows the simulation device 2, which will be described later, to identify the user U's posture (whether he is trying to push or pull the base bar 112), the way he is putting his weight (whether he is trying to turn the aircraft to the left or right), and the like. Each force sensor 13 repeats at a predetermined cycle the detection of the distortion occurring in the base 121 and the detection of the force and moment acting on the control bar 11. Note that the force sensor 13 may be a strain gauge type force sensor.
[0022] [Swing Line] The swing line 16 is for hanging the harness 17 described later. The swing line 16 may be a string-like member, or a rod-like member that can swing around its upper end. The swing line 16 has its upper end fixed to the center of the lower surface of the tilting body 123 of the tilting mechanism 12 and extends downward. The lower end of the swing line 16 is provided with an engagement part (carabiner) that detachably engages with the harness 17. The swing line 16 may be provided at a location (ceiling, etc.) where the tilting body 123 is provided, and at the side (rear) of the tilting mechanism 12.
[0023] [Harness] The harness 17 is suspended by the swing line 16 and supports the torso and legs of the user. The type of the harness 17 is not particularly limited. That is, the harness 17 may be of an apron type, a sky-floating type, or a front zipper type. The center of the upper surface of the harness 17 is provided with an engaged portion for engaging with an engaging portion of the swing line 16.
[0024] [Photodetector] The photodetector 14 detects light emitted by the HMD 3, which will be described later. A plurality of photodetectors 14 are arranged to surround the interface device 1. The photodetector 14 according to this embodiment is arranged on a wall of a room in which the interface device 1 is installed. The photodetectors 14 according to this embodiment are arranged in a matrix at predetermined intervals. The photodetectors 14 may be arranged, for example, diagonally or randomly.
[0025] [Input / output section] The input / output unit 15 provides a detection signal to the simulation device 2. The detection signal is a signal representing a force and a moment. The input / output unit 15 also acquires a control signal for controlling the tilting mechanism 12 so as to tilt the control bar 11 from the simulation device 2. The input / output unit 15 is configured with a communication module that communicates with the simulation device 2 in a wired or wireless manner, or a terminal for connecting to the simulation device 2 in a wired manner.
[0026] The input / output unit 15 according to this embodiment provides the simulation device 2 with identification information (ID, attachment position, etc.) of the photodetector 14 that detected the light irradiated by the HMD 3. In addition, the input / output unit 15 according to this embodiment provides the simulation device 2 with a switching signal corresponding to an operation performed on the operation unit 112a of the control bar 11.
[0027] [Simulation device] The simulation device 2 generates a virtual space. The simulation device 2 according to this embodiment generates a virtual space simulating the air. As shown in FIG. 2, the simulation device 2 includes a processor 21 and a memory 22.
[0028] (Memory) The memory 22 stores a control program for operating the simulation device 2. The memory 22 according to this embodiment also stores image data for generating a virtual space.
[0029] (Processor) The processor 21 generates a VR (Virtual Reality) image that reproduces an aerial landscape based on image data obtained by photographing a place where the hang glide is actually experienced. The processor 21 also generates an image of a virtual space in which the surrounding landscape moves backwards (the user U appears to be flying). The processor 21 according to the present embodiment also identifies the direction of the face of the user U based on the identification information of the photodetector 14 that detects light, and rotates the virtual space according to the direction of the face of the user U. The processor 21 then transmits the generated data of the virtual space to the HMD 3 via a communication module (not shown). When the processor 21 acquires a switching signal from the interface device 1, it also changes at least one of the location, altitude, flight speed, and sound in the virtual space to one corresponding to the switching signal.
[0030] The processor 21 according to the present embodiment generates data on minute vibrations occurring when the aircraft glides, and transmits the generated vibration data to the interface device 1 via the communication module.
[0031] The processor 21 also determines the tilt direction and tilt angle of the control bar 11 based on the state of the atmosphere in the virtual space and the posture of the user U determined from the force and moment. The "state" refers to the direction of wind and air current, the strength of wind and air current, and the like. For example, when the user U pushes (pulls) his / her arm out (pulls) (the force sensor 13 detects a force on the control bar 11 moving forward (backward), the processor 21 provides the interface device 1 with a control signal instructing the control bar 11 to tilt forward (backward). When the user U puts his / her weight on the right (left) (the force sensor 13 detects a force moving downward on the right end (left end) of the control bar 11), the processor 21 provides the interface device 1 with a control signal instructing the control bar 11 to tilt downward to the right (left). The processor 21 repeats detection of the force and moment acting on the control bar 11 at a predetermined period. As a result, the processor 21 determines a different tilt direction and tilt angle each time according to the change over time in the atmospheric condition in the virtual space (movement of the scenery in the virtual space).
[0032] The processor 21 may be configured to obtain, for example, data of a video of an advanced hang glider actually performing hang gliding, taken by a wearable camera attached to the advanced hang glider, and to create a VR video based on the data. In this way, the user U can feel as if he or she is experiencing a high-level hang glide performed by an advanced hang glider. The processor 21 may also be configured to obtain data of a video of the advanced hang glider actually performing hang gliding, taken from a location away from the advanced hang glider, and to generate a virtual space based on the data. In this way, the user U feels as if he or she is performing hang gliding alongside the advanced hang glider, resulting in a more interesting experience.
[0033] Furthermore, when a plurality of interface devices 1 and a plurality of HMDs 3 are connected, the processor 21 may be configured to generate a virtual space in which an avatar of a user other than the user wearing each HMD is shown as a virtual space to be provided to each HMD. For example, when a first user and a second user wear HMDs 3 and experience hang gliding with different interface devices 1, data of a virtual space in which an avatar of the second user (the avatar of the first user) is shown is provided to the HMD 3 of the first user (the second user). In this way, a plurality of users can enjoy hang gliding together in the virtual space and compete with each other in hang gliding skills. If the number of users becomes large, a competition with a prize money can be held in the virtual space.
[0034] Furthermore, the processor 21 may be configured to generate a virtual space that is not a VR image and an avatar of the user U existing in the virtual space. In this case, the processor 21 may be configured to change the posture of the avatar based on the atmospheric condition in the virtual space and the posture of the user U.
[0035] The processor 21 may also be configured to generate sounds in the virtual space and transmit them to the HMD 3. The sounds include the sounds of the aircraft and the user cutting through the wind, the sounds of the sails of the aircraft flapping, radio communication with people on the ground, and the like.
[0036] [Head-mounted display] The HMD3 displays an image representing the virtual space acquired from the simulation device 2. The HMD3 is also worn on the head of the user U when the user U boards the control bar 11. This allows the user U to obtain a sense of realism as if the user U were present in the virtual space. Since the simulation device 2 according to this embodiment generates a VR image, the user U wearing the HMD3 can be immersed in the sensation of being present in a more realistic virtual space. Furthermore, since the simulation device 2 according to this embodiment generates an image of the virtual space in which the surrounding scenery moves backwards, the user U wearing the HMD3 can be immersed in the sensation of being forward. Furthermore, the HMD3 according to this embodiment is configured to display flight information indicating at least one of the location, altitude, and flight speed in the virtual space (at the edge of the display unit of the HMD3) based on the information acquired from the simulation device 2. When the simulation device 2 changes at least one of the location, altitude, and flight speed in response to the switching signal, the HMD3 changes the flight information to be displayed.
[0037] The HMD 3 according to this embodiment irradiates light in the direction in which the user U faces at least while the user U is experiencing the hang glide. The light may be visible light, infrared light, or the like, as long as it is different from the indoor light in the room in which the interface device 1 is installed. The light irradiated from the HMD 3 is detected by one of a plurality of photodetectors 14 arranged around the interface device 1.
[0038] The HMD 3 may have a built-in speaker. In that case, the HMD 3 may be configured to emit sound in the virtual space acquired from the simulation device 2.
[0039] <Operation of the Hang Glide Experience System (Interface Device)> The system S configured as described above starts operation when a predetermined start condition is satisfied. The start condition may be when the power of the system S (interface device 1) is turned on, when the user U grasps the control bar 11, when the user U performs a predetermined start operation, etc.
[0040] 3, when the system S starts to operate, the simulation device 2 first generates a virtual space (step A1) and provides the data to the HMD 3 worn by the user U (step A2). Then, the HMD 3 that has received the virtual space data displays an image of the virtual space on the display unit (step B1). Then, the scenery in the virtual space starts to move, and the hang gliding experience begins.
[0041] While the virtual space is displayed on the HMD 3, the interface device 1 repeatedly detects the force and moment acting on the control bar 11 at a predetermined period (step C1). Then, every time the force and moment are detected, the interface device 1 provides a detection signal to the simulation device 2 (step C2).
[0042] Then, the simulation device 2, which has acquired the detection signal, repeatedly determines the tilt direction and tilt angle of the control bar 11 based on the atmospheric state in the generated virtual space and the posture of the user U identified from the detection signal (step A3). Then, every time the tilt direction and tilt angle are determined, the simulation device 2 provides a control signal indicating the determined tilt direction and tilt angle to the interface device 1 (step A4). Then, the interface device 1, which has acquired the control signal, controls the tilt mechanism to tilt the control bar 11 in the tilt direction and tilt angle indicated by the control signal (step C3).
[0043] <Effects of the Hang Glide Experience System> In the interface device 1 according to this embodiment, the control bar 11 is tilted by the tilt mechanism 12. This allows the user to tilt the control bar relative to the user. Therefore, the interface device 1 or the system S allows the user to experience more realistic control bar operation during hang gliding in a virtual space.
[0044] <Modification> The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. In other words, embodiments obtained by appropriately combining the technical means disclosed in the different embodiments are also included in the technical scope of the present invention.
[0045] For example, instead of the function of emitting light, the HMD 3 may be provided with a sensor (such as a gyro sensor) that detects the movement of the head of the user U. In that case, the interface device 1 does not need to include the photodetector 14.
[0046] The system S may also include a blower (not shown). This blower is disposed in front of the user U so as to blow air toward the user U. The blower is connected to the simulation device 2 and adjusts the wind speed according to the flying speed in the virtual space. In this way, the user U receives wind according to his / her movements, and the reality of the hang glide experience in the virtual space can be further improved. The system S may be configured to change the direction of the wind sent to the user U. Specifically, for example, the blower may be configured to be movable around the user, or may be disposed on the side of the user U, separate from the blower disposed in front of the user U. In this case, the simulation device 2 may be configured to tilt the control bar 11 according to the change in the wind direction. In this way, the generation of a crosswind can also be reproduced, so that the user U can experience a hang glide with a higher degree of difficulty.
[0047] Furthermore, the system S may be provided with a shock-absorbing material below the interface device 1 (such as the floor surface of the room in which the system S is installed). In this way, if the user U falls due to damage to the swing line 16 or the harness 17, or due to poor engagement between the swing line 16 and the harness 17, the shock-absorbing material will catch the user, thereby preventing the user U from being injured.
[0048] In addition, some or all of the functions of the processor may be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of each of the control blocks may be realized by, for example, a quantum computer.
[0049] 〔summary〕 The interface device of aspect 1 of the present invention is an interface device for providing a user with a hang gliding experience in a virtual space, and comprises a control bar held by the user, a tilting mechanism that supports the control bar from above so that it can be tilted, a force sensor mounted on the tilting mechanism that detects the force and moment acting on the control bar from the user, and an input / output unit that provides signals representing the force and moment to a simulation device that generates the virtual space, and obtains control signals from the simulation device for controlling the tilting mechanism so as to tilt the control bar.
[0050] An interface device according to a second aspect of the present invention may be configured in such a way that in the first aspect, the tilt mechanism is a parallel link.
[0051] A hang gliding experience system according to aspect 3 of the present invention includes the interface device described in aspect 1 or 2 above, and the simulation device, and the simulation device may be configured to determine the tilt direction and tilt angle of the control bar based on the atmospheric conditions in the virtual space and the user's posture determined from the force and the moment.
[0052] A hang gliding experience system according to aspect 4 of the present invention may be configured in accordance with aspect 3 above, further including a head-mounted display that displays an image representing the virtual space obtained from the simulation device. [Explanation of symbols]
[0053] S: Hang glide experience system, 1: Interface device, 11: Control bar 111: upright, 112: base bar, 12: tilting mechanism, 121: base, 122: movable link, 123: tilting body, 13: force sensor, 14: photodetector, 15: input / output unit, 16: swing line, 17: harness, 2: simulation device, 21: processor, 22: memory, 3: head-mounted display, U: user
Claims
1. An interface device for providing a user with a hang gliding experience in a virtual space, comprising: a control bar that is held by the user; a tilt mechanism that supports the control bar from above so that the control bar can be tilted; a force sensor mounted on the tilt mechanism for detecting a force and a moment acting on the control bar from the user; an input / output unit that provides a signal representing the force and the moment to a simulation device that generates the virtual space, and obtains a control signal from the simulation device for controlling the tilting mechanism so that the control bar tilts; 1. An interface device comprising:
2. The tilt mechanism is a parallel link.
2. The interface device according to claim 1 .
3. An interface device according to claim 1 or 2; The simulation device, the simulation device determines a tilt direction and a tilt angle of the control bar based on an atmospheric state in the virtual space and a posture of the user identified from the force and the moment; A hang gliding experience system.
4. Further comprising a head mounted display that displays an image representing the virtual space acquired from the simulation device.
4. The hang gliding experience system according to claim 3, wherein the hang gliding experience system comprises:
Citation Information
Patent Citations
Image display device and simulation apparatus
JP2010012290A
