A multi-sensory spacewalk training device that simulates weightlessness
By introducing multi-perception simulation technology into the virtual reality spacewalk training system, multi-channel feedback of auditory, vestibular and force-tactile sensation is achieved using virtual reality helmets, data gloves and driven seats, the problem of low immersion in the existing system is solved. , improves the authenticity and safety of training.
Patent Information
- Application Number
- CN202011534476.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-12-22
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2040-12-22
AI Technical Summary
The existing virtual reality spacewalk training system mainly relies on visual simulation, ignoring hearing, vestibular sense and force touch, resulting in reduced immersion and may cause symptoms such as vertigo and nausea.
A spacewalk training device with multi-perception simulated weightless conditions was designed, combining virtual reality helmets, data gloves and driven seats to realize multi-channel perceptual feedback of auditory, vestibular and force touch through position sensors and universal wheels to simulate Multi-sensory system perception and motion control in space weightless state.
It significantly improves the immersion in virtual training, relieves symptoms such as vertigo and nausea, and provides a more realistic experience and training equipment for virtual training under simulated weightless conditions.
Smart Images

Figure CN112562444B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the field of spacewalk training devices, and in particular to a spacewalk training device capable of simulating weightlessness conditions under multi-sensory sensing. Background Art
[0002] Virtual reality technology can simulate human perception under weightlessness in space to a certain extent on the ground. By building a virtual space scene, astronauts can immerse themselves in the virtual environment to simulate flight missions and interact with the virtual environment. Virtual reality technology has the characteristics of high degree of digitization, high reusability, ability to break through physical environment limitations, good safety, etc. It has been successfully used by NASA, ESA, Canada and other research institutions, and has become an important development direction for astronaut training in space exploration.
[0003] Extravehicular activity simulation training is an important application field of virtual training. Outside the cabin, spacewalks are generally achieved by grasping the handrails. At present, the simulation of spacewalk tasks in virtual training systems mainly adopts visual simulation, which constructs realistic space scenes, cooperates with motion tracking and motion simulation algorithms, and uses virtual reality helmets and operating handles to interact with virtual scenes to achieve extravehicular spacewalk simulation training based on visual perception. Although this training method can simulate the task process of spacewalks, it ignores the auditory, vestibular and force-tactile perception of people in the actual task process, and only judges the changes in their own speed and motion state through the distance, size, direction and other information fed back by visual information, which greatly reduces people's sense of immersion and is prone to dizziness, nausea and other symptoms caused by the inconsistency between vision and vestibular and force-tactile perception. Summary of the invention
[0004] The purpose of the present invention is to provide a spacewalk training device with multi-sensory simulated weightlessness conditions. In addition to traditional visual feedback, the present invention also has multi-channel sensory feedback of hearing, vestibular sense, force and touch, thereby more realistically simulating the multi-sensory system perception and motion control mode of the human body under the weightlessness state in space, which can greatly enhance the immersion of people in virtual training and relieve symptoms such as dizziness and nausea, providing new ideas and training equipment for conducting virtual training under simulated weightlessness conditions.
[0005] To achieve the above object, the present invention provides the following solutions:
[0006] A multi-sensory spacewalk training device for simulating weightlessness, comprising:
[0007] A virtual reality helmet, worn on the trainee’s head, is used to collect head movement information;
[0008] Data gloves, worn on the trainee’s hands, are used to collect hand movement information;
[0009] A support structure, comprising a support, a handrail and a handrail position sensor, wherein the handrail and the handrail position sensor are both arranged on the support, and are used to collect handrail position information when the trainee grasps the handrail;
[0010] A driven seat, used to drive the trainee to move or fix the trainee;
[0011] A simulation computer is connected to the virtual reality helmet, the data gloves and the support structure respectively, and is used to generate a virtual scene according to the head movement information, the hand movement information and the handrail position information, and feed back the virtual scene to the trainee.
[0012] Optionally, the virtual reality helmet is integrated with a head position sensor, and the head position sensor is used to collect head movement information.
[0013] Optionally, a hand position sensor is provided on the data glove, and the hand position sensor is used to collect hand movement information.
[0014] Optionally, a plurality of universal wheels are arranged at the bottom of the support structure, the steering wheels are connected to the support via a screw rod, and a brake device is arranged on the universal wheels.
[0015] Optionally, the support structure includes a plurality of handrails, the height of the handrails is adjustable, and the horizontal distance between each handrail is adjustable.
[0016] Optionally, the handrail position sensor is fixed to the bracket by a fixing device, the fixing device includes a crab claw clamp and a magic arm bracket, the position sensor is connected to the magic arm bracket by bolts, the magic arm bracket is connected to the crab claw clamp through a screw hole, and the crab claw clamp is fixed to the bracket.
[0017] Optionally, a universal wheel is provided at the bottom of the driven seat, and the steering wheel provided on the driven seat has the same structure as the universal wheel provided on the support structure.
[0018] Optionally, the driven seat is made of aluminum profile.
[0019] Optionally, the training device supports multiple training modes simultaneously, including: in the first training mode, the universal wheel at the bottom of the support structure is locked to fix the position of the handrail, and the universal wheel at the bottom of the driven seat is loosened to simulate the multi-channel perception of vision, force touch and vestibular sense during the task; in the second training mode, the universal wheel at the bottom of the driven seat is locked to fix the position of the seat to lock the position of the trainee, and the universal wheel at the bottom of the support structure is loosened to simulate the visual and force touch perception during the task; in the first training mode, the support structure is not used to simulate the visual perception during the task
[0020] According to the specific embodiments provided by the present invention, the present invention discloses the following technical effects:
[0021] The multi-sensory simulated weightlessness spacewalk training device provided by the present invention adopts a multi-sensory simulation method to reduce the above differences, uses a real handrail (fixed on a bracket) equipped with low-damping universal wheels and a driven seat to simulate a weightlessness environment in which a trainee moves in a plane direction, and tracks the trainee's motion state in real time through a virtual reality helmet and data gloves worn on the trainee, tracks the position of the handrail through a position sensor installed on the bracket structure, and uses the above position and motion information to locate the position of the virtual handrail in the virtual space scene in real time so that it completely overlaps with the real handrail, and drives the movement of the virtual astronaut in the scene, so that the trainee has multi-channel perceptual feedback of hearing, vestibular sense, force and touch in addition to traditional visual feedback during the extravehicular spacewalk simulation training, thereby more realistically simulating the multi-sensory system perception and motion control mode of the human body in the weightlessness state of space, which can greatly enhance the immersion of people in virtual training and relieve symptoms such as dizziness and nausea, and provide new ideas and training equipment for conducting virtual training under simulated weightlessness conditions. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0023] Figure 1 This is a schematic diagram of the modules of a multi-sensory spacewalk training device for simulating weightlessness according to an embodiment of the present invention;
[0024] Figure 2 This is an overall block diagram of a multi-sensory spacewalk training device for simulating weightlessness according to an embodiment of the present invention;
[0025] Figure 3 is a schematic diagram of the support structure;
[0026] Figure 4 This is a schematic diagram of a universal wheel;
[0027] Figure 5 is a schematic diagram of a driven seat;
[0028] Figure 6 Schematic diagram of trainees holding the handrail. DETAILED DESCRIPTION
[0029] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0030] The purpose of the present invention is to provide a spacewalk training device with multi-sensory simulated weightlessness conditions. In addition to traditional visual feedback, the present invention also has multi-channel sensory feedback of hearing, vestibular sense, force and touch, thereby more realistically simulating the multi-sensory system perception and motion control mode of the human body under the weightlessness state in space, which can greatly enhance the immersion of people in virtual training and relieve symptoms such as dizziness and nausea, providing new ideas and training equipment for conducting virtual training under simulated weightlessness conditions.
[0031] The difference in human perception between the environment simulated by the training system based on virtual reality to simulate the weightlessness in space and the actual natural environment is mainly reflected in two aspects: one is the change in human perception caused by the immersion and simulation of the virtual environment itself; the other is the change in human perception due to the special environment of space flight (mainly weightlessness) and the simulation of this special environment in a virtual environment. The present invention adopts a multi-sensory simulation method to reduce the above differences. A real handrail (fixed on a bracket) equipped with low-damping universal wheels and a driven seat are used to simulate a weightless environment in which a trainee moves in a planar direction. The trainee's motion state is tracked in real time by a position sensor and a data glove worn on the trainee. The position of the handrail is tracked and located by a position sensor installed on the bracket structure. The position and motion information are used to locate the position of the virtual handrail in the virtual space scene in real time so that it completely overlaps with the real handrail, and the movement of the virtual astronaut in the scene is driven. In addition to the traditional visual feedback, the trainee has multi-channel sensory feedback of hearing, vestibular sense, force and touch during the extravehicular spacewalk simulation training, thereby more realistically simulating the multi-sensory system perception and motion control mode of the human body in the weightless state of space, which can greatly enhance the immersion of people in virtual training and relieve symptoms such as dizziness and nausea, and provide new ideas and training equipment for conducting virtual training under simulated weightlessness conditions.
[0032] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
[0033] like Figure 1-2 As shown, a multi-sensory space walking training device for simulating weightlessness conditions includes: a virtual reality helmet 1, a data glove 2, a support structure 3, a driven seat 4 and a simulation computer 5.
[0034] The virtual reality helmet 1 is worn on the trainee's head and is used to collect head movement information; the virtual reality helmet 1 is integrated with a head position sensor, and the head position sensor is used to collect head movement information. The virtual reality helmet 1 is connected to the simulation computer 5 and worn on the trainee's head. The trainee's head position and real-time movement are obtained according to the position sensor integrated in the helmet 1, the position of the eyes is calculated according to the head position, and the first-person perspective image of the virtual astronaut at the current moment is rendered based on the position of the eyes as the viewpoint, and the image will move or rotate with the movement of the virtual astronaut. The virtual reality helmet 1 is equipped with two headphones, which can feed back scene sound effects such as touch and background sound to the trainee to achieve auditory feedback.
[0035] The data gloves 2 are worn on the trainee's hands to collect hand movement information; the data gloves 2 are provided with hand position sensors, which are used to collect hand movement information. The data gloves 2 are worn on the trainee's left and right hands, and can output the posture information of the trainee's palms and finger joints in real time, which is used to drive the movement of the virtual astronaut's hands and realize the interactive control of the operation of virtual objects during the training process.
[0036] The support structure 3 includes a support, a handrail and a handrail position sensor. The handrail and the handrail position sensor are both arranged on the support and are used to collect handrail position information when the trainee grasps the handrail. The support structure 3 includes a plurality of handrails, the height of the handrails is adjustable, and the horizontal distance between each handrail is adjustable. A plurality of universal wheels are arranged at the bottom of the support structure, the direction wheels are connected to the support through a screw rod, and a brake device is arranged on the universal wheel.
[0037] like Figure 3 As shown, the support structure 3 is flexibly constructed by using profiles and corner pieces, and four low-damping universal wheels are installed at the bottom. Figure 4As shown in the figure, the universal wheel is connected to the bracket through a screw rod, and the pulley with brake device can be set to two states: locked and released. In the released state, the pulley can roll and the bearing can rotate 360 degrees. The locked state will prevent the pulley from rolling and the bearing from rotating at the same time. A rectangular square tube is used to simulate the handrail, and a fixed base is provided. The handrail is connected to the bracket body by bolts. The handrail position height is adjustable, and the horizontal distance between the handrails is adjustable. In order to facilitate the fixing of the position sensor on the bracket, a crab clamp with a 1 / 4 screw hole is used to fix it on the bracket structure profile, and the magic arm bracket is connected to the crab clamp through the 1 / 4 screw hole. Finally, the position sensor is connected to the magic arm bracket through bolts, which can not only provide effective and reliable positioning, but also can adjust the magic arm bracket as needed to change the angle of the position sensor. The position of the handrail in the virtual scene is obtained according to the sensor position tracking and virtual-real fusion algorithm.
[0038] like Figure 5 As shown, the driven seat 4 is used to drive the trainee to move or fix the trainee. The driven seat body is designed and made of aluminum profiles and is equipped with 4 sets of low-resistance universal wheels, which also have locking and releasing functions. The trainee is trained in a sitting position, and the power for the horizontal movement of the seat is provided by grabbing the handrail.
[0039] The friction between the driven seat and the ground is relatively large, which can simulate the horizontal weightlessness condition to a certain extent. In actual training, it can be replaced with a suspension device or air suspension or magnetic suspension seat as needed to better reduce friction and improve the level of simulated weightlessness.
[0040] The simulation computer 5 is connected to the virtual reality helmet, the data glove and the support structure respectively, and is used to generate a virtual scene according to the head movement information, the hand movement information and the handrail position information, and feed the virtual scene back to the trainee. The virtual scene uses the Unity three-dimensional graphics engine to import three-dimensional models of astronauts, space stations, etc., and renders in real time to generate virtual space scenes, as well as interactive scene images such as handrails and virtual people.
[0041] like Figure 6 As shown, the trainees grasp the real handrail according to the position of the handrail in the virtual scene, control the movement of the body by applying force with their hands, and drive the horizontal movement of the driven seat to simulate the human force, touch, vestibular sense and other perceptions during space walking.
[0042] The training device supports multiple training modes at the same time. First, lock the universal wheel under the handrail bracket to fix the handrail position, and loosen the universal wheel under the driven seat, which can simulate the multi-channel perception of vision, force touch, and force touch during the task; second, lock the universal wheel under the driven seat to fix the position of the seat to lock the position of the trainee, and loosen the universal wheel under the handrail bracket, which can simulate the visual and force touch perception during the task, and remove the proprioceptive vestibular motion perception; third, do not use the real handrail, which can simulate the visual perception during the task, and remove the force touch and proprioceptive vestibular motion perception. Multiple usage modes can be flexibly switched according to the site conditions, and can also be used as an experimental device to study the impact of different perception channels on task execution.
[0043] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0044] The principles and implementation methods of the present invention are described in this article using specific examples. The description of the above embodiments is only used to help understand the method and core idea of the present invention. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present invention.
Claims
1. A multi-sensory spacewalk training device for simulating weightlessness, characterized in that: include: A virtual reality helmet, worn on the trainee’s head, is used to collect head movement information; Data gloves, worn on the trainee’s hands, are used to collect hand movement information; A support structure, comprising a support, a handrail and a handrail position sensor, wherein the handrail and the handrail position sensor are both arranged on the support, and are used to collect handrail position information when a trainee grasps the handrail; A driven seat, used to drive the trainee to move or fix the trainee; a simulation computer, connected to the virtual reality helmet, the data gloves and the support structure respectively, for generating a virtual scene according to the head movement information, the hand movement information and the handrail position information, and feeding back the virtual scene to the trainee; The bottom of the support structure is provided with a plurality of universal wheels, the universal wheels are connected to the support through a screw rod, and a brake device is provided on the universal wheels; the support structure includes a plurality of handrails, the height of the handrails is adjustable, and the horizontal distance between each handrail is adjustable; The bottom of the driven seat is provided with a universal wheel, and the structure of the universal wheel provided on the driven seat is the same as that of the universal wheel provided on the support structure; The training device supports multiple training modes simultaneously, including: a first training mode, locking the universal wheel at the bottom of the support structure to fix the position of the handrail, loosening the universal wheel at the bottom of the driven seat, simulating the multi-channel perception of vision, force touch and vestibular sense during the task; a second training mode, locking the universal wheel at the bottom of the driven seat to fix the position of the seat to lock the position of the trainee, loosening the universal wheel at the bottom of the support structure, simulating the visual and force touch perception during the task; The third training mode does not use the support structure and simulates visual perception during the task.
2. The multi-sensory spacewalk training device for simulating weightlessness according to claim 1, characterized in that: The virtual reality helmet is integrated with a head position sensor, and the head position sensor is used to collect head movement information.
3. The multi-sensory spacewalk training device for simulating weightlessness according to claim 1, characterized in that: The data glove is provided with a hand position sensor, and the hand position sensor is used to collect hand movement information.
4. The multi-sensory spacewalk training device for simulating weightlessness according to claim 1, characterized in that: The handrail position sensor is fixed to the bracket by a fixing device, and the fixing device includes a crab claw clamp and a magic arm bracket. The position sensor is connected to the magic arm bracket by bolts, and the magic arm bracket is connected to the crab claw clamp by screw holes, and the crab claw clamp is fixed to the bracket.
5. The multi-sensory spacewalk training device for simulating weightlessness according to claim 1, characterized in that: The driven seat is made of aluminum profile.
