Liquid conduction glove mixed reality feedback system for space station maintenance and execution method thereof

Abstract

The invention provides a liquid conduction glove mixed reality feedback system for space station maintenance and an execution method of the liquid conduction glove mixed reality feedback system. A liquid conduction feedback glove is adopted to provide necessary tactile feedback. A plurality of micro liquid chambers arranged at different parts of the astronaut glove can adjust the gripping force and the counter-acting force in real time through the pressure change generated by liquid flowing. And meanwhile, visual guidance is performed on the astronaut in combination with a virtual graphic identifier in a mixed reality system, so that the astronaut is helped to operate a tool more accurately in a microgravity environment. According to the mixed reality system, the virtual image of the tool and the operation state of the astronaut are presented in real time by using the virtual reality technology, the accuracy of the operation is enhanced through intuitive visual guidance, and the stability of the tool in the operation process is ensured. The invention provides a novel interaction mode which adapts to a low-gravity environment and improves the maintenance performance and experience of the astronaut, so that the astronaut can realize stable tool control in a microgravity environment, and the task success rate is remarkably improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of space exploration and human-computer interaction, and specifically relates to a liquid conduction glove mixed reality feedback system for space station maintenance and an execution method thereof. Background Art

[0002] As humans continue to advance in space exploration, routine maintenance of space stations, lunar exploration missions, and repairs of other space facilities are becoming increasingly complex and frequent. When performing these tasks in microgravity or low gravity environments, astronauts face many operational challenges, especially in the use of tools. Due to the lack of gravity support, the stability of tools and the accuracy of operations are greatly reduced, which not only reduces mission efficiency, but also increases the risk of operational errors, threatening the success of the mission.

[0003] Existing solutions mainly rely on mechanical devices, such as robotic arms or fixed clamps, to assist in stabilizing tools. However, these devices are often bulky, inconvenient to operate, and cannot provide real tactile feedback. Therefore, astronauts usually rely on visual feedback to complete operations. Although it can provide operational accuracy to a certain extent, due to the lack of real-time tactile feedback, operational deviations may still occur in complex maintenance tasks, affecting the smooth completion of the mission. Summary of the invention

[0004] In view of the deficiencies in the prior art, the present invention provides a liquid conduction glove mixed reality feedback system for space station maintenance and an execution method thereof.

[0005] To achieve the above object, the present invention adopts the following technical solutions:

[0006] In a first aspect, the present invention provides a liquid conduction glove mixed reality feedback system for space station maintenance, comprising: a liquid conduction feedback glove, a mixed reality system, and an environment perception and fault diagnosis module;

[0007] The mixed reality system includes mixed reality glasses and a visual display module; the mixed reality glasses provide real-time visual display guidance for astronauts and display through the visual display module;

[0008] The liquid conduction feedback glove comprises a glove body and a tactile feedback system; the tactile feedback system is arranged in the glove body to provide perceptible tactile feedback to the astronaut;

[0009] The environmental perception and fault diagnosis module includes a fault detection and diagnosis module and a tool component database; the fault detection and diagnosis module and the tactile feedback system identify faults through real-time data interaction and display them through the visual display module; the tool component database is used to store the task models, operating tools, target parts and operating steps required for the maintenance tasks, so that the mixed reality glasses can load the relevant task models, operating tools, target parts and operating steps from the tool component database, and transmit the information of the operating tools and target parts to the tactile feedback system to generate tactile feedback perceptible to astronauts.

[0010] Optionally, the mixed reality glasses are used to superimpose the virtual identification of the operating tool, the three-dimensional model of the target component and the operating steps on the astronaut's real field of view; the mixed reality glasses have built-in sensors for capturing the astronaut's head and eye movements to ensure real-time synchronization of the displayed content and the viewing angle.

[0011] Optionally, both the inner and outer sides of the glove body are made of elastic composite material.

[0012] Optionally, the tactile feedback system includes an embedded local magnetic field source, a magnetorheological fluid chamber module and a sensor array module; the magnetorheological fluid chamber module is a plurality of chambers containing magnetorheological fluid distributed on the fingers and palm of the glove body; the sensor array module is used to detect the astronaut's hand movements and positions in real time, and the detected data is transmitted to the mixed reality glasses, and the mixed reality glasses synchronously integrate the detected data with the images of the contacted operating tools and target components scanned by the mixed reality glasses, so that the embedded local magnetic field source produces corresponding magnetic field changes, and controls the magnetorheological fluid in the magnetorheological fluid chamber module to perform tactile feedback, so as to achieve consistency in time and space between tactile feedback and visual feedback.

[0013] Optionally, the tactile feedback system includes a temperature control module, which adjusts the temperature of the surface of the glove body according to the material properties of the operating tool.

[0014] Optionally, the fault detection and diagnosis module works in conjunction with the sensor array module to identify faults through real-time data interaction; when a fault is detected, the fault location is displayed on the visual display module, and a fault description and repair suggestions are provided.

[0015] In a second aspect, the present invention provides a task execution method based on the liquid conduction glove mixed reality feedback system according to the first aspect, comprising the following steps:

[0016] Wear liquid conduction feedback gloves and mixed reality glasses, and connect the sensor array module to the mixed reality glasses through a wireless connection;

[0017] The mixed reality glasses start scanning the real scene and load the preset virtual interface, forming an operating environment that combines the real scene and the virtual interface;

[0018] The mixed reality glasses load relevant mission models, operating tools, target parts and operating steps from the tool component database, automatically scan and identify the operating tools and target parts touched by the astronauts, and display the identification results on the visual display module;

[0019] The mixed reality glasses transmit information about operating tools and target parts to the tactile feedback system. Based on the received information, the tactile feedback system adjusts the pressure and flow of the magnetorheological fluid chamber module through the embedded local magnetic field source to simulate the real touch of the operating tools and target parts.

[0020] Optionally, during the mission execution, the fault detection and diagnosis module interacts with the mixed reality glasses through real-time data transmission to monitor the operation status in real time; once an operation deviation is detected, the visual display module issues a warning sign to remind the astronauts to make operational adjustments; at the same time, the embedded local magnetic field source adjusts the magnetorheological liquid chamber module to produce solid-state feedback.

[0021] Optionally, for the detected operation deviation, the fault detection and diagnosis module also generates a fault report, the report content including the fault location, type, possible cause and repair plan.

[0022] Optionally, after the task is completed, all operation data are automatically saved and a task report is generated. The report content includes the execution status of each operation step, the use of operation tools, operation time, fault handling records and operation quality evaluation.

[0023] The beneficial effects of the present invention are as follows: the present invention uses the principle of pressure tactile feedback generated by liquid flow to provide tactile feedback to astronauts, achieves the effect of simulating ground gravity in a microgravity environment, and enhances their stability and accuracy in tool operation. At the same time, combined with mixed reality (MR) technology, especially using virtual graphic logos in mixed reality glasses, astronauts are given precise visual guidance. This visual guidance not only helps astronauts understand the spatial structure of the mission and the correct operation of the tools, but also improves the accuracy of the operation through real-time feedback.

[0024] The liquid conduction feedback technology proposed in this invention is different from the traditional tactile feedback method. It uses liquid flow to generate pressure changes to simulate the gravity effect, thus providing a new tactile feedback method. The tactile feedback system seamlessly integrated with the mixed reality system enables astronauts to perceive the operating experience similar to the earth's gravity environment in a microgravity environment by adjusting the characteristics of liquid flow. This dual feedback system not only enhances the astronauts' operational perception, but also significantly improves the stability of tool operation and the safety of the mission.

[0025] In summary, the present invention proposes a new space operation solution by innovatively combining liquid conduction feedback technology with mixed reality technology. Through the visual guidance of mixed reality glasses and the tactile experience of liquid conduction feedback, the astronauts' ability to operate tools in a microgravity environment is effectively improved, providing more efficient and safe support for future space maintenance missions. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 This is a schematic diagram of the use principle of a liquid conduction glove mixed reality feedback system for space station maintenance according to the present invention.

[0027] Figure 2 It is a system block diagram of a liquid conduction glove mixed reality feedback system for space station maintenance according to the present invention.

[0028] Figure 3 It is a task execution flow chart of a liquid conduction glove mixed reality feedback system for space station maintenance according to the present invention. DETAILED DESCRIPTION

[0029] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the accompanying drawings.

[0030] Embodiment 1

[0031] This embodiment proposes a liquid conduction glove mixed reality feedback system for space station maintenance. Figure 1 and Figure 2 As shown, the system includes the following main parts: a liquid conduction feedback glove 100, a mixed reality system 200, and an environmental perception and fault diagnosis module 300. The mixed reality system 200 includes mixed reality glasses 210 and a visual display module 220; the liquid conduction feedback glove 100 includes a glove body 110 and a tactile feedback system 120; the environmental perception and fault diagnosis module 300 includes an embedded local magnetic field source 121, a magnetorheological liquid chamber module 122, a sensor array module 123, and a temperature control module 124.

[0032] The mixed reality system 200 provides astronauts with real-time visual display guidance through the mixed reality glasses 210, including virtual identification of operating tools, three-dimensional display of targets to be repaired, and dynamic instructions for operating steps. The mixed reality glasses 210 are equipped with a transparent display screen that can accurately superimpose virtual identification, three-dimensional models of targets to be repaired, and operating information on the astronauts' real field of view. The glasses also have built-in sensors to capture the astronauts' head and eye movements to ensure real-time synchronization of virtual content and perspective. At the same time, the glasses have a lightweight design to ensure comfort and ease of operation when worn for a long time in complex environments such as space stations.

[0033] The visual display module 220 refers to the part in the system that is responsible for displaying the combination of virtual information and the real environment. The virtual identification of the operating tool can provide a virtual identification for each operating tool in the field of view, so that the astronauts can quickly identify and accurately use the tools. The three-dimensional display of the target to be repaired can display the three-dimensional model of the object to be repaired, helping astronauts to view and understand the structure of the object from multiple angles. The dynamic indication of the operating steps can provide astronauts with real-time instructions for the operating steps, including action prompts, path guidance and action details for each step, to ensure the efficiency and accuracy of the maintenance task.

[0034] The inner and outer sides of the glove body 110 are both made of a highly elastic composite material, which is flexible and can come into direct contact with the human body.

[0035] The tactile feedback system 120 enhances the interactive experience by providing the user with perceptible tactile feedback.

[0036] The glove body 110 is built with an embedded local magnetic field source 121, which can generate local magnetic fields in key areas of the glove (such as fingertips and palms) for precise control and adjustment of local tactile feedback. These magnetic field sources are controlled by the electromagnetic system inside the glove to provide high-precision magnetic field changes and quickly respond to operational requirements.

[0037] The magnetorheological fluid chamber module 122 is a plurality of chambers containing magnetorheological fluid distributed on the fingers and palm. These chambers are made of flexible materials and can contain and transmit liquid. The viscosity of the magnetorheological fluid can be adjusted by the magnetic field strength of the embedded local magnetic field source 121, thereby realizing dynamic control of pressure and tactile feedback.

[0038] The glove body 110 is equipped with a sensor array module 123 for real-time detection of the astronaut's hand movements and positions, including the bending degree of the fingers, the pressure distribution of the palm, etc. The detected data will be transmitted to the mixed reality system 200, and the mixed reality glasses 210 will synchronize and integrate the data and the images captured by the mixed reality glasses 210, and the embedded local magnetic field source 121 will generate corresponding magnetic field changes, thereby controlling the magnetorheological fluid to provide tactile feedback, and the visual display module 220 will display the virtual information of the corresponding maintenance action, ensuring the consistency of tactile and visual feedback in time and space.

[0039] Optionally, the liquid conduction feedback glove 100 is also equipped with a temperature control module 124. The module can adjust the temperature of the glove surface according to the characteristics of different materials, such as simulating the cool touch of metal tools or simulating the warm touch of wooden parts. The temperature control module 124 provides a richer tactile experience by changing the temperature of the liquid or directly heating / cooling the glove surface.

[0040] The mixed reality system 200 works closely with the liquid conduction feedback glove 100 to synchronously adjust the visual focus, dynamically adjust the position and shape of the tactile feedback and virtual graphic logos according to the astronaut's operating actions and object characteristics, and improve the intuitiveness and accuracy of the operation.

[0041] The fault detection and diagnosis module 310 works in conjunction with the sensor array module 123 of the liquid conductive feedback glove 100 to quickly identify the fault status of the device through real-time data interaction. When a fault is detected, the visual display module 220 of the mixed reality system 200 will highlight the fault location on the virtual interface and provide a detailed fault description and corresponding repair suggestions.

[0042] The tool component database 320 is used to store information about all tools and components used in maintenance tasks. After scanning the status of the components to be repaired, the mixed reality glasses 210 can automatically retrieve relevant data from the database and then select the tools, and synchronously transmit the detailed information of the tools to the liquid conductive feedback gloves 100. The tactile feedback system 120 in the gloves generates corresponding tactile feedback based on these data, so that astronauts can perceive the actual operation mode and feel of the tools in the virtual interface in advance. Ensure that astronauts can more accurately control the tools through tactile feedback, and improve the sensitivity and accuracy of the operation.

[0043] Embodiment 2

[0044] This embodiment proposes a task execution method based on the liquid conduction glove mixed reality feedback system of embodiment 1, such as Figure 3 As shown, the following steps are specifically included to ensure that astronauts can complete maintenance tasks or training operations efficiently and accurately.

[0045] First, the astronaut wears the liquid conduction feedback glove 100 and connects the sensor array module 123 of the glove to the mixed reality glasses 210 through a wireless connection. Then, the astronaut wears the mixed reality glasses 210 and starts the system. After starting, the mixed reality glasses 210 begin to scan the current environment, identify and load the preset virtual operation interface. Through the mixed reality glasses 210, the astronaut can see the combination of real scenes and virtual information to form an enhanced operating environment. The mixed reality system 200 automatically detects the connection status of the gloves and glasses to ensure that all devices are working properly.

[0046] Astronauts load relevant mission models, operating tools, target components and operating steps from the tool component database 320 through the mixed reality glasses 210. The tool component database 320 is used to store and identify various maintenance operating tools and related components used for maintenance, and contains detailed three-dimensional models and operating information of maintenance tools and related components used for maintenance. The mixed reality glasses 210 will automatically scan and identify the tools or components they touch, and display the recognition results on the virtual interface of the visual display module 220, including the name, function and operating steps of the tool / component. The operating guide helps astronauts familiarize themselves with the requirements of the current mission, and includes tool / component selection, operating steps and safety precautions.

[0047] During the mission, the mixed reality system 200 provides real-time visual guidance through the visual display module 220, displaying the virtual identification of the operating tool and the three-dimensional model of the target component. Each tool and component is color-coded and labeled for easy identification. The system dynamically adjusts the display content according to the progress of the mission to ensure that astronauts always have access to the latest operation information. The mixed reality system 200 identifies the tool through the mixed reality glasses 210. Once the tool or component is identified, the mixed reality glasses 210 will retrieve the information in the tool component database 320 and transmit the information to the liquid conductive feedback glove 100. Based on the received instructions, the glove adjusts the pressure and flow of its internal magnetorheological liquid chamber module 122 through the embedded local magnetic field source 121 to simulate the real touch of the tool or component. This feedback mechanism enhances the realism of the operation, allowing astronauts to more accurately perceive and operate different tools and components.

[0048] Throughout the mission, the visual display module 220 of the mixed reality system 200 continuously provides operational guidance and real-time feedback. The visual display module 220 guides the astronauts to complete the mission step by step based on the mission model and standard operating procedures. Each step of the operation is displayed on the virtual interface, with precautions and operating points attached. When the operation is correct, the system issues positive feedback, such as a green light display or a prompt sound, to confirm that the operation is successful. If the operation does not meet the standards, the system will give corrective suggestions through the virtual interface, prompting how to adjust the posture or tool use and give tactile feedback prompts with significantly increased tactile feedback through the liquid conduction feedback glove 100. This timely feedback mechanism improves the accuracy of the operation and reduces the occurrence of errors in the mission.

[0049] The fault detection and diagnosis module 310 realizes real-time interaction with the mixed reality glasses 210 through real-time data transmission, and monitors the status of the operating object. Once an operation deviation is detected, such as improper use of tools or incorrect operation angles, the system will immediately issue a warning mark on the virtual interface, including visual highlights, color changes, and sound alarms, to remind astronauts to make operational adjustments. At the same time, the magnetorheological liquid chamber module 122 is controlled by the embedded local magnetic field source 121 in the glove to generate corresponding solid-state feedback. For serious faults or equipment abnormalities, the module generates a fault report, which covers the fault location, type, possible causes and repair solutions. Astronauts can view these reports through the mixed reality glasses 210, understand the fault situation, and follow the repair steps provided by the system.

[0050] After the mission is completed, the system automatically saves all operation data and generates a detailed mission report. The report includes the execution of each operation step, tool usage, operation time, fault handling records and operation quality evaluation. Astronauts can review this data for self-evaluation through the review function. The system supports the review and learning function of operation history, identifies common operation errors and efficiency bottlenecks, and provides improvement suggestions. Through continuous learning and optimization, the system can continuously improve the efficiency and accuracy of future mission execution.

[0051] The above are only preferred embodiments of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should be regarded as the protection scope of the present invention.

Claims

1. A liquid conduction glove mixed reality feedback system for space station maintenance, characterized in that: include: Liquid conduction feedback gloves (100), mixed reality system (200) and environment perception and fault diagnosis module (300); The mixed reality system (200) comprises mixed reality glasses (210) and a visual display module (220); the mixed reality glasses (210) provide real-time visual display guidance for astronauts and display it through the visual display module (220); The liquid conduction feedback glove (100) comprises a glove body (110) and a tactile feedback system (120); the tactile feedback system (120) is arranged in the glove body (110) to provide perceptible tactile feedback for the astronaut; The environmental perception and fault diagnosis module (300) includes a fault detection and diagnosis module (310) and a tool component database (32); the fault detection and diagnosis module (310) and the tactile feedback system (120) identify faults through real-time data interaction and display them through a visual display module (220); the tool component database (32) is used to store task models, operating tools, target components and operating steps required for maintenance tasks, so that the mixed reality glasses (210) can load relevant task models, operating tools, target components and operating steps from the tool component database (32), and transmit information about the operating tools and target components to the tactile feedback system (120) to generate tactile feedback that can be perceived by astronauts.

2. The liquid conductive glove mixed reality feedback system for space station maintenance according to claim 1, characterized in that: The mixed reality glasses (210) are used to superimpose a virtual identifier of an operating tool, a three-dimensional model of a target component, and operating steps on an astronaut's real field of view; the mixed reality glasses (210) are equipped with built-in sensors for capturing the astronaut's head and eye movements to ensure real-time synchronization of display content and viewing angle.

3. The liquid conductive glove mixed reality feedback system for space station maintenance according to claim 1, characterized in that: The inner and outer sides of the glove body (110) are both made of elastic composite material.

4. The liquid conductive glove mixed reality feedback system for space station maintenance according to claim 1, characterized in that: The tactile feedback system (120) comprises an embedded local magnetic field source (121), a magnetorheological fluid chamber module (122) and a sensor array module (123); the magnetorheological fluid chamber module (122) is a plurality of chambers containing magnetorheological fluid distributed on the fingers and palm of the glove body (110); the sensor array module (123) is used to detect the hand movements and positions of the astronaut in real time, and the detected data is transmitted to the mixed reality glasses (210), and the mixed reality glasses (210) synchronously integrate the detected data with the images of the contacted operating tools and target components scanned by the mixed reality glasses (210), so that the embedded local magnetic field source (121) generates corresponding magnetic field changes, and controls the magnetorheological fluid in the magnetorheological fluid chamber module (122) to perform tactile feedback, so as to achieve the consistency of tactile feedback and visual feedback in time and space.

5. The liquid conductive glove mixed reality feedback system for space station maintenance according to claim 1, characterized in that: The tactile feedback system (120) comprises a temperature control module (124), and the temperature control module (124) adjusts the temperature of the surface of the glove body (110) according to the material properties of the operating tool.

6. The liquid conductive glove mixed reality feedback system for space station maintenance according to claim 4, characterized in that: The fault detection and diagnosis module (310) works in conjunction with the sensor array module (123) to identify faults through real-time data interaction; when a fault is detected, the fault location is displayed on the visual display module (220), and a fault description and repair suggestions are provided.

7. A task execution method based on the liquid conduction glove mixed reality feedback system according to any one of claims 4, characterized in that: The steps include: Wearing the liquid conduction feedback gloves (100) and the mixed reality glasses (21), and connecting the sensor array module (123) to the mixed reality glasses (210) via a wireless connection; The mixed reality glasses (21) start scanning the real scene and load the preset virtual interface to form an operating environment that combines the real scene and the virtual interface; The mixed reality glasses (21) load relevant task models, operating tools, target components and operating steps from the tool component database (32), and automatically scan and identify the operating tools and target components touched by the astronauts, and display the identification results on the visual display module (220); The mixed reality glasses (21) transmit information of the operating tool and the target component to the tactile feedback system (120). The tactile feedback system (120) adjusts the pressure and flow of the magnetorheological fluid chamber module (122) through the embedded local magnetic field source (121) according to the received information, so as to simulate the real touch of the operating tool and the target component.

8. The task execution method according to claim 7, characterized in that: During the mission execution, the fault detection and diagnosis module (310) interacts with the mixed reality glasses (210) through real-time data transmission to monitor the operation status in real time; once an operation deviation is detected, the visual display module (220) issues a warning mark to remind the astronaut to make operation adjustments; at the same time, the embedded local magnetic field source (121) adjusts the magnetorheological liquid chamber module (122) to generate solid feedback.

9. The task execution method according to claim 8, characterized in that: For the detected operation deviation, the fault detection and diagnosis module (310) also generates a fault report, the report content including the fault location, type, possible cause and repair plan.

10. The task execution method according to claim 7, characterized in that: After the task is completed, all operation data is automatically saved and a task report is generated. The report includes the execution status of each operation step, the use of operation tools, operation time, fault handling records and operation quality evaluation.

Images