Space station maintenance simulation system and method

Abstract

The invention provides a space station maintenance simulation system and method, and relates to the technical field of digital twinning, and the system comprises a space station environment simulation construction module which is used for constructing a simulation environment of a space station through a mixed reality technology according to the sun illumination, the atmospheric radiation in the morning and evening period and space debris orbit parameters; the model adaptability reconstruction module is used for performing three-dimensional model rendering on the white mold basic structure to obtain a space station model; the space station damage condition simulation module is used for constructing an impact damage three-dimensional image through the collected impact historical data between the space debris and the space station, and superposing the impact damage three-dimensional image to the space station model; the space station maintenance scheme selection module is used for recommending a mechanical arm maintenance scheme or an astronaut out-of-cabin maintenance scheme according to the impact damage three-dimensional image, the fault report condition and a real pre-judgment analysis strategy input by a user; simulation construction of a space station environment is realized on the basis of a virtual mixed reality technology, and the cost of extravehicular maintenance training of the space station is saved.

Description

Technical Field

[0001] The present invention relates to the fields of simulation training and digital twin technology, and in particular to a space station maintenance simulation system and method. Background Art

[0002] With the continuous development of the space industry, the full completion of the space station is undoubtedly a milestone achievement. It not only marks a solid step forward in humanity's journey to explore the universe, but also brings unprecedented historical opportunities for large-scale space science, application, and technology research.

[0003] Space science, with aerospace technology as its cornerstone, encompasses multiple key areas, including space flight, space exploration, and space development. Its research and exploration are not only brimming with opportunities for new discoveries, but also hold enormous potential for application. The space station offers the unique advantages of long-term microgravity, cosmic radiation, and the ability to accommodate astronauts and provide round-trip transportation between Earth and Earth. This opens up effective avenues for addressing important scientific and applied problems across numerous disciplines, and serves as a key platform for testing groundbreaking new space technologies.

[0004] Extravehicular maintenance (EVM) is crucial to the daily operation and maintenance of the space station. It refers to the series of measures and actions taken outside the space station during both routine and emergency situations to prevent, limit, and eliminate disasters, ensuring the timely and effective inspection and maintenance of the space station's cabin and the proper functioning of its systems. The quality and efficiency of EVM directly impacts the successful completion of EVM missions. However, current training for EVM relies primarily on equivalent models and equipment in a microgravity environment. This process requires significant human and material resources, is complex to organize, and is relatively costly.

[0005] At the same time, mixed reality technology, as an emerging technology that integrates the real world and virtual information, can create an environment that combines the real and the virtual, allowing users to interact with virtual objects.

[0006] Based on the above background, the present invention aims to provide a space station maintenance simulation system and method based on mixed reality for the space station extravehicular maintenance simulation training process, so as to improve the astronauts' maintenance skills and operational proficiency. Summary of the Invention

[0007] The present invention provides a space station maintenance simulation system and method to solve the problem of high cost caused by the existing space station extravehicular maintenance training mainly relying on equivalent models and equipment in a microgravity environment, and to realize the simulation construction of the space station environment based on virtual mixed reality technology.

[0008] The present invention provides a space station maintenance simulation system, comprising: The space station environment simulation construction module is used to build a simulated environment of the space station using mixed reality technology based on sunlight, atmospheric radiation during the dawn and dusk periods, and orbital parameters of space debris; A model adaptive reconstruction module is used to construct a white model infrastructure required for the space station environment operation scene based on the original model data of each environmental subject in the space station, and perform three-dimensional model rendering on the white model infrastructure to obtain a space station model; a space station damage simulation module, configured to construct a three-dimensional image of the impact damage using the collected historical data of collisions between space debris and the space station, and to superimpose the three-dimensional image of the impact damage onto the space station model; The space station maintenance plan selection module is used to recommend a robotic arm maintenance plan or an astronaut extravehicular maintenance plan based on the three-dimensional image of the impact damage, the fault report and the real prediction analysis strategy input by the user.

[0009] Optionally, the space station environment simulation building module is also used to Calculate the time when the space station enters and exits the Earth's shadow, the solar illumination angle, and the atmospheric radiation space environment during the twilight period based on the sunlight and the atmospheric radiation during the twilight period; Constructing the orbital parameters of the space debris; the orbital parameters of the space debris include the basic orbit, type, nationality, launch number and size of the space debris; A simulation environment of the space station is constructed according to the time when the space station enters and exits the earth's shadow, the solar illumination angle, the atmospheric radiation space environment during the dawn and dusk periods, and the orbital parameters of the space debris.

[0010] Optionally, the environmental entities in the space station include the space station, the robotic arm, the operating table, the astronauts and the maintenance tools; the model adaptive reconstruction module is also used to Using high-definition pipeline technology to construct original model data of the space station, robotic arm, operating console, astronauts, and maintenance tools; Based on the original model data of the space station, robotic arm, operating console, astronauts and maintenance tools, a white model infrastructure required for the space station extravehicular environment operation scene is constructed; The material, illumination angle, texture and color of the white model base structure are rendered into a three-dimensional model to complete the adaptive reconstruction of the three-dimensional model, and the size, proportion and details of the white model base structure are adjusted to obtain a space station model.

[0011] Optionally, the space station damage simulation module is also used to calculating collision parameters using the collected historical collision data between the space debris and the space station; Based on the collision parameters, use mixed reality technology to restore the space station collision situation and collision damage; A three-dimensional image of impact damage is constructed based on the collision condition and the collision damage condition of the space station, and the three-dimensional image of impact damage is superimposed on the space station model and highlighted.

[0012] Optionally, the space station maintenance plan selection module is also used to Based on the space station collision situation, collision damage, the fault report, and the user-entered real-world prediction and analysis strategy, the fault report results and cabin damage assessment results are determined, and the entire repair operation process is simulated; the entire repair operation process includes at least one of replacing a specified damaged component, repairing a solar array, or adjusting specified operating parameters; The robotic arm maintenance plan or the astronaut extravehicular maintenance plan is recommended based on the cabin damage assessment results.

[0013] Optionally, the space station maintenance plan selection module is also used to Recommending a repair plan for the robotic arm based on the cabin damage assessment results, simulating the actual repair process through mixed reality gesture interaction; the robotic arm repair plan includes any one of the following operations: controlling the robotic arm to move to a specified position, controlling the robotic arm to grasp a tool, or controlling the robotic arm to replace a damaged part; Or, based on the results of the cabin damage assessment, the astronaut extravehicular maintenance plan is recommended, which includes: issuing a prompt to recommend astronauts to perform extravehicular maintenance, restoring the three-dimensional panoramic scene and special effects animation of the robotic arm taking the astronauts out of the cabin and sending them to the space station for maintenance, and restoring the astronauts' movement path scene and the fixing scene of the safety rope.

[0014] Optionally, the space station maintenance simulation system also includes a space station maintenance simulation training module for Locating a fault on the device in a simulated environment of the space station to determine the fault location; Determine the cause of the fault based on the description of the fault phenomenon and the troubleshooting solution provided by the 3D holographic image maintenance manual; Based on the fault location and the fault cause, simulated operation exercises of various maintenance tools are provided, and the simulated operation exercises include simulation of disassembly, repair and welding maintenance processes.

[0015] Optionally, the space station maintenance simulation system also includes a space station maintenance simulation training integrated display module, which is used to display the space station extravehicular maintenance scene in a virtual mixed reality environment, and adjust maintenance operations and maintenance methods based on public discussions among multiple commanders.

[0016] Optionally, the space station maintenance simulation system further includes a space station maintenance result storage module for recording key data, operation steps and maintenance results during the maintenance process in a background database; The space station maintenance result evaluation module is used to visualize the result evaluation and analysis strategy and required data indicators of the training task after the training task is completed, and submit the generated maintenance report to the space station maintenance system or platform for evaluation and archiving.

[0017] The present invention also provides a space station maintenance simulation method, comprising: Using mixed reality technology to build a simulated space station environment based on sunlight, atmospheric radiation during dawn and dusk, and orbital parameters of space debris; Based on the original model data of each environmental subject in the space station, a white model infrastructure required for the space station environment operation scene is constructed, and a three-dimensional model rendering is performed on the white model infrastructure to obtain a space station model; constructing a three-dimensional image of impact damage using the collected historical data of impacts between the space debris and the space station, and superimposing the three-dimensional image of impact damage on the space station model; Based on the three-dimensional image of the impact damage, the fault report and the real prediction analysis strategy input by the user, a robotic arm maintenance plan or an astronaut extravehicular maintenance plan is recommended.

[0018] The space station maintenance simulation system and method provided by the present invention, the space station environment simulation construction module uses mixed reality technology to construct a space station simulation environment based on sunlight, atmospheric radiation during the dawn and dusk periods, and orbital parameters of space debris, so that astronauts can feel as if they are personally on the scene and can more realistically experience the space environment in which the space station is located. In the immersive training experience, the ability to cope with various situations is enhanced, the training effect is significantly improved, and more abundant experience is accumulated for the actual execution of tasks; the model adaptive reconstruction module constructs a white model basic structure based on the original model data, and performs three-dimensional model rendering to obtain a space station model. The entire process is efficient and accurate, which not only shortens the time for model construction, but also ensures the accuracy of the model, providing a reliable foundation for subsequent damage simulation and maintenance plan formulation, saving a lot of time and cost, and improving the simulation training system. The overall operation efficiency of the space station is improved; the space station damage simulation module constructs a three-dimensional image of impact damage through historical impact data and superimposes it on the space station model, showing the damage of the space station in an intuitive and visual form. Maintenance personnel and decision makers can quickly and accurately understand the specific location and extent of the damage, provide an intuitive basis for making scientific and reasonable maintenance decisions, and avoid decision-making errors caused by unclear information; the space station maintenance plan selection module recommends a robotic arm maintenance plan or an astronaut extravehicular maintenance plan based on the real prediction analysis strategy of the three-dimensional image of impact damage, fault report status and user input. By integrating multi-dimensional information, it can provide customized maintenance plans according to different damage scenarios and actual conditions, ensure the pertinence and effectiveness of maintenance work, and effectively guarantee the maintenance quality and normal operation of the space station. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 This is a block diagram of a space station maintenance simulation system provided by the present invention.

[0021] Figure 2 This is a flow chart of a space station maintenance simulation method provided by the present invention.

[0022] Figure 3 An example of a physical structure diagram of a space station maintenance simulation system is shown.

[0023] Reference numerals: Processor 310 ; communication interface 320 ; memory 330 ; communication bus 340 . DETAILED DESCRIPTION

[0024] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0025] Mixed reality technology combines the real world and virtual information to create a realistic yet virtual environment, allowing users to interact with virtual objects. In the aerospace field, this technology is used to create simulated environments that closely resemble the space station's extravehicular environment, which is of great significance for astronaut training, equipment testing, and scientific research.

[0026] At present, the training for extravehicular maintenance of the space station is mainly based on equivalent models and equipment in a microgravity environment. It requires a lot of manpower and material resources to cooperate, is relatively complex to organize, and has high investment costs.

[0027] Based on the above reasons, the present invention proposes a space station maintenance simulation system, which uses mixed reality technology to achieve three-dimensional visualization, real-time interaction and simulation of the space station's space environment and the entire process of extravehicular maintenance of the space station. It uses high-definition pipeline technology to construct original model data of the space station, astronauts and extravehicular maintenance tools, set cabin maintenance tasks and maintenance plans, clarify extravehicular maintenance goals, simulate maintenance operation processes according to the degree of extravehicular damage, and realize the operation of the robotic arm according to control instructions to perform minor extravehicular maintenance or simulate the astronaut's perspective to guide astronauts to perform maintenance simulation training on parts of the cabin with more serious damage.

[0028] The space station extravehicular maintenance simulation training is mainly based on existing models and space environment data to build a specific simulated space environment and space station extravehicular damage scenario. Under the constructed scenario and given conditions, the mixed reality technology is used to realize the tasks of cabin maintenance task determination, maintenance plan selection, extravehicular maintenance goal clarification, maintenance operation process simulation, space station extravehicular maintenance, and maintenance result evaluation.

[0029] In order to more clearly illustrate the technical solution of the present invention and its specific implementation details, this article will provide a comprehensive and in-depth description of the technical solution of the present invention in conjunction with the accompanying drawings in the embodiments. In this process, each key feature of the technical solution and its role will be described in detail to ensure that the core ideas and innovations of the present invention can be accurately explained, so as to fully grasp its design principles and application value. The functional composition of the space station maintenance simulation system based on mixed reality is as follows: Figure 1 As shown, Figure 1This is a block diagram of a space station maintenance simulation system provided by the present invention. The space station maintenance simulation system includes a space station environment simulation construction module, a model adaptive reconstruction module, a space station damage simulation module, a space station maintenance plan selection module, a space station maintenance simulation training module, a space station maintenance simulation training comprehensive display module, a space station maintenance result storage module and a space station maintenance result evaluation module.

[0030] The following explains the functions and designs of the space station maintenance simulation system, including the space station environment simulation construction module, model adaptive reconstruction module, space station damage simulation module, space station maintenance plan selection module, space station maintenance simulation training module, space station maintenance simulation training comprehensive display module, space station maintenance result storage module, and space station maintenance result evaluation module.

[0031] The space station environment simulation construction module is used to build a simulated environment of the space station using mixed reality technology based on sunlight, atmospheric radiation during dawn and dusk, and orbital parameters of space debris.

[0032] In one embodiment, a space station environment simulation construction module calculates the time when the space station enters and exits the Earth's shadow, the angle of sunlight, and the atmospheric radiation space environment during the twilight period based on sunlight and atmospheric radiation during the twilight period; constructs the orbital parameters of space debris; wherein the orbital parameters of space debris include the basic orbit, type, nationality, launch number, and size of the space debris; and constructs a simulation environment of the space station based on the time when the space station enters and exits the Earth's shadow, the angle of sunlight, the atmospheric radiation space environment during the twilight period, and the orbital parameters of space debris.

[0033] Exemplarily, the space station environment simulation construction module is based on solar illumination simulation and atmospheric radiation during the dawn and dusk periods, taking into account the actual impact of the satellite solar illumination angle space environment and the atmospheric radiation space during the dawn and dusk periods on imaging, and calculates the time when the space station enters and exits the earth's shadow, the solar illumination angle and the atmospheric radiation space environment during the dawn and dusk periods. In this process, the basic orbit, type, nationality, launch number, size and other parameters of space debris are constructed to realize the simulation of the space environment of the space station.

[0034] The space station's simulated environment accurately simulates sunlight, including not only the intensity and direction of sunlight but also the variations in atmospheric radiation during the dawn and dusk periods. By precisely calculating the solar angle, the simulation replicates the variations in sunlight and shadows experienced by the space station, which is crucial for astronauts' extravehicular activity training. The simulation also accounts for the effects of the satellite's solar angle on imaging, as well as the effects of atmospheric radiation on the space station during the dawn and dusk periods—factors that have a real impact on the station's observation and communication systems.

[0035] Among them, the earth's shadow refers to the shadow area of ​​the earth, which has a significant impact on the temperature and energy supply of the space station. By simulating the changes in the earth's shadow, we can better predict and prepare the energy needs of the space station and adapt to temperature changes.

[0036] Space debris refers to abandoned satellites, rocket debris and other debris orbiting in Earth's orbit, which pose a potential threat to the space station. By simulating parameters such as the type, nationality, launch number, and size of these debris, we can better assess the risks faced by the space station and formulate corresponding avoidance strategies.

[0037] Through the above-mentioned precise simulation, a highly realistic space station environment can be constructed; this environment can not only be used for astronaut training, but also for testing new equipment and technologies, as well as for scientific research. The use of mixed reality technology greatly improves the safety and efficiency of space station operations, while also providing valuable data and experience for future space exploration.

[0038] The model adaptive reconstruction module is used to construct the white model infrastructure required for the space station environment operation scene based on the original model data of each environmental entity in the space station. The white model infrastructure is then rendered into a 3D model to obtain the space station model. The various environmental entities in the space station include the space station, robotic arm, operating console, astronauts, and maintenance tools.

[0039] In one embodiment, the model adaptive reconstruction module uses high-definition pipeline technology to construct the original model data of the space station, robotic arm, operating console, astronauts and maintenance tools; based on the original model data of the space station, robotic arm, operating console, astronauts and maintenance tools, the white model infrastructure required for the space station extravehicular environment operation scene is constructed; the material, lighting angle, texture, and color of the white model infrastructure are rendered into a three-dimensional model to complete the adaptive reconstruction of the three-dimensional model, and the size, proportion and details of the white model infrastructure are adjusted to obtain the space station model.

[0040] For example, the basic structure of the white model of the model UV mapping (UV Mapping), plane drawing, and wireframe drawing required for the business scenario is constructed from models or model-related materials such as the space station, robotic arm, operating table, astronauts, and maintenance tools, providing a basic geometric reference for model construction, helping designers and engineers understand the structure and shape of the model, and ensuring that the appearance of the material can be realistically reproduced in subsequent rendering. On this basis, three-dimensional model rendering of model materials, lighting angles, textures, colors, etc. is performed, and appropriate materials such as metal, plastic, or special coatings are assigned to the models of each environmental subject to simulate the physical properties of materials in the real world; simulating the lighting effects at different times and conditions can effectively simulate the working conditions of astronauts under different lighting conditions; applying high-resolution texture maps can increase the realism and details of the model; selecting and adjusting colors can ensure that the color of the model matches the actual equipment, while considering the color performance under different lighting conditions.

[0041] Among them, the basic structure of the white model determines the overall shape and structure of the model; the wireframe is a simplified expression of the white model, which is used to check the geometric rationality of the model; the plan view is a two-dimensional projection of the white model and the wireframe, which is used to plan the layout and size of the model; the UV map is a surface unfolding based on the white model, which is used for texture mapping.

[0042] After building the white model infrastructure, the model is processed using mixed reality computing power to complete the adaptive reconstruction of the 3D model, ensuring that the model meets the comprehensive display requirements of the space station's extravehicular maintenance scenario and improving the display smoothness and rendering speed during the scene operation. Using mixed reality technology, the model is processed and adjusted in real time in the virtual environment, allowing the model to seamlessly interact with real-world elements. High-performance computing resources are used to process complex 3D model data in real time to ensure smooth display and interaction in the mixed reality environment. Based on the specific needs of the space station's extravehicular maintenance scenario, the model is adaptively reconstructed to ensure that the model can meet specific operational and display requirements. The size, proportion, and details of the model are adjusted to ensure the best visual effects and operational experience in the simulated environment. By optimizing the model's geometric structure and texture, the computational burden during the rendering process is reduced, thereby improving the smoothness of the scene's operation. Rendering technologies such as real-time ray tracing and global illumination simulation are used to improve rendering speed and image quality.

[0043] Through the model adaptive reconstruction module, a highly realistic and fully functional three-dimensional model environment can be created, which can not only be used for astronaut training and simulation, but also provide important reference and support for the design, construction and maintenance of space stations.

[0044] The space station damage simulation module is used to construct a three-dimensional image of impact damage based on the historical data of collisions between space debris and the space station, and to superimpose the three-dimensional image of impact damage onto the space station model.

[0045] In one embodiment, collision parameters are calculated using historical collision data between space debris and the space station. Based on the collision parameters, mixed reality technology is used to restore the collision situation and collision damage of the space station. Based on the collision situation and collision damage of the space station, a three-dimensional image of the collision damage is constructed, and the three-dimensional image of the collision damage is superimposed on the space station model and highlighted.

[0046] For example, by using historical data on collisions between space debris and the space station, collision parameters that meet pre-defined criteria are calculated based on the speed, size, and shape of the debris and the material properties of the space station's hull. Mixed reality technology is then used to recreate the collision and damage to the space station at the time. This process uses physical properties such as the speed and shape of the debris, combined with the material properties of the space station's hull, to predict the force and energy transfer generated by the collision through physical models and numerical simulation methods. After calculating the collision parameters, a 3D image of the impact damage is constructed and superimposed on the space station model, highlighting it and providing further maintenance prompts.

[0047] Through the space station damage simulation module, astronauts can visually observe the location of the impact point of the space station cabin, the scope and extent of the damage caused by the impact in three-dimensional space; the superposition of three-dimensional images can not only help technicians and astronauts better understand the impact event, but also guide actual maintenance work to ensure the safety and reliability of the space station.

[0048] The space station maintenance plan selection module is used to recommend robotic arm maintenance plans or astronaut extravehicular maintenance plans based on the real-world predictive analysis strategy of impact damage three-dimensional images, fault reports, and user input.

[0049] In one embodiment, the space station maintenance plan selection module determines the fault report results and the cabin damage assessment results based on the space station collision situation, collision damage situation, fault report situation, and the real predictive analysis strategy input by the user, and simulates the entire process of the maintenance operation; the entire process of the maintenance operation includes replacing designated damaged parts, repairing solar panels, or adjusting designated operating parameters; and recommends a robotic arm maintenance plan or an astronaut extravehicular maintenance plan based on the cabin damage assessment results.

[0050] Exemplarily, the space station repair plan selection module determines the degree of collision of the space station cabin with space debris based on the three-dimensional image of impact damage. Based on the collision degree and the fault report, combined with the real predictive analysis strategy input by the user, the holographic three-dimensional model of the space station's extravehicular robotic arm equipment is loaded through mixed reality technology. According to the set fault report results, the robotic arm repair plan or the astronaut extravehicular repair plan is recommended, and then the repair plan is selected from a global perspective or a user perspective to simulate the entire process of the repair operation, including: the possible need to replace a damaged component, repair the solar wing, or adjust a certain operating parameter.

[0051] Recommended repair plans are based on the damage assessment results to match the repair strategy. The following two repair plans are mainly provided: For the robotic arm repair plan, if the cabin damage assessment results suggest robotic arm repair, the user will need to manually select the robotic arm operation path and repair method. The scene will be transformed from the global perspective to the user perspective (robotic arm perspective). At this time, the user can further simulate the repair process through mixed reality gesture interaction and other methods, simulating the actual repair process, including moving the robotic arm to the specified position, grabbing tools, replacing damaged parts, and other operations.

[0052] For the astronaut extravehicular maintenance plan, if the results of the cabin damage assessment suggest that astronauts should go out for maintenance, the scene will be converted from the global perspective to the user perspective (astronaut perspective). Before the simulated maintenance, the data of the robotic arm taking the astronaut out of the cabin and sending him to the space station for maintenance will be realistically restored in a three-dimensional panoramic scene and special effects animation, including details such as the astronaut's movement path and the fixing of the safety rope. At this time, users can further simulate the maintenance process through mixed reality gesture interaction and other methods.

[0053] In the two maintenance solutions mentioned above, mixed reality technology provides an immersive environment, allowing maintenance personnel to simulate the entire maintenance process in a safe and risk-free environment. The full-process simulation not only includes the maintenance operation itself, but also the preparation work before maintenance, emergency response during maintenance, and post-maintenance inspection and testing.

[0054] Through full-process simulation, astronauts can identify potential maintenance risks in advance, optimize maintenance processes, and reduce errors and accidents in actual maintenance; at the same time, this also provides astronauts with a learning and training platform, which helps to improve astronauts' maintenance skills and ability to respond to emergencies.

[0055] The space station maintenance simulation training module is used to locate equipment faults in the simulated environment of the space station and determine the fault location; determine the cause of the fault based on the description of the fault phenomenon and troubleshooting solutions guided by the three-dimensional holographic image maintenance manual; and provide simulated operation exercises of various maintenance tools based on the fault location and cause. The simulated operation exercises include simulation of disassembly, repair and welding maintenance processes.

[0056] In one embodiment, locating equipment faults in a simulated environment of a space station includes: combining sensor data, fault codes and other information in the simulated environment with the description of the fault phenomenon and troubleshooting solutions provided in the three-dimensional holographic image maintenance manual to quickly determine the cause of the fault. Based on simulated operation exercises, users can select maintenance tools in a virtual environment to simulate maintenance processes such as disassembly, repair, and welding. Various working conditions during the operation of the equipment can be simulated to check whether the equipment has resumed normal operation and meets performance index requirements, thereby helping astronauts and technicians to successfully complete maintenance tasks.

[0057] In the simulated environment of the space station, users can access key information such as sensor data and fault codes in the equipment model. This data provides a basis for fault diagnosis and can help users understand the current status of the equipment and possible problems. Through the 3D holographic image maintenance manual, users can view the description of the fault phenomenon and troubleshooting solutions. The 3D holographic image maintenance manual provides intuitive troubleshooting guidance, allowing users to quickly determine the cause of the fault and take appropriate maintenance measures.

[0058] During the simulation training, users use mixed reality technology to recreate holographic 3D images of the robotic arm or astronaut maintenance procedures and required tools from the user's perspective. Users can follow the instructions to perform robotic arm maintenance operations. For example, during extravehicular maintenance, users select the required maintenance tools or parts according to the instructions, then simulate the operation according to the holographic prompts. For example, to replace an old part, users simulate picking up a wrench and placing it where the part needs to be removed. Following the instructions, users perform hand movements, simulating the movement of a real wrench to move the part. Following the prompts, users twist the wrench multiple times to remove the part. Users then use gestures to pick up new parts and place them where they need to move them, or use the wrench to replace and install them. During the operation, the space station maintenance simulation system provides prompts for accuracy and proficiency, and simultaneously manages countdowns based on different levels of difficulty to assess proficiency. The system also evaluates accuracy based on how well the repair operation aligns with the original location or the set repair boundaries, ultimately providing a comprehensive assessment of the simulation training results and providing a conclusion on success or failure.

[0059] The integrated display module for space station maintenance simulation training is used to display space station extravehicular maintenance scenarios in a virtual mixed reality environment, and adjust maintenance operations and methods based on public discussions among multiple commanders.

[0060] For example, in the simulated environment of the space station, in order to make the simulation and training of the space station's extravehicular maintenance mission more efficient and collaborative, multiple commanders can simultaneously view typical scenarios of the space station's extravehicular maintenance, and can adjust maintenance operations or maintenance methods through public discussions to ensure that the final maintenance results meet the mission objectives.

[0061] Regarding the method of simulating the maintenance process, multiple commanders in the team can discuss it together. Team members can view the real superposition of the entire extravehicular maintenance process and the physical space. The operation process such as the parts to be repaired and the required tools will be highlighted for the user to operate. Team members can discuss through the maintenance plan and make changes to the maintenance tools or plans provided in the maintenance operation instructions. After the group discussion, further selection and confirmation will be made, and the maintenance process can be shared within the group.

[0062] In the simulated environment of the space station, multiple commanders can enter the same virtual space station model at the same time to view typical scenarios of extravehicular maintenance, allowing team members to participate in the mission at the same time in different geographical locations, improving the efficiency of communication and collaboration. Commanders can use the public discussion platform to exchange opinions on adjustments to maintenance operations and maintenance methods in real time to ensure that the maintenance plan can meet mission objectives and safety standards.

[0063] The maintenance operation guide provides detailed maintenance tools or plan options, which team members can make changes based on the discussion results. It allows team members to adjust the maintenance plan based on the latest discussions and feedback, ensuring real-time updating and optimization of the maintenance plan. After confirming the changes, the maintenance process can be shared within the team to ensure that all members have a clear understanding of the latest maintenance plan. This sharing mechanism helps reduce misunderstandings and communication errors and improve the team's execution.

[0064] The space station's simulated environment is not only used to simulate maintenance missions, but also serves as a platform for training and rehearsal. By simulating different maintenance scenarios and challenges, astronauts and technicians can gain valuable experience before actually performing missions. This integrated training and rehearsal method helps to improve the team's overall capabilities and ensure that maintenance work can be completed quickly and accurately when faced with real missions.

[0065] The space station maintenance result storage module is used to record key data, operation steps and maintenance results during the maintenance process in the background database.

[0066] For example, the space station maintenance simulation system records key data, operating steps and maintenance results in the maintenance process in the database of the mixed reality background; the space station maintenance simulation system can capture key data in the maintenance process in real time, including but not limited to equipment status, environmental parameters, tool usage and maintenance personnel's operation details; each step of the maintenance operation in the simulation training will be recorded in detail by the system, including the time point of the operation, the specific actions performed and the duration of the operation; the space station maintenance result storage module helps to review the entire space station extravehicular maintenance process and analyze the efficiency and correctness of each step.

[0067] After the maintenance is completed, the space station maintenance simulation system will record the maintenance results in the database, including a comparison of the equipment status before and after the maintenance, whether the fault has been successfully eliminated, and the performance test results after the maintenance. This information will help evaluate the maintenance quality, formulate future maintenance plans, and improve the maintenance process.

[0068] The space station maintenance result evaluation module is used to visualize the result evaluation and analysis strategy of the training mission and the required data indicators after the training mission is completed, and submit the generated maintenance report to the space station maintenance system or platform for evaluation and archiving.

[0069] For example, after the training mission is completed, the result evaluation and analysis strategy of the training mission and the required data indicators are visualized, and a detailed maintenance report is generated and submitted to the space station maintenance system or platform for evaluation and archiving, providing further reference for subsequent further space station maintenance strategies and discussions.

[0070] The results evaluation and analysis strategy for training tasks includes quantitative analysis of performance in training tasks, involving consideration of multiple dimensions such as the accuracy, efficiency, and safety of maintenance operations. By setting a series of data indicators, such as task completion time and operation accuracy, the execution of maintenance tasks can be comprehensively evaluated.

[0071] The results evaluation and analysis strategies of training tasks are presented through visualization tools such as charts, graphs, and dashboards, making complex data information more intuitive and easy to understand. The visualization results can help the maintenance team quickly identify problems and provide intuitive support for discussions and decision-making.

[0072] Based on the results evaluation and analysis strategy of the training mission, the space station maintenance simulation system will generate a detailed maintenance report, which includes not only quantitative data indicators, but also a qualitative description of the maintenance operation, such as special circumstances during the operation, team collaboration, and records of any abnormal events.

[0073] The space station maintenance simulation method provided by the present invention is described below. The space station maintenance simulation method described below and the space station maintenance simulation system described above can be referenced to each other.

[0074] Figure 2 A flow chart of a space station maintenance simulation method provided by the present invention is as follows: Figure 2 As shown, the space station maintenance simulation method is used in devices such as servers, desktops, and laptops, and includes the following steps: In step 201, a simulated environment of a space station is constructed using mixed reality technology based on sunlight, atmospheric radiation during the dawn and dusk periods, and orbital parameters of space debris.

[0075] In step 202, based on the original model data of each environmental subject in the space station, a white model infrastructure required for the space station environment operation scene is constructed, and a three-dimensional model rendering is performed on the white model infrastructure to obtain a space station model.

[0076] In step 203, a three-dimensional image of impact damage is constructed using the collected historical data of impacts between the space debris and the space station, and the three-dimensional image of impact damage is superimposed on the space station model.

[0077] In step 204, based on the three-dimensional image of the impact damage, the fault report and the real prediction analysis strategy input by the user, a robotic arm maintenance plan or an astronaut extravehicular maintenance plan is recommended.

[0078] Figure 3 The following is an example of a physical structure diagram of a space station maintenance simulation system: Figure 3 As shown, the space station maintenance simulation system may include: a processor 310, a communications interface 320, a memory 330, and a communications bus 340. The processor 310, the communications interface 320, and the memory 330 communicate with each other via the communications bus 340. The processor 310 may invoke logic instructions in the memory 330 to execute a space station maintenance simulation method, which includes: constructing a simulated space station environment using mixed reality technology based on sunlight, atmospheric radiation during the dawn and dusk periods, and orbital parameters of space debris; constructing a white model infrastructure required for the space station environment operation scenario based on original model data of various environmental entities in the space station, and performing three-dimensional model rendering on the white model infrastructure to obtain a space station model; constructing a three-dimensional impact damage image based on collected historical data of collisions between space debris and the space station, and superimposing the three-dimensional impact damage image on the space station model; and recommending a robotic arm maintenance plan or an astronaut extravehicular maintenance plan based on the three-dimensional impact damage image, fault reports, and a user-input real-world prediction analysis strategy.

[0079] Furthermore, the logic instructions in the aforementioned memory 330 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product, stored in a storage medium, includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0080] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the space station maintenance simulation method provided by the above methods, which includes: using mixed reality technology to construct a simulated environment of the space station based on sunlight, atmospheric radiation during the dawn and dusk periods, and orbital parameters of space debris; based on the original model data of each environmental subject in the space station, constructing a white model infrastructure required for the space station environment operation scene, performing three-dimensional model rendering on the white model infrastructure to obtain a space station model; constructing a three-dimensional image of impact damage through the collected collision history data between space debris and the space station, and superimposing the three-dimensional image of impact damage on the space station model; recommending a robotic arm maintenance plan or an astronaut extravehicular maintenance plan based on the real prediction analysis strategy of the three-dimensional image of impact damage, fault report status and user input.

[0081] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the space station maintenance simulation method provided by the above-mentioned methods, the method comprising: constructing a simulated environment of the space station using mixed reality technology according to sunlight, atmospheric radiation during the dawn and dusk periods, and orbital parameters of space debris; constructing a white model infrastructure required for the space station environment operation scene based on the original model data of each environmental subject in the space station, performing three-dimensional model rendering on the white model infrastructure to obtain a space station model; constructing a three-dimensional image of impact damage through the collected historical collision data between the space debris and the space station, and superimposing the three-dimensional image of impact damage on the space station model; and recommending a robotic arm maintenance plan or an astronaut extravehicular maintenance plan based on the real prediction analysis strategy of the three-dimensional image of impact damage, fault report status, and user input.

[0082] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0083] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented using software plus a necessary general-purpose hardware platform, or of course, hardware. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for causing a computer device (such as a personal computer, server, or network device) to execute the methods described in each embodiment or certain portions of the embodiments.

[0084] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A space station maintenance simulation system, characterized in that: include: The space station environment simulation construction module is used to build a simulated environment of the space station using mixed reality technology based on sunlight, atmospheric radiation during the dawn and dusk periods, and orbital parameters of space debris; A model adaptive reconstruction module is used to construct a white model infrastructure required for the space station environment operation scene based on the original model data of each environmental subject in the space station, and perform three-dimensional model rendering on the white model infrastructure to obtain a space station model; a space station damage simulation module, configured to construct a three-dimensional image of the impact damage using the collected historical data of collisions between space debris and the space station, and to superimpose the three-dimensional image of the impact damage onto the space station model; The space station maintenance plan selection module is used to recommend a robotic arm maintenance plan or an astronaut extravehicular maintenance plan based on the three-dimensional image of the impact damage, the fault report and the real prediction analysis strategy input by the user.

2. The system according to claim 1, wherein: The space station environment simulation building module is also used to Calculate the time when the space station enters and exits the Earth's shadow, the solar illumination angle, and the atmospheric radiation space environment during the twilight period based on the sunlight and the atmospheric radiation during the twilight period; constructing orbital parameters of the space debris; The space debris orbital parameters include the basic orbit, type, nationality, launch number and size of the space debris; A simulation environment of the space station is constructed according to the time when the space station enters and exits the earth's shadow, the solar illumination angle, the atmospheric radiation space environment during the dawn and dusk periods, and the orbital parameters of the space debris.

3. The system according to claim 1, wherein: The various environmental entities in the space station include the space station, robotic arm, operating table, astronauts and maintenance tools; the model adaptive reconstruction module is also used to Using high-definition pipeline technology to construct original model data of the space station, robotic arm, operating console, astronauts, and maintenance tools; Based on the original model data of the space station, robotic arm, operating console, astronauts and maintenance tools, a white model infrastructure required for the space station extravehicular environment operation scene is constructed; The material, illumination angle, texture and color of the white model base structure are rendered into a three-dimensional model to complete the adaptive reconstruction of the three-dimensional model, and the size, proportion and details of the white model base structure are adjusted to obtain a space station model.

4. The system according to claim 1, wherein: The space station damage simulation module is also used to calculating collision parameters using the collected historical collision data between the space debris and the space station; Based on the collision parameters, use mixed reality technology to restore the space station collision situation and collision damage; A three-dimensional image of impact damage is constructed based on the collision condition and the collision damage condition of the space station, and the three-dimensional image of impact damage is superimposed on the space station model and highlighted.

5. The system according to claim 1, wherein: The space station maintenance plan selection module is also used to Based on the space station collision situation, collision damage, the fault report, and the user-entered real-world prediction and analysis strategy, the fault report results and cabin damage assessment results are determined, and the entire repair operation process is simulated; the entire repair operation process includes at least one of replacing a specified damaged component, repairing a solar array, or adjusting specified operating parameters; The robotic arm maintenance plan or the astronaut extravehicular maintenance plan is recommended based on the cabin damage assessment results.

6. The system according to claim 5, characterized in that The space station maintenance plan selection module is also used to Recommending a repair plan for the robotic arm based on the cabin damage assessment results, simulating the actual repair process through mixed reality gesture interaction; the robotic arm repair plan includes any one of the following operations: controlling the robotic arm to move to a specified position, controlling the robotic arm to grasp a tool, or controlling the robotic arm to replace a damaged part; Or, based on the results of the cabin damage assessment, the astronaut extravehicular maintenance plan is recommended, which includes: issuing a prompt to recommend astronauts to perform extravehicular maintenance, restoring the three-dimensional panoramic scene and special effects animation of the robotic arm taking the astronauts out of the cabin and sending them to the space station for maintenance, and restoring the astronauts' movement path scene and the fixing scene of the safety rope.

7. The system according to claim 1, wherein: Also includes: Space station maintenance simulation training module for Locating a fault on the device in a simulated environment of the space station to determine the fault location; Determine the cause of the fault based on the description of the fault phenomenon and the troubleshooting solution provided by the 3D holographic image maintenance manual; Based on the fault location and the fault cause, simulated operation exercises of various maintenance tools are provided, and the simulated operation exercises include simulation of disassembly, repair and welding maintenance processes.

8. The system according to claim 1, wherein: Also includes: The integrated display module for space station maintenance simulation training is used to display space station extravehicular maintenance scenarios in a virtual mixed reality environment, and adjust maintenance operations and methods based on public discussions among multiple commanders.

9. The system according to claim 1, wherein: Also includes: The space station maintenance result storage module is used to record key data, operation steps and maintenance results during the maintenance process in the background database; The space station maintenance result evaluation module is used to visualize the result evaluation and analysis strategy and required data indicators of the training task after the training task is completed, and submit the generated maintenance report to the space station maintenance system or platform for evaluation and archiving.

10. A space station maintenance simulation method, characterized in that: include: Using mixed reality technology to build a simulated space station environment based on sunlight, atmospheric radiation during dawn and dusk, and orbital parameters of space debris; Based on the original model data of each environmental subject in the space station, a white model infrastructure required for the space station environment operation scene is constructed, and a three-dimensional model rendering is performed on the white model infrastructure to obtain a space station model; constructing a three-dimensional image of impact damage using the collected historical data of impacts between the space debris and the space station, and superimposing the three-dimensional image of impact damage on the space station model; Based on the three-dimensional image of the impact damage, the fault report and the real prediction analysis strategy input by the user, a robotic arm maintenance plan or an astronaut extravehicular maintenance plan is recommended.

Images