A visual retrieval system and method for aerospace engineering data

Abstract

The present invention provides a visual retrieval system and method for aerospace engineering data, which includes: a 3D model and cascade relationship building module, a data visualization component library building module, a mapping relationship table building module, a 3D scene rendering and roaming module, an aerospace engineering data cascade retrieval module, an interactive data visualization module, and an aerospace engineering database and file system module. The system can realize immersive, interactive, and 3D model-driven visual retrieval of aerospace engineering data by establishing a mapping relationship between 3D model-engineering data-data visualization components and a designed aerospace engineering data cascade retrieval method, and finally visualize the retrieved data in various forms, so that users have a sense of what they see is what they get in the entire data retrieval process, thereby improving the user's experience of data retrieval.

Description

Technical Field

[0001] The present invention relates to the technical field of data retrieval, and in particular to a visual retrieval system and method for aerospace engineering data. Background Art

[0002] With the rapid development of computer technology and data information processing technology, users can retrieve expected data from massive data according to screening conditions to achieve data retrieval.

[0003] From the perspective of human-computer interaction, data retrieval can be divided into retrieval based on text information and retrieval with the help of visual graphics and images. Among them, retrieval based on text information generally sets data filtering conditions and performs data retrieval in the form of inputting or selecting text. Data retrieval with the help of visual graphics and images is generally customized for specific fields and data and specific filtering conditions. It sets data filtering conditions and performs data retrieval by utilizing visual understanding and human-computer interaction. A typical example is the retrieval of remote sensing images based on two-dimensional maps, where the mouse is used to interactively select on the map to set the latitude and longitude range conditions of the retrieved data.

[0004] However, for the data retrieval of aerospace engineering data, the above data retrieval methods generally have the following problems: the human-computer interaction means are relatively simple, the users cannot intuitively understand the screening conditions and retrieval result data during the data retrieval process, and there is a lack of immersion in the data retrieval, which leads to a decrease in the user experience of data retrieval. Summary of the invention

[0005] The technical problem to be solved by the present invention is that during the data retrieval process of aerospace engineering data, users cannot intuitively understand the screening conditions and the retrieval result data, resulting in a low user experience in data retrieval.

[0006] In order to solve the above technical problems, the present invention provides a visual retrieval system and method for aerospace engineering data, which specifically adopts the following technical solutions:

[0007] In a first aspect, the present invention provides a visual retrieval system for aerospace engineering data, comprising: a 3D model and cascade relationship construction module, a data visualization component library construction module, a mapping relationship table construction module, a 3D scene rendering and roaming module, an aerospace engineering data cascade retrieval module, an interactive data visualization module, and an aerospace engineering database and file system module. Among them, the 3D model and cascade relationship construction module is used to construct a 3D model of aerospace hardware equipment and a model cascade relationship of the 3D model of aerospace hardware equipment according to the basic data of the aerospace hardware equipment; the basic data of the aerospace hardware equipment includes: type data and structural size data of the aerospace hardware equipment. The aerospace engineering database and file system module is used to store and provide aerospace engineering data. The data visualization component library construction module is used to determine the corresponding data visualization component according to the data type of the aerospace engineering data and construct a data visualization component library. The mapping relationship table construction module is used to associate and map the 3D model of the aerospace hardware equipment, the aerospace engineering data and the data visualization component, and construct a mapping relationship table. The 3D scene rendering and roaming module is used to generate and display a user retrieval operation interface according to the 3D model of the aerospace hardware equipment, so that the user can select the 3D model of the aerospace hardware equipment. The aerospace engineering data cascade retrieval module is used to receive the user's model selection results and retrieval conditions, and determine the aerospace engineering data retrieval results from the aerospace engineering database and file system through the mapping relationship table and the model cascade relationship according to the model selection results and the retrieval conditions, and determine the data visualization component corresponding to the aerospace engineering data retrieval results from the data visualization component library. The interactive data visualization module is used to map the aerospace engineering data retrieval results to the data visualization component corresponding to the aerospace engineering data retrieval results, so as to generate and display the aerospace engineering data retrieval results.

[0008] This system, by establishing a mapping relationship between 3D models, engineering data, and data visualization components and designing a cascade retrieval method for aerospace engineering data, realizes immersive, interactive, 3D model-driven visualization retrieval of aerospace engineering data, and ultimately presents the retrieved data in a variety of forms of visualization, allowing users to have a what-you-see-is-what-you-get experience throughout the data retrieval process, thereby improving the user experience of data retrieval.

[0009] In combination with the first aspect, in an optional implementation, the above-mentioned 3D model of the spacecraft hardware equipment includes: an aircraft model, a cabin model, a test cabinet model, a module model and an instrument model. Among them, the aircraft model is used to characterize the overall shape and structure of the spacecraft, the cabin model is used to characterize the shape and structure of each cabin included in the spacecraft, the test cabinet model is used to characterize the shape and structure of the test cabinet included in each cabin, the module model is used to characterize the shape and structure of the functional module included in the test cabinet, and the instrument model is used to characterize the shape and structure of the instrument included in the functional module.

[0010] In combination with the first aspect, in an optional implementation method, the model cascade relationship of the above-mentioned spacecraft hardware equipment 3D model is: the aircraft model is associated with the cabin model, the cabin model is associated with the experimental cabinet model, the experimental cabinet model is associated with the module model, and the module model is associated with the instrument model.

[0011] In combination with the first aspect, in an optional implementation, the data types of the above-mentioned aerospace engineering data include: parameter data, text data, image data and video data.

[0012] In conjunction with the first aspect, in an optional implementation, the data visualization component library includes: a line chart component, a bar chart component, an image component, a video component, and a text component. The line chart component is used to display parameter data in a line format, the bar chart component is used to display parameter data in a column format, the image component is used to display image data, the video component is used to display video data, and the text component is used to display text data.

[0013] In this implementation, the retrieved aerospace engineering data can be displayed in a diversified manner through the above-mentioned line chart component, bar chart component, image component, video component and text component, further improving the user experience.

[0014] In conjunction with the first aspect, in an optional implementation, the above-mentioned mapping relationship table includes: a direct mapping table, an indirect mapping table, and a multi-visualization component mapping table. Among them, the direct mapping table is used to represent the correspondence between aerospace engineering data and the 3D model of the spacecraft hardware device corresponding to the spacecraft hardware device that generates the aerospace engineering data, the indirect mapping table is used to represent the correspondence between aerospace engineering data and the 3D model of the spacecraft hardware device corresponding to the upper-level spacecraft hardware device of the spacecraft hardware device that generates the aerospace engineering data, and the multi-visualization component mapping table is used to represent the correspondence between aerospace engineering data and one or more data visualization components.

[0015] In this implementation, the mapping relationship table construction module can associate and map the 3D model of the spacecraft hardware device, the aerospace engineering data and the data visualization component to achieve the purpose of visual retrieval of aerospace engineering data driven by the 3D model. Through the direct mapping table, the data directly generated by the spacecraft hardware device can be quickly provided to the user. Through the indirect mapping table, all data generated by the lower-level spacecraft hardware device can be quickly and conveniently provided to the user to provide an overall overview of the aerospace engineering data. Through the multi-visual component mapping table, the same aerospace engineering data can be visualized in different forms, providing users with a variety of choices.

[0016] In combination with the first aspect, in an optional implementation method, the above-mentioned aerospace engineering data cascade retrieval module is specifically used to: first, determine the target spacecraft hardware device 3D model according to the spacecraft hardware device name corresponding to the model selection result. Then, according to the target spacecraft hardware device 3D model, the target aerospace engineering data is determined from the aerospace engineering database and file system through the mapping relationship table and the model cascade relationship; the target aerospace engineering data includes: the aerospace engineering data corresponding to the target spacecraft hardware device 3D model, or the aerospace engineering data corresponding to the target spacecraft hardware device 3D model and the lower-level spacecraft hardware device 3D model. Further, the aerospace engineering data retrieval result is determined in the target aerospace engineering data according to the retrieval conditions. Finally, according to the determined aerospace engineering data retrieval result and the mapping relationship table, the data visualization component corresponding to the aerospace engineering data retrieval result is determined from the data visualization component library.

[0017] In a second aspect, the present invention provides a method for visual retrieval of aerospace engineering data, comprising: first, obtaining and saving basic data of spacecraft hardware equipment and various types of aerospace engineering data. Then, constructing a 3D model of spacecraft hardware equipment and a model cascade relationship of the 3D model of spacecraft hardware equipment according to the basic data of spacecraft hardware equipment; the basic data of spacecraft hardware equipment includes: type data of spacecraft hardware equipment and structural size data of spacecraft hardware equipment. Secondly, determining the corresponding data visualization component according to the data type of the aerospace engineering data, and constructing a data visualization component library. Next, the 3D model of spacecraft hardware equipment, aerospace engineering data and data visualization component are associated and mapped to construct a mapping relationship table. Then, a user retrieval operation interface is generated and displayed according to the 3D model of spacecraft hardware equipment, so that the user can select the 3D model of spacecraft hardware equipment. Further, receiving the model selection result and retrieval condition of the user, and determining the aerospace engineering data retrieval result from the aerospace engineering database and the file system through the mapping relationship table and the model cascade relationship according to the model selection result and the retrieval condition, and determining the data visualization component corresponding to the aerospace engineering data retrieval result from the data visualization component library. Finally, the aerospace engineering data retrieval results are mapped to data visualization components corresponding to the aerospace engineering data retrieval results to generate and display the aerospace engineering data retrieval results.

[0018] According to a third aspect, an electronic device is provided, comprising: a memory, and one or more processors; the memory is coupled to the processor; wherein computer program code is stored in the memory, and the computer program code comprises computer instructions, and when the computer instructions are executed by the processor, the electronic device executes the aerospace engineering data visualization retrieval method according to the second aspect mentioned above.

[0019] In a fourth aspect, a computer-readable storage medium is provided, comprising computer instructions, which, when executed on an electronic device, enables the electronic device to execute the aerospace engineering data visualization retrieval method as described in the second aspect above.

[0020] It can be understood that the beneficial effects that can be achieved by the aerospace engineering data visualization retrieval method provided by the second aspect, the electronic device of the third aspect, and the computer-readable storage medium of the fourth aspect can refer to the beneficial effects of the first aspect and any possible design method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 An architectural diagram of a visual retrieval system for aerospace engineering data provided by an embodiment of the present invention;

[0022] Figure 2 A schematic diagram of the technical process of a visual retrieval system for aerospace engineering data provided by an embodiment of the present invention;

[0023] Figure 3 A schematic diagram of a model cascade relationship provided by an embodiment of the present invention;

[0024] Figure 4 A schematic diagram of a mapping relationship provided in an embodiment of the present invention;

[0025] Figure 5 A schematic diagram of a display interface of a visual retrieval system for aerospace engineering data provided by an embodiment of the present invention;

[0026] Figure 6 A schematic diagram of a display interface for a model cascade relationship provided in an embodiment of the present invention;

[0027] Figure 7 A schematic diagram of a display interface of a mapping relationship table construction module provided in an embodiment of the present invention;

[0028] Figure 8 A schematic flow chart of a method for visual retrieval of aerospace engineering data provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0029] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0030] With the rapid development of computer technology and data information processing technology, users can retrieve expected data from massive data according to screening conditions to achieve data retrieval.

[0031] From the perspective of human-computer interaction, data retrieval can be divided into retrieval based on text information and retrieval with the help of visual graphics and images. Among them, retrieval based on text information generally sets data filtering conditions and performs data retrieval in the form of inputting or selecting text. For example, the user can enter the filtering conditions in the text box and select specific conditions through the drop-down box. After setting the filtering conditions, the user performs the data retrieval operation and returns the data that meets the conditions. The data retrieval method based on text information only requires the system to provide an input box or selection box for text information, so it can adapt to the setting of filtering conditions in various situations and is a data retrieval method with a wide range of applications.

[0032] Data retrieval methods with the help of visual graphics and images generally use human visual understanding and human-computer interaction to set data screening conditions and perform data retrieval. Data retrieval methods with the help of visual graphics and images are generally customized for specific fields and data and specific screening conditions. A typical example is the retrieval of remote sensing images based on two-dimensional maps, where the mouse is used to interactively select on the map to set the latitude and longitude range conditions of the retrieved data.

[0033] However, for the data retrieval of aerospace engineering data, the data retrieval method based on text information mainly sets the data screening conditions and performs data retrieval in the form of inputting or selecting text. The human-computer interaction means in this process are relatively simple, and the process of setting conditions such as spatial range is also cumbersome and time-consuming. The data retrieval method based on text information is more universal but lacks pertinence, and does not give full play to people's visual understanding, and the whole process lacks immersion. The data retrieval method with the help of visual graphics and images is mainly customized for specific fields and data, and for specific screening conditions such as spatial range. The data screening conditions are set by interactive drawing with the mouse, which has a limited scope of application for the data. The human-computer interaction means in the retrieval process are relatively simple, and the user's immersion in the scene during the data retrieval process still needs to be improved.

[0034] It can be seen that the above-mentioned data retrieval methods generally have the problem that the human-computer interaction means are relatively simple, the users cannot intuitively understand the screening conditions and retrieval result data during the data retrieval process, and there is a lack of immersion in data retrieval, which leads to a decrease in the user experience of data retrieval.

[0035] In order to solve the above problems, an embodiment of the present invention provides a visual retrieval system and method for aerospace engineering data. The visual retrieval system is based on a 3D model-driven system that builds a 3D model of spacecraft hardware equipment and establishes a cascade relationship between models to achieve roaming interactive selection of equipment from the whole to the part. By establishing a mapping relationship between 3D model-engineering data-data visualization components and a designed aerospace engineering data cascade retrieval method, an immersive, interactive, 3D model-driven visual retrieval of aerospace engineering data is achieved, and the retrieved data is finally visualized in various forms, allowing users to have a what-you-see-is-what-you-get experience throughout the data retrieval process, thereby improving the user experience of data retrieval.

[0036] The solution provided by the embodiment of the present application is introduced below in conjunction with the accompanying drawings.

[0037] For details, see Figure 1 , which is an architecture diagram of the aerospace engineering data visualization retrieval system provided by an embodiment of the present invention, such as Figure 1 As shown, the aerospace engineering data visualization retrieval system 100 provided in the embodiment of the present application includes: a 3D model and cascade relationship construction module 110, a data visualization component library construction module 120, a mapping relationship table construction module 130, a 3D scene rendering and roaming module 140, an aerospace engineering data cascade retrieval module 150, an interactive data visualization module 160 and an aerospace engineering database and file system module 170.

[0038] Figure 2 A schematic diagram of the technical process of the aerospace engineering data visualization retrieval system provided by the embodiment of the present invention is shown in FIG. Figure 2 As shown, the aerospace engineering data visualization retrieval system provided by the embodiment of the present invention includes a WEB (network) front-end (or user-end) part and a back-end service (administrator-end) part. Among them, the back-end service part includes: a 3D model and cascade relationship construction module 110, a data visualization component library construction module 120, a mapping relationship table construction module 130 and an aerospace engineering database and file system module 170. That is, the 3D model and cascade relationship construction module 110, the data visualization component library construction module 120, and the mapping relationship table construction module 130 can be pre-constructed and dynamically updated by the system administrator. The aerospace engineering database and file system module 170 is a basic module. The WEB front-end part includes: a 3D scene rendering and roaming module 140, an aerospace engineering data cascade retrieval module 150 and an interactive data visualization module 160. That is, the 3D scene rendering and roaming module 140, the aerospace engineering data cascade retrieval module 150 and the interactive data visualization module 160 are user-oriented interactive operations, providing users with immersive data visualization retrieval services in the form of a WEB browser.

[0039] Specifically, the 3D model and cascade relationship building module 110 can be used to build a 3D model of spacecraft hardware equipment and a model cascade relationship of the 3D model of spacecraft hardware equipment according to the basic data of spacecraft hardware equipment. The basic data of spacecraft hardware equipment includes: type data and structural size data of spacecraft hardware equipment.

[0040] The 3D model and cascade relationship construction module 110 is one of the basic components of the aerospace engineering data visualization retrieval system, and can provide underlying model data support for 3D model-driven engineering data visualization retrieval.

[0041] In some embodiments, the above-mentioned 3D model of spacecraft hardware equipment includes: an aircraft model, a cabin model, a test cabinet model, a module model and an instrument model.

[0042] Among them, the aircraft model is used to characterize the overall shape and structure of the spacecraft, the cabin model is used to characterize the shape and structure of each cabin included in the spacecraft, the experimental cabinet model is used to characterize the shape and structure of the experimental cabinet included in each cabin, the module model is used to characterize the shape and structure of the functional modules included in the experimental cabinet, and the instrument model is used to characterize the shape and structure of the instruments included in the functional modules.

[0043] In one implementation, the 3D model and cascade relationship building module 110 can build an aircraft model, a cabin model, a test cabinet model, a module model and an instrument model through 3D modeling software (eg, Ci nema 4D).

[0044] In some embodiments, the 3D model of the spacecraft hardware equipment can be cascaded according to the relationship from the whole to the part. Specifically, the model cascade relationship of the 3D model of the spacecraft hardware equipment can be: the aircraft model is associated with the cabin model, the cabin model is associated with the laboratory cabinet model, the laboratory cabinet model is associated with the module model, and the module model is associated with the instrument model. The levels of the 3D model of the spacecraft hardware equipment are from high to low: aircraft model, cabin model, laboratory cabinet model, module model, instrument model. In this way, the model cascade relationship can provide users with a hierarchical and targeted retrieval of aerospace engineering data using the 3D model of the spacecraft hardware equipment as a navigation.

[0045] In one example, Figure 3 A schematic diagram of the model cascade relationship provided by an embodiment of the present invention, such as Figure 3As shown, the aircraft model can specifically be: a space station model. The cabin model can specifically include: a core cabin model, an experimental cabin I model, and an experimental cabin II model. The experimental cabinet model can specifically include: a containerless material experimental cabinet model, a medical sample and high microgravity experimental cabinet model, a human system research cabinet model, a space bicycle model, and a microwave heating device model. The module model can specifically include: a thermal control drawer model, an experimental electronic control module model, a vacuum and pressurization module model, and an experimental platform core model. The instrument model can specifically include: a panoramic camera model, a position detection camera model, a single-wavelength thermometer model, a dual-wavelength thermometer model, and a pulsed laser model.

[0046] Exemplarily, the space station model is associated with the core module model, the experimental module I model and the experimental module II model in a cascade relationship. Moreover, the space station model is the upper-level spacecraft hardware equipment of the core module model, the experimental module I model and the experimental module II model.

[0047] The core module model is associated with the non-container material experiment cabinet model, the medical sample and high microgravity experiment cabinet model, the human system research cabinet model, the space bicycle model and the microwave heating device model in a cascade relationship. In addition, the core module model is the upper-level spacecraft hardware equipment of the non-container material experiment cabinet model, the medical sample and high microgravity experiment cabinet model, the human system research cabinet model, the space bicycle model and the microwave heating device model.

[0048] The containerless material experiment cabinet model is associated with the thermal control drawer model, the experimental electric control module model, the vacuum and pressurization module model and the experimental platform core model in a cascade relationship. In addition, the containerless material experiment cabinet model is the upper-level spacecraft hardware equipment of the thermal control drawer model, the experimental electric control module model, the vacuum and pressurization module model and the experimental platform core model.

[0049] The core model of the experimental platform is associated with the panoramic camera model, the position detection camera model, the single-wavelength thermometer model, the dual-wavelength thermometer model and the pulse laser model in a cascade relationship. In addition, the core model of the experimental platform is the upper-level spacecraft hardware equipment of the panoramic camera model, the position detection camera model, the single-wavelength thermometer model, the dual-wavelength thermometer model and the pulse laser model.

[0050] In one implementation, the 3D model and cascade relationship building module 110 can build the model cascade relationship between the aircraft model, the cabin model, the test cabinet model, the module model and the instrument model through 3D modeling software (eg, Ci nema 4D).

[0051] The aerospace engineering database and file system module 170 can be used to store and provide various aerospace engineering data.

[0052] In the embodiment of the present application, the aerospace engineering database and file system module 170 serves as the data basis of the aerospace engineering data visualization retrieval system and is the source of aerospace engineering data. The data types of aerospace engineering data include: parameter data, text data, image data and video data.

[0053] Specifically, the parameter data may be an aerospace engineering data file stored in the form of time-series recording parameters, such as a csv format file, etc. The text data may be aerospace engineering text data saved in txt, doc, docx, xml, pdf, etc. The image data may be an aerospace engineering data file stored in an image compression package format such as png, jpg, bmp, etc., such as a rar, zip format file, etc. The video data may be a data file stored in a video format, such as mp4, mpeg, avi format file, etc.

[0054] The data visualization component library construction module 120 can be used to determine the corresponding data visualization component according to the data type of the aerospace engineering data and construct a data visualization component library.

[0055] In the embodiment of the present application, the data visualization component library construction module 120, as one of the basic components of the aerospace engineering data visualization retrieval system, can realize a variety of out-of-the-box data visualization functions and define the required data interfaces and interaction methods.

[0056] In some embodiments, the data visualization component library includes: a line chart component, a bar chart component, an image component, a video component, and a text component. Among them, the line chart component is used to display parameter data in a line manner, and has functions such as supporting mouse interactive operations such as coordinate axis scaling. The bar chart component is used to display parameter data in a columnar manner, and has functions such as supporting mouse interactive operations such as coordinate axis scaling. The image component is used to display image data, and has functions such as supporting a series of sequential images by turning pages, including functions such as scaling, rotation, positioning, thumbnails, and annotations. The video component is used to display video data, and has functions such as supporting full-screen playback and adjusting playback speed. The text component is used to display text data, and has functions such as supporting opening text data in the form of a text viewer for online preview, and supporting page turning.

[0057] The mapping relationship table construction module 130 can be used to perform association mapping on the 3D model of spacecraft hardware equipment, aerospace engineering data and data visualization components to construct a mapping relationship table.

[0058] In the embodiment of the present application, the mapping relationship table construction module 130 is a key component module of the aerospace engineering data visualization retrieval system. The mapping relationship table construction module 130 can associate and map the 3D model of the spacecraft hardware equipment, the aerospace engineering data and the data visualization component to achieve the purpose of visual retrieval of aerospace engineering data driven by the 3D model. In addition, by dynamically updating the mapping relationship table, the dynamic expansion of the aerospace engineering data type and the continuous growth of the data scale can also be supported.

[0059] In some embodiments, the mapping relationship table includes: a direct mapping table, an indirect mapping table, and a multi-visual component mapping table.

[0060] Specifically, the direct mapping table is used to characterize the correspondence between the aerospace engineering data and the 3D model of the spacecraft hardware device corresponding to the spacecraft hardware device that generates the aerospace engineering data. That is, the aerospace engineering data is directly associated with the 3D model of the spacecraft hardware device corresponding to the spacecraft hardware device that generates the aerospace engineering data. In this way, the direct mapping table can be used to quickly provide users with data directly generated by the spacecraft hardware device.

[0061] For example, Figure 4 A schematic diagram of a mapping relationship provided by an embodiment of the present invention, such as Figure 4 As shown, temperature data 1 is generated by a single-wavelength thermometer, that is, temperature data 1 is associated with the single-wavelength thermometer model, that is, temperature data 1 has a direct mapping relationship with the single-wavelength thermometer model. For another example, the pressure value of the experimental cavity is generated by the core of the experimental platform, that is, the pressure value of the experimental cavity is associated with the core model of the experimental platform, that is, the pressure value of the experimental cavity has a direct mapping relationship with the core model of the experimental platform.

[0062] The above indirect mapping table is used to represent the correspondence between aerospace engineering data and the 3D model of spacecraft hardware equipment corresponding to the superior spacecraft hardware equipment of the spacecraft hardware equipment that generates the aerospace engineering data. That is, the aerospace engineering data is associated with the 3D model of spacecraft hardware equipment corresponding to the superior spacecraft hardware equipment of the spacecraft hardware equipment that generates the aerospace engineering data. The superior spacecraft hardware equipment can be the upper-level spacecraft hardware equipment, or multiple-level spacecraft hardware equipment. Figure 3 Taking the model cascade relationship shown in the figure as an example, the upper-level spacecraft hardware equipment of the panoramic camera can be: experimental platform core, containerless material experimental cabinet, core cabin, and space station. The upper-level spacecraft hardware equipment of the experimental electronic control module can be: containerless material experimental cabinet, core cabin, and space station. In this way, through the indirect mapping table, all data generated by the lower-level spacecraft hardware equipment can be provided to users quickly and conveniently to provide an overall overview of the aerospace engineering data situation.

[0063] For example, Figure 4As shown, temperature data 1 is generated by a single-wavelength thermometer, and the upper-level spacecraft hardware equipment of the single-wavelength thermometer includes: the experimental platform core and the containerless material experimental cabinet. Therefore, temperature data 1 is also associated with the experimental platform core and the containerless material experimental cabinet, that is, temperature data 1 has an indirect mapping relationship with the experimental platform core model and the containerless material experimental cabinet model.

[0064] The above multi-visualization component mapping table is used to characterize the correspondence between aerospace engineering data and one or more data visualization components. That is, the same aerospace engineering data can be associated with one or more data visualization components. In this way, the same aerospace engineering data can be visualized in different forms through the multi-visualization component mapping table, providing users with a variety of choices.

[0065] For example, Figure 4 As shown, the solenoid valve state data can be associated with both the bar graph component and the line graph component, that is, the solenoid valve state data has a visual component mapping relationship with the bar graph component and the line graph component.

[0066] The 3D scene rendering and roaming module 140 can be used to generate and display a user search operation interface based on the spacecraft hardware device 3D model, so that the user can select the spacecraft hardware device 3D model.

[0067] In the embodiment of the present application, the 3D scene rendering and roaming module 140, as one of the basic components of the aerospace engineering data visualization retrieval system, can realize the intuitive presentation of the entire aerospace 3D scene, and support perspective roaming in the aerospace 3D scene through devices such as keyboards, providing support for users' immersive data visualization retrieval.

[0068] Exemplarily, the following spacecraft hardware equipment 3D model selection methods may be provided: aircraft model selection, cabin model selection, experiment cabinet model selection, module model selection and instrument model selection.

[0069] Among them, the aircraft model selection allows you to click on the entire aircraft model through input devices such as the mouse, and use the aircraft name as the basic condition for data retrieval. The cabin model selection allows you to click on the target cabin model through input devices such as the mouse, and use the cabin name as the basic condition for data retrieval. The laboratory cabinet model selection allows you to click on the target laboratory cabinet model through input devices such as the mouse, and use the laboratory cabinet name as the basic condition for data retrieval. The module model selection allows you to click on the target module model through input devices such as the mouse, and use the module name as the basic condition for data retrieval. The instrument model selection allows you to click on the target instrument model through input devices such as the mouse, and use the instrument name as the basic condition for data retrieval.

[0070] The aerospace engineering data cascade retrieval module 150 can be used to receive the user's model selection results and retrieval conditions, and determine the aerospace engineering data retrieval results from the aerospace engineering database and file system based on the model selection results and retrieval conditions through a mapping relationship table and a model cascade relationship, and determine the data visualization components corresponding to the aerospace engineering data retrieval results from the data visualization component library.

[0071] In an embodiment of the present application, the aerospace engineering data cascade retrieval module 150 is a key component module of the aerospace engineering data visualization retrieval system. The aerospace engineering data cascade retrieval module 150 can retrieve and read corresponding data based on the model selection result, the mapping relationship table and the model cascade relationship.

[0072] Exemplarily, the user can select a 3D model in any level of the aircraft model, cabin model, test cabinet model, module model, and instrument model to input the model selection result. When the model selection result is the aircraft model, the aerospace engineering data cascade retrieval module 150 retrieves the aerospace engineering data directly mapped to the aircraft model, and retrieves the aerospace engineering data corresponding to each of the lower-level spacecraft hardware equipment models (including: cabin model, test cabinet model, module model, instrument model) as needed (for example, the retrieval condition includes the retrieved lower-level spacecraft hardware equipment).

[0073] When the model selection result is a cabin model, the aerospace engineering data cascade retrieval module 150 retrieves the aerospace engineering data directly mapped to the cabin model, and retrieves the aerospace engineering data corresponding to the subordinate spacecraft hardware equipment models (including: laboratory cabinet model, module model, instrument model) of the cabin model as needed (for example, the retrieval conditions include the retrieved subordinate spacecraft hardware equipment).

[0074] When the model selection result is an experimental cabinet model, the aerospace engineering data cascade retrieval module 150 retrieves the aerospace engineering data directly mapped to the experimental cabinet model, and retrieves the aerospace engineering data corresponding to the subordinate spacecraft hardware equipment models (including: module models, instrument models) of the experimental cabinet model as needed (for example, the retrieval conditions include the retrieved subordinate spacecraft hardware equipment).

[0075] When the model selection result is a module model, the aerospace engineering data cascade retrieval module 150 retrieves the aerospace engineering data directly mapped to the module model, and retrieves the aerospace engineering data corresponding to the subordinate spacecraft hardware equipment models (including: instrument models) of the module model as needed (for example, the retrieval conditions include the retrieval of subordinate spacecraft hardware equipment).

[0076] When the model selection result is an instrument model, the aerospace engineering data cascade search module 150 searches for aerospace engineering data directly mapped to the instrument model.

[0077] Among them, whether the above-mentioned retrieval model selection result corresponds to the aerospace engineering data of each lower-level spacecraft hardware device of the target spacecraft hardware device can be determined by the user through interface option selection and input into the aerospace engineering data cascade retrieval module 150 as a retrieval condition.

[0078] In some embodiments, the aerospace engineering data cascade retrieval module 150 may be specifically used for:

[0079] First, the 3D model of the target spacecraft hardware device is determined according to the spacecraft hardware device name corresponding to the model selection result.

[0080] Then, according to the target spacecraft hardware equipment 3D model, the target aerospace engineering data is determined from the aerospace engineering database and the file system through the mapping relationship table and the model cascade relationship. The target aerospace engineering data includes: the aerospace engineering data corresponding to the target spacecraft hardware equipment 3D model, or the aerospace engineering data corresponding to the target spacecraft hardware equipment 3D model and the lower-level spacecraft hardware equipment 3D model.

[0081] Further, aerospace engineering data retrieval results are determined in the target aerospace engineering data according to the retrieval conditions.

[0082] In some embodiments, the content retrieved according to the search conditions may specifically include: parameter search, image search, video search and text search.

[0083] Specifically, parameter retrieval is based on the model selection result, and parameter data records are retrieved and read from the aerospace engineering database and file system according to the retrieval conditions. Image retrieval is based on the model selection result, and image data records are retrieved from the aerospace engineering database and file system according to the retrieval conditions, and can be provided in a list form for users to select and read specific image data. Video retrieval is based on the model selection result, and video data records are retrieved from the aerospace engineering database and file system according to the retrieval conditions, and can be provided in a list form for users to select and read specific video data. Text retrieval is based on the model selection result, and text data records are retrieved from the aerospace engineering database and file system according to the retrieval conditions, and can be provided in a list form for users to select and read specific text data.

[0084] Finally, according to the aerospace engineering data retrieval results and the mapping relationship table, the data visualization components corresponding to the aerospace engineering data retrieval results are determined from the data visualization component library.

[0085] The interactive data visualization module 160 may be used to map the aerospace engineering data retrieval results to data visualization components corresponding to the aerospace engineering data retrieval results, so as to generate and display the aerospace engineering data retrieval results.

[0086] In the embodiment of the present application, the interactive data visualization module 160, as one of the basic components of the aerospace engineering data visualization retrieval system, can map the retrieved and read aerospace engineering data retrieval result data to the corresponding data visualization component for presentation. In some implementations, the interactive data visualization module 160 supports interactively setting more retrieval conditions to further filter the aerospace engineering data retrieval result data, for example, including: time range selection conditions, value range selection conditions, and other conditions.

[0087] Specifically, aerospace engineering data retrieval results are generated and displayed, that is, data visualization presentation methods include: line chart, bar chart, image carousel, video playback and text preview.

[0088] Among them, when the aerospace engineering data retrieval result is parameter data, the aerospace engineering data retrieval result can be mapped to a line chart component for drawing and presented in a line form. Alternatively, the aerospace engineering data retrieval result can also be mapped to a bar chart component for drawing and presented in a bar form. When the aerospace engineering data retrieval result is image data, the aerospace engineering data retrieval result can be mapped to an image component for carousel and presented in an image carousel. When the aerospace engineering data retrieval result is video data, the aerospace engineering data retrieval result can be mapped to a video component for playback and presented in a video playback manner. When the aerospace engineering data retrieval result is text data, the aerospace engineering data retrieval result can be mapped to a text component for opening and previewing and presented in a text preview manner.

[0089] The aerospace engineering data visualization retrieval system provided by the above embodiment of the present invention adopts a 3D model-engineering data-data visualization component dynamic mapping mechanism to construct a mapping relationship table as a hub for data visualization retrieval driven by 3D models, realizing immersive, interactive, and 3D model-driven data visualization retrieval, and finally realizing a what-you-see-is-what-you-get aerospace engineering data retrieval and presentation mode through multi-visual component mapping. The 3D model-engineering data-data visualization component dynamic mapping mechanism also strongly supports the dynamic expansion of aerospace engineering data types and the continuous growth of data scale.

[0090] In addition, the aerospace engineering data visualization retrieval system adopts the aerospace engineering data cascade retrieval method, which can use the 3D model selection results of any level of spacecraft hardware equipment in the aircraft, cabin, laboratory cabinet, module, and instrument as the basic condition to retrieve the aerospace engineering data directly mapped to the selected model, and retrieve the aerospace engineering data of each lower-level spacecraft hardware equipment on demand. The aerospace engineering data cascade retrieval method can intuitively let users know which spacecraft hardware equipment the engineering data comes from, and can also intuitively let users understand what aerospace engineering data a certain spacecraft hardware equipment can generate, effectively improving the convenience and intuitiveness of the user's data retrieval process.

[0091] In summary, the aerospace engineering data visualization retrieval system provided in the embodiment of the present invention realizes immersive, interactive, 3D model-driven aerospace engineering data visualization retrieval by establishing a mapping relationship between 3D model-engineering data-data visualization components and designing a cascade retrieval method for aerospace engineering data, and finally visualizes the retrieved data in various forms, allowing users to have a what-you-see-is-what-you-get experience throughout the data retrieval process, thereby improving the user experience of data retrieval.

[0092] In some embodiments, the application method of the aerospace engineering data visualization retrieval system provided by the embodiments of the present invention is introduced from the perspective of the WEB front end (ie, the user end). Figure 5 A schematic diagram of a display interface of a visual retrieval system for aerospace engineering data provided by an embodiment of the present invention is shown in FIG. Figure 5 As shown, display window A is a 3D model navigation window, and the display content of the window can be generated by the 3D scene rendering and roaming module 140. The user can roam in the 3D scene with the help of input electronic devices such as a keyboard, and select the target spacecraft hardware device model by clicking on the input electronic device such as a mouse, and the selected target spacecraft hardware device model (i.e., the model selection result) can be highlighted. After the user determines the model selection result, the aerospace engineering data cascade retrieval module 150 can retrieve the aerospace engineering data associated with the target spacecraft hardware device model based on the mapping relationship table and display it in display window B. Further, the user can select specific aerospace engineering data as a retrieval condition in display window B to determine the aerospace engineering data retrieval result. And it is generated and displayed in display window C through the interactive data visualization module 160 to visualize the aerospace engineering data retrieval result. Among them, the display window D is a link button for the parameter settings of the aerospace engineering data visualization retrieval system.

[0093] Figure 6 A schematic diagram of a display interface for a model cascade relationship provided in an embodiment of the present invention, such as Figure 6As shown, the spacecraft hardware equipment 3D model 601 is a container-free experimental cabinet model, the spacecraft hardware equipment 3D model 602 is the core model of the experimental platform, and the spacecraft hardware equipment 3D model 603 is a position detection camera model. The spacecraft hardware equipment 3D model 601-spacecraft hardware equipment 3D model 602-spacecraft hardware equipment 3D model 603 has a cascade relationship from the whole to the part. Among them, the spacecraft hardware equipment 3D model 602 is the next level spacecraft hardware equipment 3D model of the spacecraft hardware equipment 3D model 601, the spacecraft hardware equipment 3D model 603 is the next level spacecraft hardware equipment 3D model of the spacecraft hardware equipment 3D model 601, and the spacecraft hardware equipment 3D model 603 is the next level spacecraft hardware equipment 3D model of the spacecraft hardware equipment 3D model 602.

[0094] In some embodiments, Figure 7 A schematic diagram of a display interface of a mapping relationship table construction module provided in an embodiment of the present invention, such as Figure 7 As shown, the mapping relationship table construction module 130 is a display interface for associating and mapping the spacecraft hardware equipment 3D model, aerospace engineering data, and data visualization components, wherein display area 701 and display area 702 are mapping relationship configuration areas between the spacecraft hardware equipment 3D model and aerospace engineering data. Display area 702 and display area 703 are mapping relationship configuration areas between aerospace engineering data and data visualization components. In this way, the mapping relationship table construction module 130 can realize the construction of a mapping relationship table.

[0095] The embodiment of the present invention also provides a method for visual retrieval of aerospace engineering data, which can be applied to Figure 1 and Figure 2 The aerospace engineering data visualization retrieval system shown in FIG. Figure 8 A flow chart of a method for visual retrieval of aerospace engineering data provided by an embodiment of the present invention is shown in FIG. Figure 8 As shown, the method includes the following steps S101-S107:

[0096] S101. Obtain and save basic data of spacecraft hardware equipment and various aerospace engineering data.

[0097] S102: construct a 3D model of the spacecraft hardware equipment and a model cascade relationship of the 3D model of the spacecraft hardware equipment according to the basic data of the spacecraft hardware equipment.

[0098] Among them, the basic data of spacecraft hardware equipment includes: type data of spacecraft hardware equipment and structural size data of spacecraft hardware equipment.

[0099] S103. Determine corresponding data visualization components according to the data type of aerospace engineering data, and construct a data visualization component library.

[0100] S104: perform association mapping on the 3D model of the spacecraft hardware equipment, the aerospace engineering data and the data visualization components, and construct a mapping relationship table.

[0101] S105. Generate and display a user search operation interface based on the spacecraft hardware device 3D model, so that the user can select the spacecraft hardware device 3D model.

[0102] S106. Receive the user's model selection results and search conditions, and determine the aerospace engineering data retrieval results from the aerospace engineering database and file system through the mapping relationship table and the model cascade relationship based on the model selection results and the search conditions, and determine the data visualization components corresponding to the aerospace engineering data retrieval results from the data visualization component library.

[0103] S107, mapping the aerospace engineering data retrieval results to the data visualization components corresponding to the aerospace engineering data retrieval results, so as to generate and display the aerospace engineering data retrieval results.

[0104] By adopting the aerospace engineering data visualization retrieval method provided in the embodiment of the present invention, a mapping relationship between 3D model, engineering data and data visualization components is established, and a cascade retrieval method for aerospace engineering data is designed, an immersive, interactive, 3D model-driven aerospace engineering data visualization retrieval is realized, and the retrieved data is finally visualized in various forms, so that users have a what-you-see-is-what-you-get experience in the entire data retrieval process, thereby improving the user experience of data retrieval.

[0105] An embodiment of the present invention further provides an electronic device, which may include: a display screen, a memory, and one or more processors. The display screen, the memory, and the processor are coupled. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device can execute the various methods or steps executed in the above-mentioned aerospace engineering data visualization retrieval method embodiment. Of course, the electronic device includes but is not limited to the above-mentioned display screen, the memory, and one or more processors.

[0106] An embodiment of the present invention also provides a computer-readable storage medium for storing computer instructions for running the above-mentioned aerospace engineering data visualization retrieval method.

[0107] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0108] In the description of the present invention, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0109] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0110] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0111] Similar parts between the embodiments provided in this application can be referenced to each other. The specific implementation methods provided above are only a few examples under the general concept of this application and do not constitute a limitation on the protection scope of this application. For those skilled in the art, any other implementation methods expanded based on the scheme of this application without creative work belong to the protection scope of this application.

Claims

1. A visual retrieval system for aerospace engineering data, characterized in that: include: 3D model and cascade relationship building module, data visualization component library building module, mapping relationship table building module, 3D scene rendering and roaming module, aerospace engineering data cascade retrieval module, interactive data visualization module and aerospace engineering database and file system module; The 3D model and cascade relationship building module is used to build a 3D model of spacecraft hardware equipment and a model cascade relationship of the 3D model of spacecraft hardware equipment according to the basic data of spacecraft hardware equipment; the basic data of spacecraft hardware equipment includes: type data and structural size data of spacecraft hardware equipment; The aerospace engineering database and file system module is used to store and provide aerospace engineering data; The data visualization component library construction module is used to determine the corresponding data visualization component according to the data type of the aerospace engineering data, and construct a data visualization component library; The mapping relationship table construction module is used to associate and map the spacecraft hardware device 3D model, the aerospace engineering data and the data visualization component to construct a mapping relationship table; the mapping relationship table includes: a direct mapping table, an indirect mapping table, and a multi-visualization component mapping table; wherein the direct mapping table is used to characterize the correspondence between the aerospace engineering data and the 3D model of the spacecraft hardware device corresponding to the spacecraft hardware device that generates the aerospace engineering data, the indirect mapping table is used to characterize the correspondence between the aerospace engineering data and the 3D model of the spacecraft hardware device corresponding to the superior spacecraft hardware device of the spacecraft hardware device that generates the aerospace engineering data, and the multi-visualization component mapping table is used to characterize the correspondence between the aerospace engineering data and one or more data visualization components; The 3D scene rendering and roaming module is used to generate and display a user search operation interface according to the spacecraft hardware device 3D model, so that the user can select the spacecraft hardware device 3D model; The aerospace engineering data cascade retrieval module is used to receive the user's model selection result and retrieval conditions, and determine the aerospace engineering data retrieval result from the aerospace engineering database and the file system through the mapping relationship table and the model cascade relationship according to the model selection result and the retrieval condition, and determine the data visualization component corresponding to the aerospace engineering data retrieval result from the data visualization component library; wherein the retrieval condition is used to retrieve the aerospace engineering data of the spacecraft hardware device model and the lower-level spacecraft hardware device model corresponding to the model selection result; The interactive data visualization module is used to map the aerospace engineering data retrieval result to the data visualization component corresponding to the aerospace engineering data retrieval result, so as to generate and display the aerospace engineering data retrieval result.

2. The system according to claim 1, characterized in that The 3D model of the spacecraft hardware equipment includes: an aircraft model, a cabin model, a test cabinet model, a module model and an instrument model; Among them, the aircraft model is used to characterize the overall shape and structure of the spacecraft, the cabin model is used to characterize the shape and structure of each cabin included in the spacecraft, the experimental cabinet model is used to characterize the shape and structure of the experimental cabinet included in each cabin, the module model is used to characterize the shape and structure of the functional module included in the experimental cabinet, and the instrument model is used to characterize the shape and structure of the instrument included in the functional module.

3. The system according to claim 2, characterized in that The model cascade relationship of the 3D model of the spacecraft hardware equipment is: the aircraft model is associated with the cabin model, the cabin model is associated with the experimental cabinet model, the experimental cabinet model is associated with the module model, and the module model is associated with the instrument model.

4. The system according to claim 1, characterized in that The data types of the aerospace engineering data include: parameter data, text data, image data and video data.

5. The system according to claim 4, characterized in that The data visualization component library includes: a line chart component, a bar chart component, an image component, a video component and a text component; Among them, the line chart component is used to display the parameter data in a line manner, the bar chart component is used to display the parameter data in a bar manner, the image component is used to display the image data, the video component is used to display the video data, and the text component is used to display the text data.

6. The system according to claim 1, characterized in that The aerospace engineering data cascade retrieval module is specifically used for: Determine the target spacecraft hardware device 3D model according to the spacecraft hardware device name corresponding to the model selection result; According to the target spacecraft hardware device 3D model, the target aerospace engineering data is determined from the aerospace engineering database and the file system through the mapping relationship table and the model cascade relationship; The target aerospace engineering data includes: aerospace engineering data corresponding to the target spacecraft hardware equipment 3D model, or aerospace engineering data corresponding to the target spacecraft hardware equipment 3D model and the lower-level spacecraft hardware equipment 3D model; Determine the aerospace engineering data search result in the target aerospace engineering data according to the search condition; According to the aerospace engineering data retrieval result and the mapping relationship table, the data visualization component corresponding to the aerospace engineering data retrieval result is determined from the data visualization component library.

7. A visual retrieval method for aerospace engineering data, characterized in that: include: Acquire and save basic data of spacecraft hardware equipment and aerospace engineering data; Constructing a 3D model of spacecraft hardware equipment and a model cascade relationship of the 3D model of spacecraft hardware equipment according to the basic data of the spacecraft hardware equipment; The basic data of spacecraft hardware equipment includes: type data of spacecraft hardware equipment and structural size data of spacecraft hardware equipment; Determine the corresponding data visualization component according to the data type of the aerospace engineering data, and build a data visualization component library; The 3D model of the spacecraft hardware device, the aerospace engineering data and the data visualization component are associated and mapped to construct a mapping relationship table; the mapping relationship table includes: a direct mapping table, an indirect mapping table and a multi-visualization component mapping table; wherein the direct mapping table is used to characterize the correspondence between the aerospace engineering data and the 3D model of the spacecraft hardware device corresponding to the spacecraft hardware device that generates the aerospace engineering data, the indirect mapping table is used to characterize the correspondence between the aerospace engineering data and the 3D model of the spacecraft hardware device corresponding to the superior spacecraft hardware device of the spacecraft hardware device that generates the aerospace engineering data, and the multi-visualization component mapping table is used to characterize the correspondence between the aerospace engineering data and one or more data visualization components; Rendering a 3D scene according to the 3D model of the spacecraft hardware device, generating and displaying a user search operation interface for the user to navigate in the user search operation interface to select the 3D model of the spacecraft hardware device; Receive the user's model selection result and search conditions, and determine the aerospace engineering data search result from the aerospace engineering database and file system through the mapping relationship table and the model cascade relationship according to the model selection result and the search conditions, and determine the data visualization component corresponding to the aerospace engineering data search result from the data visualization component library; wherein the search condition is used to retrieve the aerospace engineering data of the spacecraft hardware equipment model and the lower-level spacecraft hardware equipment model corresponding to the model selection result; map the aerospace engineering data search result to the data visualization component corresponding to the aerospace engineering data search result to generate and display the aerospace engineering data search result.

8. An electronic device, characterized in that: include: A memory and one or more processors; the memory is coupled to the processor; wherein the memory stores computer program code, the computer program code includes computer instructions, and when the computer instructions are executed by the processor, the electronic device executes the method as claimed in claim 7.

9. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in claim 7.

Images