Airplane docking backtracking system, method and equipment and storage medium

Abstract

The invention discloses an aircraft docking backtracking system, method and device and a storage medium. Comprising a data acquisition module used for acquiring each access device, performing protocol conversion on each access device, acquiring device production data of each access device based on an edge node, and sending the device production data to a visualization module; and the visualization module is used for acquiring a digital model, preprocessing the digital model to generate a processed digital model, performing UV mapping on the processed digital model to generate a visualization model, performing skeleton binding according to the visualization model and the equipment production data to generate a skeleton motion model, and performing visualization display based on the skeleton motion model. And through the data acquisition module, acquisition and processing of equipment production data are realized, obstacles caused by data format differences are eliminated, and the data integration efficiency is improved. And comprehensive visual backtracking and analysis are carried out on the aircraft docking process through the visual module, so that the actual application requirements of the aircraft docking process are met.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of aircraft assembly, and in particular to an aircraft docking backtracking system, method, device and storage medium. BACKGROUND

[0002] With the rapid development of the aviation transportation industry, the operation efficiency and safety of the aircraft have become the focus of the industry. In the field of aircraft manufacturing and maintenance, aircraft docking is a key and complex link.

[0003] The application of virtual reality and augmented reality technology in aircraft assembly has a certain foundation, but the application of augmented reality technology in docking process backtracking in the environment of digital model is relatively rare. Therefore, it is very meaningful to apply augmented reality technology to docking process backtracking based on digital model data. The existing visualization system has single function and cannot meet the monitoring demand of multi-dimension and multi-angle, and it is difficult to comprehensively and deeply analyze the aircraft docking process. SUMMARY

[0004] The present application provides an aircraft docking backtracking system, method, device and storage medium to realize data-driven docking whole process simulation and accurate docking quality control, improve the consistency and docking efficiency of aircraft docking quality, and reduce the docking cost.

[0005] According to an aspect of the present application, an aircraft docking backtracking system is provided, which comprises a data acquisition module and a visualization module connected with the data acquisition module.

[0006] The data acquisition module is used for acquiring each access device, performing protocol conversion on each access device, and obtaining device production data of each access device based on an edge node, and sending the device production data to the visualization module.

[0007] The visualization module is used for acquiring a digital model, preprocessing the digital model to generate a processed digital model, performing UV mapping on the processed digital model to generate a visualization model, performing bone binding according to the visualization model and the device production data to generate a bone motion model, and performing visualization display based on the bone motion model.

[0008] Optionally, the data acquisition module specifically comprises: a device access unit, a protocol conversion unit and an edge node design unit; the device access unit is configured to determine the device types of the field devices, access the field devices based on the device types to generate the accessed devices, wherein the field device types comprise tooling automation devices and measurement devices; the protocol conversion unit is configured to obtain the original protocols of the accessed devices and convert the original protocols into standard Internet protocols; and the edge node design unit is configured to divide the edge nodes according to the stations and obtain the device production data of the accessed devices through the edge nodes of the stations.

[0009] Optionally, the visualization module specifically comprises: a digital model preprocessing unit, a digital model UV mapping unit, a skeleton binding unit and an interaction unit; the digital model preprocessing unit is configured to obtain the digital model, perform part culling and visual rendering on the digital model to generate a processed digital model; the digital model UV mapping unit is configured to determine the surface vertices corresponding to the processed digital model, map the surface vertices from a three-dimensional coordinate system to a UV plane coordinate system, obtain material information, transfer the material information to the UV plane coordinate system to generate a two-dimensional texture map, map the two-dimensional texture map to the three-dimensional model to generate a visual model; the skeleton binding unit is configured to drive the skeleton motion based on the device production data to determine skeleton motion data, and bind the visual model and the skeleton motion data to generate a skeleton motion model; and the interaction unit is configured to visually display the skeleton motion model.

[0010] Optionally, the system further comprises: a data management module connected with the data acquisition module; the data acquisition module is configured to send the device production data to the data management module; and the data management module is configured to perform edge-cloud collaborative management based on the device production data.

[0011] Optionally, the data management module specifically comprises: an edge-cloud collaborative unit configured to register the device production data through edge computing, develop an application through a cloud and make a container image.

[0012] Optionally, the data management module further comprises: a secondary development plug-in unit configured to obtain custom information based on a secondary development interface and develop data according to the custom information.

[0013] Optionally, the system further comprises: a data storage module connected with the data acquisition module; the data acquisition module is configured to send the device production data to the data storage module; and the data storage module is configured to select a time series database according to the device production data, determine a target database and store the device production data in the target database.

[0014] According to another aspect of the present application, a method for aircraft docking backtracking is provided, the method comprising:

[0015] Obtain each access device through the data acquisition module, perform protocol conversion on each access device, and obtain device production data of each access device based on the edge node, and send the device production data to the visualization module;

[0016] Obtain the digital model through the visualization module, pre-process the digital model to generate a processed digital model, perform UV mapping on the processed digital model to generate a visualization model, perform bone binding on the visualization model and the device production data to generate a bone motion model, and perform visualization display based on the bone motion model.

[0017] According to another aspect of the present application, an electronic device is provided, comprising:

[0018] at least one processor; and

[0019] a memory in communication with the at least one processor; wherein

[0020] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the aircraft docking backtracking method according to any one of the embodiments of the present application.

[0021] According to another aspect of the present application, a computer readable storage medium is provided, which stores computer instructions for enabling a processor to perform the aircraft docking backtracking method according to any one of the embodiments of the present application when executed.

[0022] The technical scheme of the embodiments of the present application realizes the acquisition and processing of device production data through the data acquisition module, eliminates the obstacles caused by data format differences, and improves the data integration efficiency. Based on the edge node, the device production data can be quickly acquired to ensure the real-time nature of the data and provide strong support for timely decision-making and monitoring. The digital model is pre-processed and UV mapped to generate a more realistic and clear visualization model, which improves the user's intuitive feeling of the aircraft docking situation. The visualization model is combined with the device production data through bone binding, so that the motion and changes of the model can accurately reflect the dynamics of the actual data, enhancing the accuracy and reliability of the visualization display. Through the comprehensive visualization backtracking and analysis of the aircraft docking process by the visualization module, the actual application requirements of the aircraft docking process are met.

[0023] It should be understood that the content described in this part is not intended to identify key or important features of the embodiments of the present application, nor is it used to limit the scope of the present application. Other features of the present application will become apparent through the following description. BRIEF DESCRIPTION OF DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiments description. Obviously, the drawings in the following description only show some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative effort based on these drawings.

[0025] Figure 1 is a structural schematic diagram of an aircraft docking backtracking system according to an embodiment of the present application;

[0026] Figure 2 is another structural schematic diagram of an aircraft docking backtracking system according to an embodiment of the present application;

[0027] Figure 3 is another structural schematic diagram of an aircraft docking backtracking system according to an embodiment of the present application;

[0028] Figure 4 is a flow chart of an aircraft docking backtracking method according to an embodiment of the present application;

[0029] Figure 5 is a structural schematic diagram of an electronic device for implementing an aircraft docking backtracking method according to an embodiment of the present application. DETAILED DESCRIPTION

[0030] In order to make the technical personnel in the art better understand the present application, the following will combine the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative effort should be within the scope of protection of the present application.

[0031] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not necessarily limit to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0032] Embodiment one

[0033] Figure 1 A structural diagram of an aircraft docking trace-back system is provided for Embodiment One of the present application. The system comprises: a data acquisition module 110, and a visualization module 120 connected to the data acquisition module 110.

[0034] Optionally, the data acquisition module 110 is configured to acquire various access devices, perform protocol conversion on the various access devices, and obtain device production data of the various access devices based on an edge node, and send the device production data to a data management module 140; the visualization module 120 is configured to obtain a digital model, pre-process the digital model to generate a processed digital model, perform UV mapping on the processed digital model to generate a visualized model, perform bone binding based on the visualized model and the device production data to generate a bone motion model, and perform visualized display based on the bone motion model.

[0035] The aircraft docking trace-back system refers to a system for processing aircraft docking related data and capable of tracing and analyzing past docking situations. The data acquisition module 110 is responsible for collecting and acquiring various data functional units, including information of access devices and data generated thereby. The access device refers to a hardware device connected to the system and capable of providing relevant data, such as sensors, instruments, etc. Different devices may use different communication protocols, and protocol conversion is the process of uniformly converting protocols of different formats and rules so that the data can be correctly understood and processed by the system. The device production data refers to original data generated by the access device, reflecting the running state, performance, and other related data of the device.

[0036] Specifically, the data acquisition module 110 acquires various access devices and performs protocol conversion on the various access devices to realize data communication and integration between different devices. Through protocol conversion, data from different devices and in different formats can be uniformly converted into a standard format that can be recognized and processed by the system. At the same time, the data acquisition module 110 obtains device production data of the various access devices based on an edge node. The edge node refers to a computing node close to the data source, capable of performing preliminary data processing and analysis near the source of data generation, reducing the delay and bandwidth pressure of data transmission. After obtaining the device production data, the data acquisition module 110 sends it to the data management module 140 to provide a basis for subsequent data analysis and management.

[0037] The digital model is a pre-created three-dimensional model representing the relevant equipment, production scene or other data-related objects. Preprocessing of the digital model is to optimize the structure and geometry of the model to make subsequent operations more efficient and accurate. UV mapping is to unfold the texture coordinates of the surface of the three-dimensional model to a two-dimensional plane, which can accurately paste images, materials and other textures to the model surface, making it look more realistic and rich. Skeletal binding is to add bones to the human model to control its movement, and the changes in equipment production data can drive the movement of the control points, thereby driving the dynamic changes of the entire model.

[0038] Finally, the visualization module 120 will visualize based on the generated skeletal motion model. The visualization module 120 can render the model in three-dimensional or two-dimensional form on the screen through graphics rendering technology, and will constantly update the state of the skeletal motion model according to the real-time update of the equipment production data, realizing dynamic and real-time visualization, so that users can intuitively understand the running state of the equipment, changes in the production process and other information.

[0039] Figure 2 A structural diagram of an aircraft docking backtracking system is provided for the first embodiment of the present application, Figure 2 The system further includes a data storage module 130 connected to the data acquisition module 110, which specifically includes a device access unit 111, a protocol conversion unit 112 and an edge node design unit 113, and the visualization module 120 specifically includes a digital model preprocessing unit 121, a digital model UV mapping unit 122, a skeletal binding unit 123 and an interaction unit 124.

[0040] Optionally, the data acquisition module 110 specifically includes a device access unit 111, a protocol conversion unit 112 and an edge node design unit 113; the device access unit 111 is used to determine the device type of the field device, and based on the device type, the device access unit 111 performs device access to generate each access device, wherein the field device type includes tool automation equipment and measurement equipment; the protocol conversion unit 112 is used to obtain the original protocol of each access device, and uses the standard Internet protocol to convert each original protocol; the edge node design unit 113 is used to divide each edge node according to the station, and obtains the equipment production data of each access device through the edge node of each station.

[0041] Among them, different types of field devices (such as tool automation equipment and measurement equipment) may have great differences in function, interface and data output mode. Therefore, the device access unit 111 will first determine the device type of the field device. The tool automation equipment is mainly composed of positioners, and is accessed through a general PLC controller. The general controller is already equipped with a digital I / O unit and a network communication unit, and data transmission is performed through an industrial Ethernet, completing data acquisition of the automation equipment itself and process data. The measurement equipment is mainly laser trackers, laser range finders and vision cameras, which are accessed through professional measurement software Spatial Analyzer, and then the measurement data is directly transmitted to the module that needs to use the data through the Spatial Analyzer software interface.

[0042] Specifically, the access device will use its own specific original protocol to transmit data, and the original protocol may differ in data format, frame structure, communication rate, etc., resulting in data that cannot be directly processed and transmitted uniformly in the system. The protocol conversion unit 112 will obtain the original protocol of each access device, and then convert the original protocol using a standard Internet protocol (such as the TCP / IP protocol). The protocol conversion unit 112 will parse the original protocol, extract the key information of the data (such as measurement values, status information, etc.), and then encapsulate and reorganize it according to the format of the standard Internet protocol.

[0043] Specifically, the work area and tasks will be divided according to the workstations in the aircraft docking work site. The edge node design unit 113 divides the edge nodes according to the workstations, and the workstation data acquisition module 110 is decoupled, with each workstation's data acquisition working independently. The data analysis algorithm suitable for each workstation is designed according to the data characteristics of each workstation, and the edge nodes of each workstation are combined to form an assembly line distributed server cluster, which can realize unified automation operation. In addition, when the assembly process is optimized or the assembly workstation is changed, the distributed cluster can achieve the effect of elastic expansion. The edge node can quickly respond to the data generated by the equipment and perform real-time data preprocessing such as data filtering and simple calculation. The distributed edge node design improves the data processing efficiency and real-time performance of the entire system, and can better meet the needs of industrial production for fast response and efficient data processing.

[0044] Optionally, the visualization module 120 specifically comprises a digital model preprocessing unit 121, a digital model UV mapping unit 122, a skeleton binding unit 123, and an interaction unit 124. The digital model preprocessing unit 121 is configured to obtain a digital model, perform part culling and visualization rendering on the digital model to generate a processed digital model. The digital model UV mapping unit 122 is configured to determine surface vertices corresponding to the processed digital model, map the surface vertices from a three-dimensional coordinate system to a UV plane coordinate system, obtain material information, and pass the material information to the UV plane coordinate system to generate a two-dimensional texture map, and map the two-dimensional texture map to the three-dimensional model to generate a visualization model. The skeleton binding unit 123 is configured to drive skeleton motion based on device production data to determine skeleton motion data, and perform skeleton binding on the visualization model and the skeleton motion data to generate a skeleton motion model. The interaction unit 124 is configured to visually display the skeleton motion model.

[0045] The digital model preprocessing unit 121 is responsible for obtaining the original digital model and performing part culling on the digital model. The part culling process can determine whether certain parts in the model are unnecessary in the current visualization requirements according to specific rules or conditions. For example, if only the main structure of the device is concerned and certain small parts are not concerned, these small parts can be removed to reduce the complexity of subsequent processing. Visualization rendering is the use of computer graphics principles to calculate and process light, color, material, and other aspects of the digital model. By calculating the reflection, refraction, and scattering of light on the model surface through the light model, the real lighting effect is simulated. The model is given material properties such as metal, plastic, glass, etc., making it visually closer to the real object. Through visualization rendering, a clearer, more realistic, and suitable digital model for subsequent processing can be generated.

[0046] Specifically, the digital model UV mapping unit 122 will first determine the surface vertices corresponding to the processed digital model. In three-dimensional computer graphics, the model surface is composed of numerous vertices, each with its coordinates in three-dimensional space. Then, these surface vertices are mapped from a three-dimensional coordinate system to a UV plane coordinate system. Meanwhile, material information is obtained, including images, colors, roughness, and other properties that describe the appearance of the object, and the material information is passed to the UV plane coordinate system to generate a two-dimensional texture map. Finally, the two-dimensional texture map is remapped to the three-dimensional model, making the model surface appear rich in detail and realistic in material effect, i.e., generating a visualization model.

[0047] Further, the skeleton binding unit 123 can associate the values or parameters in the device production data with the motion patterns of the skeleton, and then drive the skeleton motion. For example, a certain value in the device production data may represent the rotation angle of a joint, or a certain parameter may control the stretching degree of the skeleton. Then the visual model is bound with the skeleton motion data. When the skeleton moves, it can drive the corresponding deformation and motion of the model surface bound therewith, thereby generating a skeleton motion model.

[0048] Specifically, the main function of the interaction unit 124 is to display the skeleton motion model to the user in a visual form, and support the user to interact with the model. For example, the interaction unit 124 can use graphic display technology to present the three-dimensional shape, material, color and other information of the skeleton motion model on the computer screen. At the same time, the interaction unit 124 also supports the user to interact with the model, such as zooming, rotating, translating the model, selecting different viewing angles to view the model, etc.

[0049] Optionally, the system further comprises a data storage module 130 connected with the data acquisition module 110; the data acquisition module 110 is used to send the device production data to the data storage module 130; the data storage module 130 is used to select a time series database according to the device production data, to determine a target database, and to store the device production data to the target database.

[0050] Specifically, the selection of the time series database will consider the characteristics and needs of the device production data. During the selection process, various factors will be considered. For example, the writing speed of the data, the storage capacity of the data and the scalability of the database. The data storage module 130 will comprehensively evaluate the device production data to determine the target database most suitable for storing the data. During the storage process, the data will be organized and indexed according to the time sequence, so as to quickly query and analyze. For example, through the timestamp as the index, the data at a specific time point can be quickly located. At the same time, in order to improve the storage efficiency, compression algorithm may be used for compressed storage of the data, to reduce the occupation of the storage space. Through the data storage module 130, the device production data can be effectively managed and stored, to provide reliable data support for subsequent data analysis, processing and application.

[0051] The technical scheme of the embodiment of the application realizes acquisition and processing of equipment production data through the data acquisition module, eliminates the obstacles caused by data format differences, and improves data integration efficiency. Based on the edge node, the equipment production data can be quickly acquired to ensure the real-time performance of the data and provide strong support for timely decision-making and monitoring. The pre-processing and UV mapping of the digital model make the generated visual model more realistic and clear, and improve the intuitive feeling of the user on the aircraft docking situation. The visual model is combined with the equipment production data through the skeleton binding, so that the motion and change of the model can accurately reflect the dynamics of the actual data, and the accuracy and reliability of the visual display are enhanced. The visual module is used for comprehensive visual backtracking and analysis of the aircraft docking process, so as to meet the actual application requirements of the aircraft docking process.

[0052] Embodiment two

[0053] Figure 3 A structural schematic diagram of an aircraft docking backtracking system is provided for the embodiment one of the application, Figure 3 A data management module 140 is added on the basis of the embodiment one, and the data management module 140 includes an edge-cloud collaboration unit 141 and a secondary development plug-in unit 142.

[0054] Optionally, the system further includes a data management module 140 connected with the data acquisition module 110; the data acquisition module 110 is used for sending the equipment production data to the data management module 140; and the data management module 140 is used for performing edge-cloud collaborative management based on the equipment production data.

[0055] Specifically, the data management module 140 receives the equipment production data from the data acquisition module 110 and performs edge-cloud collaborative management based on the equipment production data. The edge-cloud collaborative management process fully combines the advantages of edge computing and cloud computing. On the edge side, tasks with high real-time requirements can be quickly processed, such as real-time monitoring and early warning of critical components of the aircraft. While in the cloud, a large amount of historical data can be deeply analyzed and mined, for example, the failure trend of the equipment can be predicted through a machine learning algorithm, and the maintenance plan of the aircraft can be optimized. The data management module 140 is also responsible for data interaction and collaborative work with the cloud, can upload key data on the edge side to the cloud, and receive analysis results and control instructions issued by the cloud, to realize efficient collaboration between the edge and the cloud, thereby improving the overall performance and reliability of the aircraft docking backtracking system, and providing strong support for the safe operation and maintenance of the aircraft.

[0056] Optionally, the data management module 140 specifically includes an edge-cloud collaboration unit 141, which is used for registering the equipment production data through edge computing, developing applications through the cloud, and making container images.

[0057] Specifically, the edge-cloud collaboration unit 141 first registers through edge computing, that is, the edge device creates a corresponding identifier and index for the device production data after obtaining the device production data, so as to quickly locate and access. During the registration process, the key features of the data are extracted and labeled, such as the identifier of the device, the generation time of the data, the data type, etc. In this way, when specific data needs to be queried or processed, the corresponding information can be quickly found. At the same time, the cloud develops applications and makes container images. The cloud has powerful computing and storage resources and can support complex application development and large-scale data processing. The developed applications can be based on the rich tools and environment of the cloud computing platform, using various programming languages and frameworks to build software applications that meet specific needs, such as data analysis tools, machine learning algorithms, visualization interfaces, etc., for in-depth mining and processing of device production data. Making container images means packaging and encapsulating the developed applications and their dependent environments. Container technology (such as Docker) can package the application program and all its dependencies (such as libraries, configuration files, etc.) into an independent, portable unit, i.e. a container image. By generating a container image, when deploying and running the application in different cloud computing environments, it can also ensure its consistency and reliability. By combining the fast response and local processing capability of edge computing with the powerful computing and resource advantages of the cloud, the edge-cloud collaboration unit 141 can achieve efficient management and utilization of device production data, providing strong support for production process optimization, fault prediction, etc.

[0058] Optionally, the data management module 140 further includes a secondary development plug-in unit 142 for obtaining custom information based on a secondary development interface and developing data according to the custom information.

[0059] Among them, the secondary development interface is an open interface provided to meet the specific needs of users and expand the functions of the system. The secondary development interface defines specifications and protocols, allowing external developers or users to interact with the system according to specific rules and methods.

[0060] Specifically, through the secondary development interface, the secondary development plug-in unit 142 can obtain custom information. Custom information can come from data input by users according to their own business logic and special requirements. Then the secondary development plug-in unit 142 will develop data according to the custom information to meet the individual data management and utilization needs of different users.

[0061] The technical scheme of the embodiment of the application registers device production data through edge computing, can quickly process and filter data at the edge close to the data source, reduces the computing burden of the cloud, and improves the overall data processing efficiency. The cloud develops applications and makes container images, which facilitates the rapid deployment and update of the applications and improves the adaptability and expansibility of the system. The secondary development interface enables the system to be customized for application in different industries and fields, thereby expanding the application range of the system.

[0062] Embodiment three

[0063] Figure 4 A flowchart of an aircraft docking backtracking method is provided for the third embodiment of the application, and the embodiment can be applied to the scenario of aircraft docking. As shown in Figure 4 , the method comprises the following steps:

[0064] S310, acquire each access device through the data acquisition module, perform protocol conversion on each access device, acquire device production data of each access device based on the edge node, and send the device production data to the visualization module.

[0065] Specifically, the data acquisition module acquires each access device and performs protocol conversion on each access device to realize data communication and integration between different devices. Through protocol conversion, data in different formats from different devices can be uniformly converted into a standard format that can be recognized and processed by the system. At the same time, the data acquisition module acquires device production data of each access device based on the edge node. The edge node refers to a computing node close to the data source, which can perform preliminary data processing and analysis near the source of data generation, thereby reducing the delay and bandwidth pressure of data transmission. After obtaining the device production data, the data acquisition module sends it to the data management module to provide a basis for subsequent data analysis and management.

[0066] S320, acquire a digital model through the visualization module, pre-process the digital model to generate a processed digital model, perform UV mapping on the processed digital model to generate a visualization model, perform bone binding on the visualization model and the device production data to generate a bone motion model, and perform visualization display based on the bone motion model.

[0067] The digital model is a pre-created three-dimensional model representing the relevant equipment, production scene or other data-related object. Pre-processing of the digital model is to optimize the structure and geometry of the model, so that subsequent operations are more efficient and accurate. UV mapping is to unfold the texture coordinates of the surface of the three-dimensional model to a two-dimensional plane, which can accurately paste images, materials and other textures to the model surface, making it look more realistic and rich. Skeleton binding is to add bones to the human model to control its movement, and the changes in equipment production data can drive the movement of control points, thereby driving the dynamic changes of the entire model.

[0068] Finally, the visualization module will visualize the generated skeletal motion model. The visualization module can render the model in three-dimensional or two-dimensional form on the screen through graphics rendering technology, and will constantly update the state of the skeletal motion model according to the real-time update of the equipment production data, achieving dynamic and real-time visualization, so that users can intuitively understand the running state of the equipment, changes in the production process and other information.

[0069] The technical scheme of the embodiment of the application realizes the acquisition and processing of equipment production data through the data acquisition module, eliminates the obstacles caused by data format differences, and improves the data integration efficiency. Based on the edge node, the equipment production data can be quickly acquired to ensure the real-time nature of the data and provide strong support for timely decision-making and monitoring. The pre-processing and UV mapping of the digital model make the generated visualization model more realistic and clear, improving the user's intuitive feeling of the aircraft docking situation. The combination of the visualization model and the equipment production data through skeleton binding enables the motion and changes of the model to accurately reflect the dynamics of the actual data, enhancing the accuracy and reliability of the visualization. Through the comprehensive visualization of the aircraft docking process by the visualization module, the actual application requirements of the aircraft docking process are met.

[0070] Embodiment four

[0071] Figure 5 A structural schematic diagram of an electronic device 10 that can be used to implement embodiments of the application is shown. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smartphones, wearable devices (e.g., headsets, glasses, watches, etc.), and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the application described and / or claimed in this document.

[0072] As Figure 5As shown, the electronic device 10 includes at least one processor 11, and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., communicatively connected to the at least one processor 11, where the memory stores a computer program executable by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or loaded into the random access memory (RAM) 13 from the storage unit 18. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0073] Various components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc., an output unit 17, such as various types of displays, a speaker, etc., a storage unit 18, such as a magnetic disk, an optical disk, etc., and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.

[0074] The processor 11 can be various general and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs various methods and processes described above, such as an aircraft docking backtracking method.

[0075] In some embodiments, an aircraft docking backtracking method can be implemented as a computer program tangibly embodied in a computer readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of an aircraft docking backtracking method described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured, by way of firmware or any other suitable means, to perform an aircraft docking backtracking method.

[0076] The various embodiments of the systems and techniques described above can be implemented in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a load programmable logic device (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0077] Computer programs used to implement the processes of the application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer program, when executed, can cause instructions defined in the flow charts and / or block diagrams to be implemented. The computer program can be executed entirely on a machine, partially on a machine, partially on a machine as a standalone software package and partially on a remote machine or entirely on a remote machine or server.

[0078] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store computer programs for use by or in connection with an instruction execution system, apparatus, or device. Computer-readable storage media can include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disk drives, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fibers, portable compact disc read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0079] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0080] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0081] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. A server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and VPS service.

[0082] It should be understood that the various forms of flow shown above can be re-ordered, added to, or deleted from without departing from the scope of the present disclosure. For example, the steps recited in the present disclosure can be executed in parallel, executed in sequence, or executed in a different order, as long as the desired results of the present disclosure are achieved, and the present disclosure is not limited herein.

[0083] The specific embodiments described above are not intended to be limiting, and persons skilled in the art will appreciate that various modifications, combinations, sub-combinations and alternatives can be made to the specific embodiments without departing from the spirit and principles of the disclosure. Accordingly, the disclosure is not limited to the specific embodiments described above, but only by the scope of the appended claims.

Claims

1. An aircraft docking backtracking system, characterized in that: include: A data acquisition module, and a visualization module connected to the data acquisition module; The data acquisition module is used to obtain each access device, perform protocol conversion on each access device, obtain device production data of each access device based on the edge node, and send the device production data to the visualization module; The visualization module is used to obtain a digital model, preprocess the digital model to generate a processed digital model, perform UV mapping on the processed digital model to generate a visualization model, perform skeleton binding based on the visualization model and the equipment production data to generate a skeleton motion model, and perform visualization based on the skeleton motion model.

2. The system according to claim 1, wherein: The data acquisition module specifically includes: a device access unit, a protocol conversion unit and an edge node design unit; The device access unit is configured to determine a device type of a field device, and perform device access on each field device based on the device type to generate each access device, wherein the field device type includes tool automation equipment and measurement equipment; The protocol conversion unit is used to obtain the original protocol of each data access device and perform protocol conversion on each of the original protocols using the standard Internet protocol; The edge node design unit is used to divide each edge node according to the workstation, and obtain the equipment production data of each access device through the edge node of each workstation.

3. The system according to claim 1, wherein: The visualization module specifically includes: a digital model pre-processing unit, a digital model UV mapping unit, a skeleton binding unit and an interaction unit; The digital model pre-processing unit is used to obtain a digital model, perform parts elimination and visual rendering on the digital model to generate a processed digital model; The digital model UV mapping unit is used to determine the surface vertices corresponding to the processed digital model, map the surface vertices from a three-dimensional coordinate system to a UV plane coordinate system, obtain material information, transfer the material information to the UV plane coordinate system to generate a two-dimensional map, and map the two-dimensional map to the three-dimensional model to generate the visual model; The skeleton binding unit is used to drive skeleton movement based on the device production data to determine skeleton movement data, and perform skeleton binding on the visualization model and the skeleton movement data to generate a skeleton movement model; The interactive unit is used to visualize the skeletal motion model.

4. The system according to claim 1, wherein: The system further comprises: a data management module connected to the data acquisition module; The data acquisition module is used to send the equipment production data to the data management module; The data management module is used to perform edge-cloud collaborative management based on the equipment production data.

5. The system according to claim 4, characterized in that The data management module specifically includes: an edge-cloud collaboration unit, which is used to register the device production data through edge computing, develop applications through the cloud, and create container images.

6. The system according to claim 5, characterized in that The data management module further includes: a secondary development plug-in unit, which is used to obtain custom information based on a secondary development interface and perform data development according to the custom information.

7. The system according to claim 1, wherein: The system further comprises: a data storage module connected to the data acquisition module; The data acquisition module is used to send the equipment production data to the data storage module; The data storage module is used to select a time series database based on the equipment production data to determine a target database, and store the equipment production data in the target database.

8. An aircraft docking backtracking method, characterized in that: The aircraft docking tracing system according to any one of claims 1 to 7 comprises: Acquire each access device through the data acquisition module, perform protocol conversion on each access device, obtain device production data of each access device based on the edge node, and send the device production data to the visualization module; A digital model is obtained through a visualization module, the digital model is preprocessed to generate a processed digital model, UV mapping is performed on the processed digital model to generate a visualization model, skeleton binding is performed according to the visualization model and the equipment production data to generate a skeleton motion model, and visualization is performed based on the skeleton motion model.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, wherein the computer program is executed by the at least one processor to enable the at least one processor to perform the method of claim 8 .

10. A computer storage medium, characterized in that The computer storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method described in claim 8 when the instructions are executed.

Images