System and method for data processing and visualization of aircraft

Abstract

The invention discloses a system and a method for data processing and visualization of an aircraft. The system comprises a video acquisition device used for acquiring video data; a sensor device for acquiring sensor data; the data processing equipment is used for analyzing data, and the data comprises aircraft bus data, video data and sensor data; the monitoring terminal equipment is used for monitoring, analyzing and visually displaying the analyzed data; wherein the system performs structured storage of the parsed data and generates a persistent file to provide a specified service associated with the parsed data. Other aspects are also disclosed.

Description

Technical Field

[0001] This invention relates to the field of avionics testing technology, and more particularly to systems and methods for data processing and visualization of aircraft. Background Technology

[0002] During the development phase of aircraft, especially civil aircraft, real-time monitoring of flight test data relies on distributed airborne test systems, which require the installation of numerous specialized devices on the aircraft. However, once mass production flight testing begins, on the one hand, aircraft configuration and airworthiness limitations prevent the installation of traditional test systems, resulting in a lack of real-time data monitoring and storage methods during flight. Flight test results rely on manual recording, and data must be retrieved from external devices post-flight, leading to analysis delays. On the other hand, existing airborne test systems are only suitable for the development phase, and aircraft avionics bus analyzers lack real-time visualization capabilities. Furthermore, the Electronic Flight Bag (EFB) only supports basic flight data and cannot process flight test-level bus data.

[0003] This application proposes a system and method for aircraft data processing and visualization, which can provide a variety of flight test data application services and has advantages such as portability, wireless capability, and high scalability. Summary of the Invention

[0004] The following provides a brief overview of one or more aspects to offer a basic understanding of them. This overview is not an exhaustive summary of all conceived aspects, nor is it intended to identify the key or decisive elements of all aspects, nor to define the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed descriptions that follow.

[0005] To address the aforementioned problems, various aspects of this application propose a system and method for aircraft data processing and visualization.

[0006] In one aspect, a system for data processing and visualization of an aircraft is disclosed, characterized by comprising: a video acquisition device for acquiring video data; a sensor device for acquiring sensor data; a data processing device for parsing data, the data including aircraft bus data, the video data, and the sensor data; and a monitoring terminal device for monitoring, analyzing, and visualizing the parsed data; wherein the system performs structured storage of the parsed data and generates persistent files to provide specified services associated with the parsed data.

[0007] Preferably, the data processing device includes: a host computer integrating at least four independent gigabit network adapters, at least one serial communication interface, and at least one wireless network module for communication with the sensor device, the video acquisition device, the monitoring terminal device, and the aircraft bus; and a battery pack including at least two batteries to ensure uninterrupted power supply during flight.

[0008] Preferably, configuring the data processing device includes: generating a configuration project file based at least in part on the Interface Control Document (ICD), the Add-on Parameter Format Definition File (DFI), and the data processing requirements list; and loading the configuration project file.

[0009] Preferably, the real-time parsing of the data by the data processing device includes: performing millisecond-level synchronization of the data through the BeiDou timing module of the data processing device; performing time alignment processing on the parameters obtained from parsing the data in parallel using multi-threading technology; and writing the time-aligned data into the database in real time.

[0010] Preferably, the database is a time-series database (IoTDB) and the persistent file is a TsFile format file.

[0011] Preferably, generating the persistent file includes: outputting the TsFile format file through the IoTDB; or directly generating the TsFile format file through the TsFile-SDK.

[0012] Preferably, the designated service for the data includes at least one of the following: real-time data subscription or push service; historical data query service; algorithm management service; B-end data interface service and / or client data forwarding service.

[0013] Preferably, the real-time data subscription or push service is performed by one of the following: performing real-time polling requests and pushes of the required data through the data request API provided by IoTDB; or generating a message queue from the parsed data and establishing real-time communication with the user's browser through WebSocket to perform real-time subscription or push of the message queue.

[0014] Preferably, the algorithm management service is executed through the algorithm management module of the system and supports: calling pre-compiled algorithm libraries; or dynamically configuring algorithm functions through the algorithm editing interface.

[0015] Preferably, the video acquisition device acquires and persistently stores video via the RTMP protocol API, wherein the preview of the video is performed by at least one of the following: converting the RTSP stream to an RTMP stream in real time for playback by a browser; or directly opening the stored video file through a player.

[0016] Preferably, the system supports event alarm rule configuration and provides visual alarms through status light color changes, audio prompts, or information displays.

[0017] On another front, a method for data processing and visualization of an aircraft is disclosed, characterized by comprising: acquiring video data and sensor data; parsing the data, the data including aircraft bus data, the video data, and the sensor data; monitoring, analyzing, and visualizing the parsed data; and performing structured storage of the parsed data and generating persistent files to provide specified services associated with the parsed data.

[0018] Preferably, the method further includes pre-configuration before parsing the data, including: generating a configuration project file based at least in part on the Interface Control Document (ICD), the Add-on Parameter Format Definition File (DFI), and the data processing requirements list; and loading the configuration project file.

[0019] Preferably, the parsing of the data includes: performing millisecond-level synchronization of the data through the BeiDou timing module of the data processing device; performing time alignment processing on the parameters obtained from parsing the data in parallel using multi-threading technology; and writing the time-aligned data into the database in real time.

[0020] In another aspect, a non-transient computer-readable storage medium is disclosed that stores instructions, which, when executed by a computer, cause the computer to perform the above-described methods for data processing and visualization of an aircraft.

[0021] This synopsis is provided to introduce some concepts in a simplified form, which will be further described in the detailed description below. This synopsis is not intended to identify key or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter. Other aspects, features, and / or advantages of the embodiments will be set forth in part in the description which follows, and will be apparent in part from the description, or may be learned by practice of this disclosure. Attached Figure Description

[0022] To gain a detailed understanding of the manner in which the above-described features of the invention are employed, a more specific description of the above-briefly summarized content can be provided with reference to various embodiments, some of which are illustrated in the accompanying drawings. However, it should be noted that the drawings only illustrate certain typical aspects of the invention and should not be considered as limiting its scope, as this description may allow for other equivalent aspects. In the drawings, similar reference numerals are consistently used for similar purposes. It should be noted that the described drawings are merely schematic and non-limiting. In the drawings, the dimensions of some components may be enlarged and are not drawn to scale for illustrative purposes.

[0023] Figure 1 An example of a structural schematic diagram of a system for data processing and visualization of an aircraft according to an embodiment of the present invention is provided.

[0024] Figure 2 An example of a data flow diagram for aircraft data processing and visualization according to an embodiment of the present invention is explained.

[0025] Figure 3 A block diagram illustrating a method for supporting data processing and visualization for aircraft according to an embodiment of the present invention is provided. Detailed Implementation

[0026] To make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail below with reference to specific embodiments and the accompanying drawings. In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the described exemplary embodiments. However, it will be apparent to those skilled in the art that the described embodiments can be practiced without some or all of these specific details. In other exemplary embodiments, well-known structures or processing steps have not been described in detail to avoid unnecessarily obscuring the concepts of this disclosure.

[0027] In this specification, unless otherwise stated, the term "A or B" as used herein refers to "A and B" and "A or B", and does not imply that A and B are exclusive.

[0028] During the development phase of aircraft, especially civil aircraft, real-time monitoring of flight test data relies on distributed airborne test systems, which require the installation of numerous specialized devices on the aircraft. However, once mass production flight testing begins, on the one hand, aircraft configuration and airworthiness limitations prevent the installation of traditional test systems, resulting in a lack of real-time data monitoring and storage methods during flight. Flight test results rely on manual recording, and data must be retrieved from external devices post-flight, leading to analysis delays. On the other hand, existing airborne test systems are only suitable for the development phase, and aircraft avionics bus analyzers lack real-time visualization capabilities. Furthermore, the Electronic Flight Bag (EFB) only supports basic flight data and cannot process flight test-level bus data.

[0029] Therefore, there is an urgent need for a system for processing bus data during civil aircraft flight tests. This system should be able to collect, parse, and store general flight or test data (including ARINC664 bus data, video data, sensor data, etc.) during the flight process of civil aircraft outside the development and design phases (such as batch production flight tests, delivery flight tests, and line operation), through data processing equipment, video acquisition equipment, sensor equipment, etc., providing data subscription and query services, and enabling the development of client applications such as data monitoring and data analysis based on the equipment platform, or providing data interfaces for application development, through monitoring equipment. The following will combine... Figures 1 to 3 Explanation of various aspects of the present invention.

[0030] Figure 1 An example of a structural schematic diagram of a system 100 for aircraft data processing and visualization according to an embodiment of the present invention is provided.

[0031] In the embodiments of this application, such as Figure 1 As shown, the system 100 for aircraft data processing and visualization may include: a data processing device 105, a video acquisition device 110, a sensor device 115, and a monitoring terminal device 120. Preferably, the aircraft data processing and visualization can be performed in real time on board, thereby providing diverse data services, including real-time monitoring to assist in mass production test flights, data analysis, event alarms, real-time data querying, video storage, and providing interfaces for the development of subsequent data application expansion. In the embodiments of this application, the data processing device 105 may be referred to as a mass production test flight real-time data processing device, which is used to provide underlying functions and data service functions to B-end and client data users. In the embodiments of this application, the video acquisition device 110 may be referred to as a mobile video acquisition device, which is used for B-end users and client users to perform data monitoring, data analysis, and other data applications. In the embodiments of this application, the sensor device 115 may be referred to as an added sensor device or a sensing and measurement device, or it may be an onboard sensor used for the acquisition of different types of sensing and measurement data. In the embodiments of this application, the monitoring terminal device 120 may be a fixed terminal device, a mobile terminal device, a mobile monitoring terminal, etc., which is used for on-board video acquisition.

[0032] In the embodiments of this application, system 100 can perform the functions of acquiring, parsing, and storing aircraft avionics full-duplex switched Ethernet AFDX (ARINC 664) bus data, serial port data, and video data (e.g., wireless video data, wired video data), while providing related data analysis, monitoring, forwarding, and other applications and services. Preferably, system 100 can perform structured storage of video data acquired by video acquisition devices, sensor data acquired by sensor devices, and aircraft bus data, etc., and generate persistent files to provide specified services associated with these data.

[0033] In embodiments of this application, the data processing device 105 includes a host computer and a battery pack. Preferably, the host computer can be a general-purpose ruggedized portable PC host with an x86 architecture, integrating at least four independent network adapters, at least one serial communication interface, and at least one wireless network transmitter module for communication with sensor devices, video acquisition devices, monitoring terminal devices, and aircraft buses. Preferably, the data processing device adopts a dual-battery redundant power supply design. For example, the data processing device may include a battery pack comprising at least two batteries to ensure uninterrupted power supply during flight. It should be understood that the data processing device 105 may also include other interfaces, or other numbers of network adapters, serial interfaces, or transmitter modules.

[0034] In the embodiments of this application, such as Figure 1 As shown, the data processing device 105 connects to the Flight Test Interface (FTI) interface of the aircraft via four dedicated connection cables to four independent gigabit network adapters of the data processing device, acquiring four channels of native network data from the aircraft's ARINC664 bus. Alternatively, the data processing device 105 can also use a universal serial data interface to acquire serial data from sensor-equipped tests via a serial data connection cable to the data processing device 105. Alternatively, the data processing device 105 can also acquire wireless network connections to video acquisition devices and mobile monitoring terminals via a wireless access point generated by its wireless network adapter, and acquire network video streams by calling the wireless mobile device application programming interface (API). Preferably, data can also be forwarded to clients via the wireless network connection.

[0035] In the embodiments of this application, the aforementioned data is parsed by the BeiDou timing board of the data processing device 105 to obtain millisecond-level synchronization of engineering quantity data. The engineering quantity data can be a "physical quantity" directly usable for engineering analysis, obtained from raw bus data messages or raw sensor data streams after parsing, scaling, unit conversion, and offset correction; for example, velocity, temperature, etc. For instance, after time alignment, the engineering quantity data is written to a time-series database in real time to complete structured data storage and generates a TsFile format file for data persistence, thereby providing specified services associated with the data. For example, data services may include real-time engineering quantity data subscription and push services, historical data queries, algorithm management services, B-end data interface services, and client data forwarding services.

[0036] In the embodiments of this application, the method for providing underlying functions to B-end and client data users by the data processing device 105 includes: configuring the data processing device to process real-time data of the aircraft bus and added parameters. It can collect and parse real-time data by receiving the aircraft integrated avionics bus network interface, the added sensor data interface and the video acquisition device interface, and realize the structured and persistent database storage of the aircraft test flight engineering data to record the video files / data collected on the aircraft.

[0037] In the embodiments of this application, the configuration of the data processing device 105 includes: reading the integrated display data interface definition file (ICD), the addition parameter format definition file (DFI), and the data processing requirement list as configuration input files for requirement data parsing, generating a system engineering configuration file (XML) based on the input files, and subsequently loading the system engineering configuration file.

[0038] In the embodiments of this application, the data visualization service establishes a server (S-side) data interface service to implement a browser / server (B / S) architecture monitoring data subscription and publishing mechanism. Additionally or alternatively, the data terminal applications on the monitoring terminal device 120 may include real-time data monitoring, test flight assistance judgment, and historical data analysis of event alarms, as described in more detail below.

[0039] Figure 2 An example of a data flow diagram for aircraft data processing and visualization according to an embodiment of the present invention is explained.

[0040] In embodiments of this application, data processing devices (e.g., data processing device 105 as shown in 1) can be pre-configured. Figure 2As shown, the parameter identifiers and sampling frequencies related to data processing can be obtained by reading the parameter requirement list. Alternatively, the configuration information required for the required parameter data processing can be obtained by reading the parameter name, message, bit position, resolution, and data type from the ARINC664 interface control document (ICD). Alternatively, the data format definition file of the added sensor can be read to obtain information including data format, control port, baud rate, data bits, stop bits, and checksum.

[0041] In embodiments of this application, configuration project files can be generated at least in part based on the Interface Control Document (ICD), the Mounting Parameter Format Definition File (DFI), and the data processing requirements list. For example, a configuration project file for data processing generated based on the above information can be read and loaded. Additionally or alternatively, aircraft bus data (e.g., native 664 network data) can be filtered and entered into a data parsing process based on the configuration project file. Additionally or alternatively, a real-time serial data parsing process can also be performed, storing all project data in memory in the form of a two-dimensional array pointer.

[0042] In the embodiments of this application, such as Figure 2 As shown, while performing real-time data parsing during the project, the input and real-time storage of engineering data such as aircraft bus data, serial data, sensor data, and video data can be completed simultaneously. For example, bus network data can come from the integrated avionics network. Preferably, aircraft bus data can be stored in real time, for example, using the lossless network packet capture next generation (pcapng) format to store raw data. Alternatively or additionally, serial data can also be stored, for example, using the .dat format file. Alternatively or additionally, the engineering data cached in memory can be written to a real-time time-series database (IoTDB) to perform structured storage of the engineering data and generate a TsFile format time-series data file to achieve persistence of the engineering data. In the embodiments of this application, the implementation of generating TsFile format files may include: using the built-in function of the IoTDB time-series database to continuously output TsFiles, and / or directly generating TsFile format files using TsFile-SKD.

[0043] In the embodiments of this application, the BeiDou time synchronization module of the data processing device performs millisecond (ms)-level synchronization on the parsed engineering quantity data. Multi-threading technology is used to perform time alignment processing on the parameters obtained from the parsed data in parallel. Finally, the data interface is called to write the time-aligned data into the time-series database. Preferably, the engineering quantity data uses a specified time zone by default, such as UTC+8. It should be understood that other time zones can also be used without exceeding the scope of this application.

[0044] In the embodiments of this application, secondary calculations of engineering quantity data are performed by calling calculation methods in a pre-loaded algorithm library, and calculation parameters are formed in memory. All secondary calculation parameters are formed into a message queue according to a set order. For example, the secondary calculation can be based on data measured by sensors or parameters obtained from the bus to calculate the aircraft's average altitude, angle of attack, etc. In the embodiments of this application, according to the client's data application requirements, the engineering quantity data processed by the preceding steps in memory and the secondary calculation parameters are combined on demand by the network application layer according to an agreed format and forwarded via broadcast, multicast, or TCP based on a reliable connection. The real-time forwarding requirement is executed based on the number of preceding forwarding parameter rules configured, supporting the requirement of multi-path parallel forwarding. Additionally or alternatively, parameter forwarding rules can also be configured, supporting loading a file list or manually retrieving and selecting a parameter forwarding list, setting its forwarding target, frequency, application layer protocol, and other rules to realize the real-time forwarding requirements of parameter groups required by internal and external services.

[0045] In the embodiments of this application, one implementation of data subscription and push can be to execute real-time polling requests and pushes of required topic data through the data request API provided by IoTDB. Additionally or alternatively, another implementation of data subscription and push can be to directly generate a message queue from parsed data in memory and establish a WebSocket communication mechanism with the user's browser to execute real-time subscription and push of the message queue.

[0046] In the embodiments of this application, the data history query service is a function that obtains the complete set of target data under a history (e.g., a time period). For example, the data history query module can provide a standardized query interface that supports parallel scheduling of multiple external requesters and can synchronously respond to requests for no less than 15 history queries. Additionally or alternatively, in the data history query module interface, or based on the history conditions input externally (mainly the time range, with no limit on the allowed time range, basically covering the entire test flight cycle, and the total continuous time length can exceed 6 hours), the time history curve of the required data is finally displayed.

[0047] In the embodiments of this application, one implementation of algorithm management can be the establishment of an algorithm library, for example, a method library (e.g., DLL, etc.) created using the C# language, which can be called during the configuration of calculation parameters. Alternatively or additionally, another implementation of algorithm management can be the dynamic editing of the algorithm's name, function name, algorithm content, and input / output parameters according to actual needs through an algorithm editing interface. Preferably, when inputting, the method name and the number and type of input / output parameters must be consistent with the algorithm content. Preferably, when adding dynamic parameters, the user needs to input information such as parameter name, calculation method, parameter algorithm, formula expression, and associated parameters. Preferably, the calculation method can be an algorithm function or a dynamic formula. Preferably, when selecting an algorithm function, the relevant parameter algorithm needs to be configured. Preferably, when selecting a dynamic formula, the formula expression needs to be entered. In the embodiments of this application, the corresponding associated parameters are selected according to the algorithm or formula expression.

[0048] In the embodiments of this application, real-time data monitoring adopts a browser / server (B / S) architecture, which can be achieved through secondary development of reusable interface units (e.g., Grafana component modules) based on the open-source visualization framework Grafana. For example, numerical boxes, curve boxes, status lights, dials, sliders, and customized components specifically for flight testing can be developed. Preferably, by calling components, the layout of components within the canvas, text layout, background color style of the monitoring screen, etc., can be set to form the compilation and release of batch flight testing monitoring screens.

[0049] In the embodiments of this application, various alarm events, auxiliary monitoring rules or logic are loaded and managed through algorithm management and algorithm loading, and the rules are triggered in real time based on the corresponding parameter data for judgment. The judgment method is to apply various pre-set and loaded rules or logic calculation methods. For events that are judged to be alarms, they are visualized through the corresponding monitoring screen and the alarm display method is set, including color changes of status lights or digital color changes, alarm information display or audio prompts, etc.

[0050] In the embodiments of this application, one implementation of data analysis applications based on data query services can be to request and query the calculation parameters of the already formed analysis results in the data analysis module, and display the time history curve of the data analysis results. Another implementation can be to execute the analysis results of the queried data by loading a dynamic algorithm method. Yet another implementation can be to output the analysis results of the queried data using the analysis tools provided by this module. The tool functions include: data overlay, data scaling, data truncation, and feature value recognition.

[0051] In embodiments of this application, the video acquisition device accesses the wireless network provided by the data processing device and provides an API for acquiring Real-Time Message Transfer Protocol (RTMP) streams. Alternatively, the data processing device can pre-configure the video request URL and other configuration information of the video acquisition device, and write the configuration information to a MySQL database. Alternatively, the device can complete video stream requests based on the configuration information and perform functions such as real-time data stream acquisition, transcoding, storage, and management, performing video data acquisition and storage; the storage format can be MP4.

[0052] In the embodiments of this application, one implementation of video preview can be to directly access the requested video data stream through a monitoring page and display the video image of the airborne surveillance video. Preferably, if the accessed video data stream is a Real-time Streaming Protocol (RTSP) stream by default, then a method is provided to convert the RTSP stream into an RTMP stream that is supported by the browser for online playback in real time. Additionally or alternatively, another implementation of video preview can be to preview and watch stored video clip files by directly opening local files or downloading video files using a player.

[0053] Figure 3 A block diagram illustrating a method for supporting data processing and visualization for aircraft according to an embodiment of the present invention is provided.

[0054] like Figure 3 As shown, method 300 includes: in step 310, acquiring video data and sensor data. For example, as referenced... Figure 1-2 As described, video capture devices can acquire video data; sensor devices can acquire sensor data.

[0055] Furthermore, method 300 includes: in step 320, parsing data, including aircraft bus data, video data, and sensor data. For example, a data processing device can be used to parse the data, and the parsing includes: performing millisecond-level synchronization of the data using the BeiDou timing module of the data processing device; performing time alignment processing on the parameters obtained from the parsed data in parallel using multi-threading technology; and writing the time-aligned data into a database in real time, as shown in the reference... Figure 1-2 As described. Preferably, the data processing device is pre-configured before parsing the data, including: generating a configuration project file based at least in part on the Interface Control Document (ICD), the Add-on Parameter Format Definition File (DFI), and the data processing requirements list; and loading the configuration project file. Preferably, the database is a time-series database (IoTDB) and the persistent file is a TsFile format file. Preferably, generating the persistent file includes: outputting a TsFile format file through the IoTDB; or directly generating a TsFile format file.

[0056] Furthermore, method 300 includes: in step 330, monitoring, analyzing, and visualizing the parsed data. (See reference...) Figure 1-2 As described, the video capture device provides an API for Real-Time Message Transport Protocol (RTMP) streams, wherein the visualization includes at least one of the following: converting Real-Time Streaming Protocol (RTSP) streams into RTMP streams in real time for playback by a browser; or directly opening a stored video file through a player. Preferably, the monitoring terminal device supports configuring alarm rules for specified events, and the visualization includes: visually alarming specified events through changes in the color of status lights, audio prompts, or information prompts displayed on the monitoring terminal device.

[0057] Furthermore, method 300 includes: in step 340, performing structured storage of the parsed data and generating a persistent file to provide a specified service associated with the parsed data. (See reference...) Figure 1-2 The described specified services associated with the parsed data include at least one of the following: a subscription or push service for specified data within the data; a historical data query service; an algorithm management service; a B-end data interface service; and / or a client-side data forwarding service. Preferably, the subscription or push service for specified data is performed through one of the following: executing real-time polling requests and pushes for specified data via the data request application programming interface (API) provided by IoTDB; or generating a message queue from the parsed data and establishing real-time communication with the user's browser via WebSocket to execute real-time subscription or push of the message queue. Preferably, the algorithm management service is performed through the system's algorithm management module and includes: calling a pre-compiled algorithm library; or dynamically configuring algorithm functions through an algorithm editing interface.

[0058] Furthermore, embodiments of this application also disclose a computer-readable storage medium including computer-executable instructions stored thereon, which, when executed by a processor, cause the processor to perform the methods of the embodiments herein.

[0059] Furthermore, embodiments of this application also disclose an apparatus including a processor and a memory storing computer-executable instructions, which, when executed by the processor, cause the processor to perform the methods of the embodiments herein.

[0060] Furthermore, embodiments of this application also disclose an apparatus for aircraft data processing and visualization, the apparatus including means for performing the methods of the various embodiments herein.

[0061] The above describes a system and method for aircraft data processing and visualization according to the present invention. Compared with the prior art, the method of the present invention has at least the following advantages:

[0062] (1) Provide integrated and diverse data services, including real-time monitoring, data analysis, event alarm, real-time data query, and video storage to assist in batch production test flights, and provide interfaces for the development of subsequent data application expansion;

[0063] (2) Multi-source data fusion, through BeiDou time synchronization and multi-threaded processing, achieves accurate alignment of bus data, sensor data and video data;

[0064] (3) Structured and persistent storage, using a storage architecture that uses IoTDB for real-time processing and TsFile for persistence;

[0065] (4) A scalable service framework with fast response speed; the interface supports parallel scheduling of multiple external requesters and can synchronously respond to requests for no less than 15 process queries; and

[0066] (5) Portable hardware architecture solves the problem of not being able to load traditional systems during mass production and test flights.

[0067] Throughout this specification, reference has been made to "embodiments," meaning that a particular described feature, structure, or characteristic is included in at least one embodiment. Therefore, the use of these phrases may refer to more than one embodiment. Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0068] The various steps and modules of the methods and apparatus described above can be implemented in hardware, software, or a combination thereof. If implemented in hardware, the various illustrative steps, modules, and circuits described in connection with this disclosure can be implemented or executed using a general-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic components, hardware components, or any combination thereof. A general-purpose processor can be a processor, microprocessor, controller, microcontroller, or state machine, etc. If implemented in software, the various illustrative steps and modules described in connection with this disclosure can be stored as one or more instructions or codes on a computer-readable medium or transmitted. Software modules implementing the various operations of this disclosure can reside in a storage medium, such as RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, removable disk, CD-ROM, cloud storage, etc. The storage medium can be coupled to a processor so that the processor can read and write information from / to the storage medium and execute corresponding program modules to implement the various steps of this disclosure. Moreover, software-based embodiments can be uploaded, downloaded, or remotely accessed through appropriate communication means. Such appropriate means of communication include, for example, the Internet, the World Wide Web, intranets, software applications, cables (including fiber optic cables), magnetic communication, electromagnetic communication (including RF microwave and infrared communication), electronic communication, or other such means of communication.

[0069] The numerical values ​​given in the various embodiments are merely examples and are not intended to limit the scope of the invention. Furthermore, as a whole, there are other components or steps not listed in the claims or specification of this invention. Moreover, a single name for a component does not preclude other names for that component.

[0070] It should also be noted that these embodiments may be described as processes depicted as flowcharts, flow diagrams, structure diagrams, or block diagrams. Although a flowchart may describe the operations as a sequential process, many of these operations can be executed in parallel or concurrently. Furthermore, the order of these operations can be rearranged.

[0071] The disclosed methods, apparatuses, and systems should not be limited in any way. Rather, this disclosure covers all novel and non-obvious features and aspects of the various disclosed embodiments (individually and in various combinations and sub-combinations of each other). The disclosed methods, apparatuses, and systems are not limited to any particular aspect or feature or combination thereof, and no disclosed embodiment is required to have any one or more specific advantages or to solve any particular or all technical problems.

[0072] This invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other modifications based on the teachings of this invention without departing from the spirit and scope of the claims. All of these modifications are within the scope of protection of this invention.

[0073] Those skilled in the art will recognize that these embodiments can be practiced without one or more specific details or using other methods, resources, materials, etc. In other cases, well-known structures, resources, or operations are not shown or described in detail merely for the purpose of observing obscure aspects of the embodiments.

[0074] While embodiments and applications have been described and illustrated, it should be understood that the embodiments are not limited to the precise configurations and resources described above. Various modifications, substitutions, and improvements that will be apparent to those skilled in the art may be made in the arrangement, operation, and details of the methods and systems disclosed herein without departing from the scope of the claimed embodiments.

[0075] As used herein, the terms “and,” “or,” and “and / or” may include a variety of meanings, which are also contemplated, at least in part, depending on the context in which such terms are used. Generally, “or,” when used to relate a list such as A, B, or C, is intended to mean A, B, and C (in the inclusive sense) and A, B, or C (in the exclusive sense). Additionally, the term “one or more” as used herein may be used to describe any feature, structure, or property in its singular form, or to describe multiple features, structures, or characteristics, or some other combination thereof. However, it should be noted that this is merely an illustrative example, and the claimed subject matter is not limited to this example.

[0076] While the features currently considered exemplary have been explained and described, those skilled in the art will understand that various other modifications can be made and equivalents can be substituted without departing from the claimed subject matter. Additionally, numerous modifications can be made to adapt a particular scenario to the teachings of the claimed subject matter without departing from the central concepts described herein.

Claims

1. A system for data processing and visualization for an aircraft, characterized in that, The system comprises: a video acquisition device for acquiring video data; a sensor device for acquiring sensor data; a data processing device for parsing data, the data comprising aircraft bus data, the video data and the sensor data; and a monitoring terminal device for monitoring, analyzing and visually displaying the parsed data; wherein the system performs structured storage of the parsed data and generates a persistence file to provide specified services associated with the parsed data.

2. The system of claim 1, wherein, The data processing device comprises: a host computer integrating at least four independent gigabit network adapters, at least one serial communication interface, and at least one wireless network module for communication with the sensor device, the video acquisition device, the monitoring terminal device and the aircraft bus; and a battery pack comprising at least two batteries.

3. The system of claim 1, wherein, The configuration of the data processing device comprises: generating a configuration engineering file based at least in part on an interface control document, a retrofit parameter format definition file, and a data processing requirement list; and loading the configuration engineering file.

4. The system of claim 1, wherein, The data processing device is further configured to parse the data in real time, comprising: performing millisecond-level synchronization on the data by a Beidou timing module of the data processing device; performing time alignment processing on the engineering quantity parameters obtained by parsing the data in parallel using a multi-threading technique; writing the time-aligned engineering quantity parameters into a database in real time.

5. The system of claim 4, wherein: the database is an IoTDB (Internet of Things Database) and the persistence file is a TsFile format file.

6. The system of claim 5, wherein, Generating the persistence file comprises: outputting the TsFile format file through the IoTDB; or directly generating the TsFile format file.

7. The system of claim 1, wherein, The specified services for the data comprise at least one of: a subscription or push service for specified data in the data; a historical data query service; an algorithm management service; a B-end data interface service; and / or a client data forwarding service.

8. The system of claim 7, wherein, The subscription or push service for the specified data is performed by one of: sending real-time polling requests and push for the specified data to the monitoring terminal device through a data request application programming interface (API) provided by the IoTDB; or generating a parsed data message queue and establishing real-time communication with a browser of the monitoring terminal device to perform real-time subscription or push of the message queue.

9. The system of claim 7, wherein, The algorithm management service is performed by an algorithm management module of the system and comprises: calling a pre-compiled algorithm library; or dynamically configuring an algorithm function through an algorithm editing interface.

10. The system of claim 1, wherein, The video acquisition device provides an API for acquiring real-time message transmission protocol (RTMP) streams, wherein the visual display comprises at least one of: real-time conversion of a real-time streaming protocol (RTSP) stream to an RTMP stream for browser playback; directly opening a stored video file through a player.

11. The system of claim 1, wherein the monitoring terminal device supports an alarm rule configured to specify an event, and the visual display comprises: Visual alarm of the specified event is performed through color change of a status light, audio prompt or information prompt displayed on the monitoring terminal device.

12. A method for data processing and visualization for an aircraft, characterized in that The system comprises: acquiring video data, sensor data; parsing data, the data including airplane bus data, the video data, and the sensor data; monitoring, analyzing, and visualizing the parsed data; and performing structured storage of the parsed data and generating a persistence file to provide specified services associated with the parsed data.

13. The method of claim 12, wherein, further comprising pre-configuration before parsing the data, including: generating a configuration engineering file based at least in part on an interface control document, a plug-in parameter format definition file, and a data processing requirement list; and loading the configuration engineering file.

14. The method of claim 12, wherein, the parsing of the data including: performing millisecond-level synchronization on the data by a Beidou timing module of the data processing device; performing time alignment processing on parameters obtained by parsing the data in parallel using a multi-threading technique; writing the time alignment processed data into a database in real time.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to perform the method for data processing and visualization of an airplane according to any one of claims 12 to 14.

Images