Airworthiness certification data migration method and system

Abstract

The invention belongs to the technical field of civil aviation airworthiness, and discloses an airworthiness certification data migration method and system. The method comprises the following steps: extracting historical data from a historical system document type database to an intermediate database; historical data in the intermediate database is converted and cleaned, redundant records and fields are removed, and the format required by the target database is further fit; and loading the historical data into the target database from the intermediate data. According to the method and the system, the airworthiness certification historical data can be migrated at a relatively high speed and relatively high accuracy and convenience. According to the method, the workload of airworthiness certification historical data migration is greatly reduced, the migration quality of the airworthiness certification historical data is improved, emphasized processing is carried out on the change historical context of the airworthiness certificate in the data migration process, the utilization rate of the airworthiness certification historical data is improved, airworthiness certification work is conveniently carried out, and the data migration efficiency is improved. The efficiency of airworthiness certification is improved, and the working quality of airworthiness certification is improved.

Description

Technical Field

[0001] The present invention belongs to the field of civil aviation airworthiness technology, and in particular relates to an airworthiness certification data migration method and system. Background Art

[0002] Airworthiness refers to the sum of activities to ensure and maintain the airworthiness of civil aviation products, which runs through all activities throughout the entire life cycle of civil aviation products, from design, manufacturing, use, maintenance to retirement. The purpose of airworthiness certification is to ensure that civil aircraft maintain safety and physical integrity under the expected operating environment and operating conditions, always comply with their model design and are in a safe operating state.

[0003] The airworthiness certification process generates a massive amount of historical certificate data and process data, and there is currently a lack of effective means to collect and manage the above data. A large amount of historical data is stored in various relevant units, which not only poses a high risk of loss, but also creates a large storage pressure on the relevant units. More importantly, the lack of the above data will not only affect the continued development of the airworthiness certification work, therefore, it is urgent to structure the review materials of projects in various historical periods, disassemble the various projects according to the standardized structure, complete data collection, supplementary recording and analysis, and structure all historical certificate information to achieve the functions of archiving, statistics, changes, and visual display of historical certificates. However, in the existing technology, data processing still has the following problems: Inefficient data migration: In the current airworthiness certification process, data migration often relies on manual operations, which is not only time-consuming and labor-intensive, but also prone to errors. The lack of efficient and automated data migration tools leads to inefficiency in the entire certification process.

[0004] Data consistency and accuracy are difficult to ensure: Due to the complexity and diversity of the data migration process, there are differences in data formats, standards and requirements between different systems, which makes data prone to loss, errors or inconsistencies during the migration process.

[0005] Lack of intelligent support: The current airworthiness certification data migration process lacks intelligent support and cannot automatically identify and process anomalies or errors in the data, requiring manual intervention and correction.

[0006] Through the above analysis, the problems and defects of the existing technology are as follows: In the traditional way, the historical data of airworthiness certification is dispersedly stored in the information systems of various departments, and the technical architecture of each part of the information system is not unified. Some are stored in relational databases, and some are stored in document databases. Data stored in relational databases can be migrated using existing methods, while document databases are stored in an unstructured manner, which makes it difficult to migrate using existing methods. Summary of the invention

[0007] In order to overcome the problems existing in the related technologies, the disclosed embodiments of the present invention provide a method and system for migrating airworthiness certification data. The purpose of the present invention is to meet the unified information management needs of airworthiness certification, realize deep data utilization, interconnection and high sharing, online business handling by administrative counterparts, collaborative work and experience sharing among various units of the airworthiness certification system, and improve the quality of airworthiness certification work.

[0008] The technical solution is as follows: Airworthiness certification data migration method, including: S1, extracting historical data from the historical system document-type database to the intermediate database; S2, convert and clean the historical data in the intermediate database, remove redundant records and fields, and make it fit the format required by the target database; S3, loads historical data from the intermediate data into the target database.

[0009] In step S1, historical data is extracted from the document-type database of the historical system to the intermediate database, including: according to the different storage forms of the airworthiness certification historical data, multiple relational data converters and document data converters are used respectively to convert the airworthiness certification historical data from different sources into the same format, and then extract them.

[0010] In step S2, the historical data in the intermediate database is converted and cleaned, including: based on the flag field of the airworthiness certification data, the historical data from different sources that have been converted into the same data format are cleaned and converted.

[0011] Further, the cleaning conversion includes: (1) De-duplicate historical airworthiness certification data and delete duplicate data; (2) Extract the flag values ​​from the historical airworthiness certification data, unify the different values ​​of the same flag field, and standardize the values ​​of the flag field on the basis of a unified format; (3) After the value of the flag field is standardized, duplicate removal is performed again based on the flag field to reduce the impact of duplicate data on subsequent steps; (4) On the basis of unifying the format of historical airworthiness certification data and the value of the flag field, the data of the same aircraft will be uniformly marked and the airworthiness certification data of the same aircraft will be sorted according to the issuance time.

[0012] In step (1), duplicate data is deleted, including: determining unique data according to the aircraft type, aircraft manufacturer, aircraft serial number, aircraft nationality mark, registration mark and issue date mark fields, and removing redundant duplicate data.

[0013] In step (2), the flag value includes the aircraft type, aircraft manufacturer, aircraft serial number, aircraft nationality mark and registration mark, nationality certificate number, airworthiness certificate number and issue date; the value of the standard flag field is used to avoid different expressions of the same business semantics.

[0014] In step (4), after sorting the airworthiness certification data of the same aircraft according to the issuance time, the document change scenario corresponding to each data is marked according to the time context and the business semantics of the fields in the airworthiness certification historical data, and the document change context of the airworthiness certification historical data is obtained.

[0015] In step S3, the historical data is loaded from the intermediate data into the target database, including: the cleansed and marked airworthiness certification historical data by the data cleaning device is converted into a standardized format output in the target relational data.

[0016] Furthermore, after loading the historical data from the intermediate data into the target database, it is also necessary to: combine software technology to display the historical airworthiness certification data in the form of graphics, images, and text visualization, and display the migrated historical airworthiness certification data in an all-round and multi-level manner according to the time context and document change context.

[0017] Another object of the present invention is to provide an airworthiness certification data migration system, which implements the airworthiness certification data migration method, and the system includes: A data conversion device, including a plurality of relational data converters and document data converters, is used to convert the airworthiness certification historical data from different sources into the same format by using different types of data converters according to different storage forms of the airworthiness certification historical data; A data cleaning device, used to clean and convert historical data from different sources that have been converted into the same data format based on the flag fields of the airworthiness certification data; A data output device, used for converting the historical airworthiness certification data cleaned and marked by the data cleaning device into a standardized format for output in the target relational data; The data display device is used to combine software technology to display the historical airworthiness certification data in the form of graphics, images, and text visualization, and to display the migrated historical airworthiness certification data in an all-round and multi-level manner according to the time context and document change context.

[0018] In combination with all the above-mentioned technical solutions, the beneficial effects of the present invention are as follows: the present invention migrates airworthiness certification historical data from multiple source databases to the same relational database, and compares and summarizes the airworthiness certification data to ensure the continuity of airworthiness certification business data and meet the needs of airworthiness certification business development. Compared with the prior art, the present invention is a special method and system for the migration of airworthiness certification historical data. Through the present invention, airworthiness certification historical data can be migrated conveniently at a faster speed and with higher accuracy. The workload of migrating airworthiness certification historical data is greatly reduced, and the migration quality of airworthiness certification historical data is improved. In addition, the present invention focuses on the historical context of changes in airworthiness certificates during the data migration process, improves the utilization rate of airworthiness certification historical data, facilitates the development of airworthiness certification work, promotes the improvement of airworthiness certification efficiency, and improves the quality of airworthiness certification work. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The accompanying drawings herein are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description, serve to explain the principles of the present disclosure; Figure 1 is a flow chart of an airworthiness certification data migration method provided by an embodiment of the present invention; Figure 2 is a schematic diagram of an airworthiness certification data migration method provided by an embodiment of the present invention; Figure 3 is a schematic diagram of an airworthiness certification data migration system provided by an embodiment of the present invention; Figure 4 This is a schematic diagram of the cleaning and conversion of historical data provided by an embodiment of the present invention; In the figure: 1. data conversion device; 2. data cleaning device; 3. data output device; 4. data display device. DETAILED DESCRIPTION

[0020] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without violating the connotation of the present invention, so the present invention is not limited by the specific implementation disclosed below.

[0021] The innovation of the present invention is that the data sources involved in the airworthiness certification business model are extensive, and the data formats, data structures and data contents are not the same. Therefore, when designing and implementing the airworthiness certification business model, it is necessary to effectively migrate and integrate these heterogeneous data. For multi-source heterogeneous historical data, the extraction + cleaning method is used to migrate heterogeneous data, map the data in the multi-source structured database with the airworthiness data model, migrate the data based on actual business, and clean and complete the source data during the migration process. Through the above measures, the migration and governance of multi-source heterogeneous airworthiness data to the standardized airworthiness data model can be realized, forming comprehensive, transparent and efficient airworthiness certification structured data.

[0022] Embodiment 1, as Figure 1 As shown, the airworthiness certification data migration method provided by the embodiment of the present invention includes: S1, extracting historical data from the historical system document-type database to the intermediate database; S2, convert and clean the historical data in the intermediate database, remove redundant records and fields, and make it fit the format required by the target database; S3, loads historical data from the intermediate data into the target database.

[0023] For example, Figure 2 This is the principle of the airworthiness certification data migration method provided by the embodiment of the present invention.

[0024] Embodiment 2, as Figure 3 As shown, the airworthiness certification data migration system provided by the embodiment of the present invention includes: The data conversion device 1 includes a plurality of relational data converters and document data converters. According to different storage forms of airworthiness certification historical data, different types of data converters are used to convert airworthiness certification historical data from different sources into the same format.

[0025] Relational data converter conversion process: Relational data converter mainly processes data stored in relational databases. Relational databases organize data through tables, rows and columns, where tables represent entities, rows represent records, and columns represent attributes.

[0026] Data extraction: Extract airworthiness certification historical data from different relational databases. Use SQL query statement access technology to obtain the required data.

[0027] Data cleaning: remove duplicate data, process missing values, correct erroneous data, etc. Ensure data accuracy and consistency.

[0028] Data mapping: Map the fields in the source database to the target fields according to the requirements of the target format. Issues such as data type conversion and field name changes need to be handled.

[0029] Data transformation: Convert the cleaned and mapped data into the target format. This may involve adjusting the data format, reorganizing the data, etc.

[0030] Document-type data converter conversion process: Document-type data converter mainly processes data stored in documents, such as Word, Excel, PDF, etc.

[0031] Document parsing: Parse different types of document formats and extract the airworthiness certification history data. This requires the use of OCR technology (for scanned PDF documents), XML parsing technology (for structured documents), etc.

[0032] Data extraction: Extract the required data from the parsed document. It is necessary to deal with the diversity of text formats, nested structures of data, and other issues.

[0033] Data cleaning and normalization: The extracted data is cleaned and normalized. This includes removing irrelevant information and dealing with inconsistent data formats.

[0034] Data transformation: Convert the cleaned and normalized data into the target format.

[0035] Scalability and flexibility: Design an extensible data transformation architecture to support data sources and targets of different types and formats. Provide flexible configuration options to allow users to customize data transformation rules as needed.

[0036] The data cleaning device 2 cleans and converts the historical data from different sources that have been converted into the same data format based on the flag field of the airworthiness certification data. Figure 4 Specifically including: (1) First, deduplicate the historical airworthiness certification data and delete duplicate data. Determine unique data based on the aircraft type, aircraft manufacturer, aircraft serial number, aircraft nationality mark, registration mark, and issue date, and remove redundant and duplicate data to reduce the impact of duplicate data on subsequent steps.

[0037] A. Data Sorting: The selected flag field is unique in the data set and has no duplicate values. Sort the data based on the flag field to make it easier to identify and process duplicate data. This helps to efficiently find and delete duplicate records in subsequent steps.

[0038] B. Deduplication operation: Use data processing tools (such as SQL, etc.) to perform deduplication operations.

[0039] C. Verify the deduplication results: Verify the deduplication data to ensure that all duplicate data has been correctly removed. You can use data comparison tools or manual inspection to verify the results.

[0040] (2) Extract the flag fields from the historical data of airworthiness certification. The historical data fields contain fields without clear business semantics or abandoned fields. These fields will have a negative impact on the candidate migration work. According to the business semantics of the historical data, in comparison with the existing business semantics, clarify the definition and purpose of the flag fields. For example, whether the field is used to represent a certain state, type or other specific information, identify each field one by one, and finally identify all the flag fields. These flag fields include aircraft type, aircraft manufacturer, aircraft serial number, aircraft nationality mark and registration mark, nationality certificate number, airworthiness certificate number and issuance date, etc. Unify the different values ​​of the same flag field, conduct inductive analysis on the different values ​​of the flag fields of the historical data, and unify the field format through SQL and other solutions. On the basis of format unification, unify the different expressions of the same semantics according to the actual business semantics and purpose, standardize the values ​​of the flag fields, and avoid different expressions of the same business semantics.

[0041] (3) After the value of the flag field is standardized, perform deduplication again based on the flag field, clarify the deduplication target, and determine the flag field. First, clarify which field or field combination will be used as the basis for deduplication. This flag field should be a field that can uniquely identify each piece of data, such as an ID, serial number, timestamp plus other unique attributes. Sort the data according to the flag field, which will help with subsequent deduplication operations. Use data processing tools (such as Excel, Python, SQL, etc.) to identify duplicate data. This usually involves comparing the values ​​of the flag field to find all identical records, further reducing the impact of duplicate data on subsequent steps.

[0042] (4) On the basis of unifying the format of historical airworthiness certification data and the value of the mark field, the data of the same aircraft shall be uniformly marked in accordance with the principles of legality and compliance, accuracy, uniformity, readability and maintainability.

[0043] The airworthiness certification data of the same aircraft are sorted by issuance time. First, extract all the airworthiness certification data of the aircraft, which should contain key information such as the issuance time of the airworthiness certificate. Then, use data processing software (such as Excel, Python, etc.) to organize these data to ensure that each piece of data contains complete issuance time information. Next, sort the data in chronological order of issuance time. You can use the sorting function in the data processing software, select issuance time as the sorting basis, and set it to ascending or descending order. Finally, verify the accuracy of the sorting results to ensure that the data is correctly arranged in chronological order of issuance time, so as to obtain an orderly and accurate list of airworthiness certification data for the same aircraft.

[0044] According to the time context and the business semantics of the fields in the historical airworthiness certification data, mark the document change scenario corresponding to each piece of data, and mark the corresponding document change event at each time node, including the document type, document number, and the specific time of the change. According to the business semantics of the fields in the historical airworthiness certification data, understand the document change scenario corresponding to each piece of data. For example, a change in the document type may mean that the aircraft changes from occupant A to occupant B, or from a standard airworthiness certificate to a special airworthiness certificate, etc., so as to sort out the document change context of the historical airworthiness certification data.

[0045] The data output device 3 converts the historical airworthiness certification data cleaned and marked by the data cleaning device into a standardized format, and determines the standard format of the data according to the structure and requirements of the target database, including determining the name, data type, length, precision, etc. of the field. The original data is converted to meet the requirements of the standard format. Including data type conversion (such as converting a string to a date type), data format adjustment (such as converting the date format from "year-month-day" to "month / day / year"), data range adjustment (such as scaling the numerical range from 0-10000 to 0-1), etc., and converting it into the format output in the target relational data.

[0046] The data display device 4 is usually combined with software technology to display the historical airworthiness certification data in visual forms such as graphics, images, and texts, and displays the migrated historical airworthiness certification data in an all-round and multi-level manner according to the time context and document change context.

[0047] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0048] The present invention significantly improves the migration efficiency of airworthiness certification data by optimizing the data migration steps. Compared with the traditional manual or inefficient data migration method, the present invention realizes fast and accurate data migration and reduces errors and delays in the migration process.

[0049] During the data migration process, the present invention adopts a strict data verification and validation mechanism to ensure that the migrated data is consistent with the original data, avoiding the risk of data loss, damage or tampering, and ensuring data integrity and accuracy.

[0050] Through automated data migration process and optimized resource utilization, the present invention reduces the cost of airworthiness certification data migration. Enterprises do not need to invest a lot of manpower, material resources and financial resources for manual migration and verification, thus saving valuable resources and reducing migration costs.

[0051] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any modifications, equivalent substitutions and improvements made by any technician familiar with the technical field within the technical scope disclosed by the present invention and within the spirit and principles of the present invention should be covered within the protection scope of the present invention.

Claims

1. A method for migrating airworthiness certification data, characterized in that: The method includes: S1, extracting historical data from the historical system document-type database to the intermediate database; S2, convert and clean the historical data in the intermediate database, remove redundant records and fields, and make it fit the format required by the target database; S3, loads historical data from intermediate data into the target database.

2. The airworthiness certification data migration method according to claim 1, characterized in that: In step S1, historical data is extracted from the document-type database of the historical system to the intermediate database, including: according to the different storage forms of the airworthiness certification historical data, multiple relational data converters and document data converters are used respectively to convert the airworthiness certification historical data from different sources into the same format, and then extract them.

3. The airworthiness certification data migration method according to claim 1, characterized in that: In step S2, the historical data in the intermediate database is converted and cleaned, including: based on the flag field of the airworthiness certification data, the historical data from different sources that have been converted into the same data format are cleaned and converted.

4. The airworthiness certification data migration method according to claim 3, characterized in that: The cleaning conversion comprises: (1) De-duplicate historical airworthiness certification data and delete duplicate data; (2) Extract the flag values ​​from the historical airworthiness certification data, unify the different values ​​of the same flag field, and standardize the values ​​of the flag field on the basis of a unified format; (3) After the value of the flag field is standardized, deduplication is performed again based on the flag field to reduce the impact of duplicate data on subsequent steps; (4) On the basis of unifying the format of historical airworthiness certification data and the value of the flag field, the data of the same aircraft will be uniformly marked and the airworthiness certification data of the same aircraft will be sorted according to the issuance time.

5. The airworthiness certification data migration method according to claim 4, characterized in that: In step (1), duplicate data is deleted, including: determining unique data according to the aircraft type, aircraft manufacturer, aircraft serial number, aircraft nationality mark, registration mark and issue date mark fields, and removing redundant duplicate data.

6. The airworthiness certification data migration method according to claim 4, characterized in that: In step (2), the mark values ​​include aircraft type, aircraft manufacturer, aircraft serial number, aircraft nationality mark and registration mark, nationality certificate number, airworthiness certificate number and issue date.

7. The airworthiness certification data migration method according to claim 4, characterized in that: In step (4), after sorting the airworthiness certification data of the same aircraft according to the issuance time, the document change scenario corresponding to each data is marked according to the time context and the business semantics of the fields in the airworthiness certification historical data, and the document change context of the airworthiness certification historical data is obtained.

8. The airworthiness certification data migration method according to claim 1, characterized in that: In step S3, the historical data is loaded from the intermediate data into the target database, including: the cleansed and marked airworthiness certification historical data by the data cleaning device is converted into a standardized format output in the target relational data.

9. The airworthiness certification data migration method according to claim 8, characterized in that: After loading the historical data from the intermediate data into the target database, it is also necessary to: combine software technology to display the historical airworthiness certification data in the form of graphics, images, and text visualization, and display the migrated historical airworthiness certification data in an all-round and multi-level manner according to the time context and document change context.

10. An airworthiness certification data migration system, characterized in that: The system implements the airworthiness certification data migration method according to any one of claims 1 to 9, and the system comprises: A data conversion device (1) includes a plurality of relational data converters and document data converters, and is used to convert airworthiness certification historical data from different sources into the same format by using different types of data converters according to different storage formats of airworthiness certification historical data; A data cleaning device (2) is used to clean and convert historical data from different sources that have been converted into the same data format based on the flag field of the airworthiness certification data; The data output device (3) is used to perform standardized conversion on the airworthiness certification history data cleaned and marked by the data cleaning device (2) and convert it into a format in the target relational data for output; The data display device (4) is used to combine software technology to display the airworthiness certification historical data in the form of graphics, images, and text visualization, and to display the migrated airworthiness certification historical data in an all-round and multi-level manner according to the time context and the document change context.

Images