International trade data standardization management method and device, equipment and medium

Abstract

The invention relates to an international trade data standardization management method and device, equipment and a medium. The international trade data standardization management method comprises the steps of importing an international trade data standard; performing data mapping on the original business data based on an international trade data standard, and converting the original business data into standardized business data; formulating a data quality inspection rule and a data quality inspection index according to an international trade data standard; and regularly carrying out quality inspection evaluation on the standardized business data according to the data quality inspection rules and the data quality inspection indexes to generate a quality evaluation report. According to the invention, standardized and normalized management of the trade business data can be realized, and the data quality of the trade business data is effectively improved.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to a method, device, equipment and medium for standardizing management of international trade data. Background Art

[0002] In the current context of trade globalization, the continuous expansion of international trade and the rapid growth of trade data have made it an obvious fact that the process of trade digitalization is accelerating. The management of international trade data not only involves the transaction information of goods, but also includes data in multiple fields such as finance, logistics, and customs. Its complexity and diversity make the standardized management of data particularly important. On the other hand, the new applications and new scenarios developed in the process of deepening digitalization have also made digital trade more complex and difficult to regulate, and have also prompted countries to gradually strengthen their supervision of digital trade.

[0003] Digital trade involves cross-border transactions and data flows, and requires a series of laws and regulations to ensure the legitimacy and security of transactions. Countries have formulated a series of policies and regulations in the field of digital trade, covering aspects such as intellectual property protection, data privacy, and network security. However, there are differences in laws and regulations between countries, and different regulatory requirements for data, which brings complexity to cross-border trade, and laws, regulations and regulatory requirements will change. Therefore, how to coordinate these differences and ensure the legal flow of data is a challenge that needs to be solved urgently. Summary of the invention

[0004] In order to solve the problems of data standardization and quality management in traditional international trade data management, the present disclosure provides a method, device, equipment and medium for international trade data standardization management.

[0005] In a first aspect, the present disclosure provides a method for standardizing and managing international trade data, comprising:

[0006] Import international trade data standards;

[0007] Map the original business data based on international trade data standards and convert the original business data into standardized business data;

[0008] Formulate data quality inspection rules and indicators based on international trade data standards;

[0009] Regularly conduct quality inspection and evaluation on standardized business data based on data quality inspection rules and data quality inspection indicators, and generate quality assessment reports.

[0010] Optionally, import international trade data standards, including:

[0011] Access to international trade data standards;

[0012] Install database software and create a database instance, and establish a data standard library;

[0013] Import international trade data standards into the data standards library.

[0014] Optionally, after the international trade data standards are imported into the data standards library, the following is also included:

[0015] Regularly collect information on changes in international trade data standards;

[0016] The data standards content in the data standards library is added and revised according to the changes in international trade data standards.

[0017] Optionally, before data mapping the original business data based on the international trade data standard, the following steps are also included:

[0018] Access to the data systems of trade-related target enterprises;

[0019] Collect business data from the target enterprise's data system, and perform data preprocessing, data cleaning, data encoding and consistency checking on the collected business data to obtain the original business data.

[0020] Optionally, data mapping is performed on the original business data based on international trade data standards to convert the original business data into standardized business data, including:

[0021] Determine standardized business data structure according to international trade data standards;

[0022] According to the correspondence between the structure of the original business data and the structure of the standardized business data, the structure of the original business data is converted into the standardized business data structure, and the original business data is converted into the standardized business data.

[0023] Optionally, the method further comprises:

[0024] When performing data mapping, the mapping relationship between international trade data standards and standardized business data is saved;

[0025] When international trade data standards change, the target data that does not meet the data standards in the standardized business data is determined based on the mapping relationship, and a prompt message is issued to remind the operation and maintenance personnel to repair the target data.

[0026] Optionally, the method further comprises:

[0027] Performing data correlation analysis on the target enterprise's data system based on the business data collected from the target enterprise's data system to determine the data system to which the data is correlated;

[0028] When international trade data standards change, a table of interface changes for international trade data standards is generated;

[0029] Determine the target data system according to the source of the target original business data corresponding to the target data, and determine the data system associated with the target data system;

[0030] The interface change status table is sent to the target data system and the data system associated with the target data system.

[0031] In a second aspect, the present disclosure provides an international trade data standardization management device, comprising:

[0032] Data standards module, used to import international trade data standards;

[0033] The data mapping module is used to map the original business data based on the international trade data standard and convert the original business data into standardized business data;

[0034] Quality management module, used to formulate data quality inspection rules and data quality inspection indicators according to international trade data standards;

[0035] The quality inspection module is used to regularly conduct quality inspection and evaluation on standardized business data according to data quality inspection rules and data quality inspection indicators, and generate quality evaluation reports.

[0036] Optionally, when importing international trade data standards, the data standard module is specifically used to:

[0037] Access to international trade data standards;

[0038] Install database software and create a database instance, and establish a data standard library;

[0039] Import international trade data standards into the data standards library.

[0040] Optionally, after importing the international trade data standards into the data standards library, the data standards module is further used to:

[0041] Regularly collect information on changes in international trade data standards;

[0042] The data standards content in the data standards library is added and revised according to the changes in international trade data standards.

[0043] Optionally, the international trade data standardization management device further includes a data access module, which is used to:

[0044] Access to the data systems of trade-related target enterprises;

[0045] Collect business data from the target enterprise's data system, and perform data preprocessing, data cleaning, data encoding and consistency checking on the collected business data to obtain the original business data.

[0046] Optionally, when the data mapping module performs data mapping on the original business data based on the international trade data standard and converts the original business data into standardized business data, it is specifically used to:

[0047] Determine standardized business data structure according to international trade data standards;

[0048] According to the correspondence between the structure of the original business data and the structure of the standardized business data, the structure of the original business data is converted into the standardized business data structure, and the original business data is converted into the standardized business data.

[0049] Optionally, the data mapping module is further used to:

[0050] When performing data mapping, the mapping relationship between international trade data standards and standardized business data is saved;

[0051] When international trade data standards change, the target data that does not meet the data standards in the standardized business data is determined based on the mapping relationship, and a prompt message is issued to remind the operation and maintenance personnel to repair the target data.

[0052] Optionally, the international trade data standardization management device further includes a correlation analysis module, which is used to:

[0053] Performing data correlation analysis on the target enterprise's data system based on the business data collected from the target enterprise's data system to determine the data system to which the data is correlated;

[0054] When international trade data standards change, a table of interface changes for international trade data standards is generated;

[0055] Determine the target data system according to the source of the target original business data corresponding to the target data, and determine the data system associated with the target data system;

[0056] The interface change status table is sent to the target data system and the data system associated with the target data system.

[0057] In a third aspect, the present disclosure provides an electronic device, comprising a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the method as described in any one of the first aspects is implemented.

[0058] In a fourth aspect, the present disclosure provides a computer-readable storage medium having program instructions stored thereon, which implement any method of the first aspect when the program instructions are executed.

[0059] In a fifth aspect, the present disclosure provides a computer program product, which is stored in a storage medium. When the program product is executed, the method of the first aspect can be implemented.

[0060] Compared with the prior art, the technical solution provided by the present invention has the following advantages:

[0061] The international trade data standardization management method, device, equipment and medium provided by the present invention first import the international trade data standard, then perform data mapping on the original business data based on the international trade data standard, convert the original business data into standardized business data, and realize the standardized and normalized management of trade business data. Thereafter, data quality inspection rules and data quality inspection indicators are formulated according to the international trade data standard, and the standardized business data is regularly quality inspected and evaluated according to the data quality inspection rules and data quality inspection indicators, and a quality assessment report is generated, which can effectively improve the data quality of the trade business data. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0063] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0064] Figure 1 A flow chart of the international trade data standardization management method provided by the embodiment of the present disclosure;

[0065] Figure 2 A schematic diagram of the structure of the international trade data standardization management device provided by the embodiment of the present disclosure;

[0066] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0067] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0068] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0069] Figure 1 The present invention provides a flowchart of a method for standardizing international trade data management. The method can be executed by an international trade data standardization management device. The international trade data standardization management device can be implemented in software and / or hardware and can be applied in an international trade management system. Figure 1 The international trade data standardization management method includes the following steps:

[0070] S101. Import international trade data standards.

[0071] International trade data standards are closely related to global trade security and facilitation. This standard aims to promote the smooth development of international trade, create a fair, transparent and efficient environment, reduce trade costs and improve trade efficiency, such as the WCO (World Customs Organization) 4.0 international standard.

[0072] In some embodiments, importing international trade data standards includes: obtaining international trade data standards; installing database software and creating a database instance, establishing a data standards library; and importing international trade data standards into the data standards library.

[0073] In some embodiments, after the international trade data standards are imported into the data standards library, the data standards library can also be continuously optimized and improved, including: regularly collecting changes in international trade data standards; adding and revising data standard content in the data standards library based on changes in international trade data standards.

[0074] According to the WCO 4.0 international standard, a data standard library can be created. The data standard library is a database or data collection used to store, manage and provide standardized data. In specific implementation, the creation of a data standard library according to the WCO 4.0 international standard can be carried out through the steps of formulating data standards, designing database structure, selecting database software, creating a data standard library, conducting data quality management and monitoring, and continuous optimization and improvement.

[0075] Formulating data standards includes: selecting international standards. The disclosed embodiment chooses to follow the World Trade Organization's international standard WCO 4.0 to ensure the authority and global applicability of data standards. Define data elements according to the international standard WCO 4.0, clarify the name, definition, data type, value range, format, etc. of the data, and ensure the accuracy and consistency of the data. Establish a data model based on the international standard WCO 4.0. According to business needs, you can select a suitable data model (such as a relational model, a document model, etc.), and define data entities, data attributes, and data relationships.

[0076] Designing the database structure includes: Designing the table structure, designing the database table structure according to the data model, including fields, primary keys, foreign keys, etc. Setting the relationship between tables, establishing the association between different tables through constraints such as primary keys and foreign keys. Setting indexes, creating indexes for frequently used query fields in order to improve query efficiency.

[0077] Selecting database software includes: selecting database software as a database management system (Database Management System). In consideration of the security and performance requirements of the database, the disclosed embodiment selects the domestically produced DAMO database. Installing and configuring the database, the database is installed and configured according to the official guide of the DAMO database.

[0078] Creating a data standard library includes: creating a database instance, creating a database instance in the DAMO database, and setting the corresponding permissions and security measures. Importing data, after completing the English translation of the official data files of the WCO 4.0 international standard, import the official data of the WCO 4.0 international standard in Chinese and English into the data standard library. Ensure the accuracy and completeness of the data to facilitate the subsequent update and maintenance of the data standard library.

[0079] Data quality management and monitoring include: establishing a data verification mechanism to verify data during data import to ensure data accuracy and consistency. Establishing a data monitoring mechanism to regularly check data quality and identify and resolve problems in a timely manner.

[0080] Continuous optimization and improvement include: collecting feedback, regularly collecting changes in WCO international standards, and users' use of the data standard library and feedback. Optimization and improvement, according to changes in WCO international standards and user feedback, using system functions to add and revise the content of the data standard library, so that the data standard library keeps up with the latest WCO international standards and improves its accuracy and practicality.

[0081] In the process of international trade data standardization management, the international trade data standardization management system can formulate trade data standardization specifications and processes based on this WCO data standard library, and uniformly handle the names, definitions, data types, value ranges, formats, etc. of international trade data.

[0082] The disclosed embodiment creates a data standard library by using international trade data standards, so that the data standard library can be used to manage international trade data standardization in the future. At the same time, the data standard library is continuously optimized and improved to keep up with the latest international standards and improve its accuracy and practicality.

[0083] S102. Perform data mapping on the original business data based on international trade data standards to convert the original business data into standardized business data.

[0084] Raw business data refers to international trade business data before it is standardized. Data mapping is a means of converting data from one format or structure to another. Data mapping of raw business data based on the data structure and format defined by international trade data standards can convert raw business data into standardized business data.

[0085] In some embodiments, before data mapping of the original business data based on international trade data standards, it also includes: accessing the data system of the target enterprise related to trade; collecting business data from the data system of the target enterprise, and performing data preprocessing, data cleaning, data encoding and consistency checking on the collected business data to obtain the original business data.

[0086] For example, the trade data of trading companies and transportation companies can be connected to the international trade system (for example, the centralized trade document submission system, referred to as the STD system) through the data interface platform. After connecting to the data system of the target enterprise related to trade, it is necessary to perform a data cleansing process on the business data of different enterprises, and at the same time discover and resolve data of too low quality in this process.

[0087] In specific implementation, the data cleaning process includes: Data collection and understanding: Collect data and obtain data from various target companies' data systems (such as databases, APIs, files, etc.). Understand the data, check the data structure, data type, variable meaning and missing values, and get a preliminary understanding of the overall situation of the data. Use descriptive statistics (such as mean, median, standard deviation, etc.) to understand the distribution of the data. Use charts (such as histograms, etc.) to intuitively display data characteristics and identify possible outliers and trends.

[0088] Data preprocessing: Delete or fill missing values ​​in the data. For data records with a large number of missing values, you can directly delete them; you can also choose a filling method based on the specific situation, including mean filling, median filling, mode filling (applicable to numerical data), or using the most frequently occurring value to fill (applicable to categorical data). Missing values ​​can also be treated as a special category and handled by creating new variables to mark missing conditions. Identify and process duplicate data content, use unique identifiers or combine multiple fields to determine whether the data content is duplicated, and merge duplicate data content by deleting redundant duplicate data content.

[0089] Data cleaning and conversion: logical check and outlier processing, check the rationality of the data according to business logic, such as age should be within a reasonable range, gender should be a specific value, etc.; then identify and analyze outliers, and determine whether to retain, modify or delete them; modification methods may include using boundary value replacement, smoothing, or filling based on model prediction values. Data type conversion, ensure that the data type of each field is correct, such as converting a string to a date format, or converting numeric data to categorical data. Data normalization processing, for numeric data, z-score standardization or normalization (min-max scaling) can be performed on it according to needs to make the data on the same scale; z-score standardization is also called standard score, which is to subtract the mean from the original data and then divide it by the standard deviation, so that the mean of the processed data is 0 and the standard deviation is 11234, which is used to convert the data to the same scale.

[0090] Data coding and consistency check: Internal consistency, check whether the logical relationship between different fields in the data set is consistent, such as whether the date range is reasonable, whether the address information matches, etc. External consistency check, you can choose to compare the currently processed data with the data from the external data source to verify the accuracy and completeness of the data.

[0091] Documentation and version control: Data processing records are documented, and the cleaning process, methods used and reasons for each step are recorded in detail to facilitate subsequent audits and repeated operations. Data version control, in order to ensure the traceability and controllability of data after cleaning, a version control mechanism can be introduced in the data processing process. The version control system records the status before and after data cleaning, and can accurately trace back to the original data status before cleaning, so as to backtrack and compare when necessary. Specifically, the following steps may be included: 1. Data snapshot record: Before the data is cleaned, the system will automatically create a data snapshot to record the status and content of the original data. These data snapshots are stored in a special version control database to ensure their security and integrity. 2. Version identification and association: After each data cleaning, the system will generate a new data version and assign it a unique version identifier. The system will associate the new version with its corresponding original data snapshot to establish a clear version correspondence. 3. Version backtracking and comparison: When it is necessary to go back to the state before cleaning, the version control module can be used for quick search and backtracking operations. This solution provides a convenient version comparison function, allowing users to clearly understand the differences and changes before and after data cleaning.

[0092] In addition, data lineage analysis technology can be used to track the entire process from data source to access to the international trade management system, and quickly locate the source of data quality problems. In terms of locating the source of data quality problems, an abnormal data recognition algorithm can be introduced to automatically identify abnormal values, duplicate values, or missing values ​​in the data. Users can accurately locate the source of data quality problems and take corresponding improvement measures by querying the source, processing process, and conversion path of specific data. Abnormal data is marked and recorded, and the data flow direction is indicated to help users quickly locate the links and causes of abnormal data generation, and conduct a detailed analysis of the problem, including the nature of the problem, the scope of impact, possible causes, etc.

[0093] According to the results of the problem analysis, solutions are formulated, including modifying the data interface, adjusting the data cleaning rules, etc. Finally, the implementation effect of the solution is evaluated, including the degree of improvement in data quality and the reduction of business impact. The evaluation results are fed back to relevant departments and operation and maintenance personnel to provide a reference for subsequent data quality management. Through the above data cleaning process and effective data quality monitoring, problem location and analysis, solution formulation and implementation, and effect evaluation and feedback mechanism, data quality problems when the data interface platform accesses trade data can be discovered and solved in a timely manner, ensuring the consistency of trade data and the data standard library from the source of trade data.

[0094] The disclosed embodiment obtains original business data by performing data preprocessing, data cleaning, data encoding and consistency checking on the collected business data, thereby ensuring the integrity and accuracy of the original business data and facilitating standardized management of the original business data.

[0095] In some embodiments, data mapping is performed on original business data based on international trade data standards to convert the original business data into standardized business data, including: determining a standardized business data structure according to international trade data standards; converting the structure of the original business data into a standardized business data structure based on the correspondence between the structure of the original business data and the standardized business data structure, thereby converting the original business data into standardized business data.

[0096] Specifically, data mapping is to map the data structure in the data standard library to the table fields in the international trade system, which can be completed through automatic data mapping and manual data mapping.

[0097] The automatic data mapping process includes: data preparation, determining data standards and the structure and format of original business data. Rule definition, defining data mapping rules such as field correspondence, data conversion logic, etc. according to international trade business needs. Mapping execution, using data mapping tools or platforms to automatically execute the data mapping process according to the defined rules. Result verification, verifying the mapping results to ensure the accuracy and completeness of the data.

[0098] The specific implementation of data mapping in the disclosed embodiment includes template-based data mapping and intelligent matching algorithm-based data mapping. Template-based data mapping uses predefined templates to quickly achieve the correspondence between data structure and field. Intelligent matching algorithm-based data mapping uses intelligent matching algorithms to automatically identify and match similar fields in the data standard library and the original business data, and then maps the data structure in the data standard library to the data structure of similar fields in the original business data.

[0099] The manual data mapping process includes: problem analysis, identifying the data parts that cannot be processed by automatic mapping, such as complex data conversion logic, special data formats, etc. Manual definition of rules, manually defining the rules for data mapping based on the results of problem analysis. Execution of mapping, executing the data mapping process according to the manually defined rules. Result check, checking the results of manual mapping to ensure the accuracy and completeness of the data. Manual mapping can be completed by directly editing the mapping file, manually defining the correspondence between fields and data conversion logic in the mapping file. You can also use the manual mode of the mapping tool, select the manual mode in the data mapping tool, and manually define and execute the mapping through the graphical interface or command line.

[0100] When performing data mapping, you can use multi-threading or distributed computing technology to improve the concurrent processing capabilities of data mapping. Use a cache mechanism to reduce repeated calculations and data access times, and improve the efficiency of data mapping. For data mapping, you can also optimize the user experience. The optimization measures include: graphical interface, providing an intuitive and easy-to-use graphical interface to facilitate users to define and manage data mapping rules. Real-time monitoring and feedback, real-time monitoring of the progress and status of data mapping, and providing timely feedback and alarm information. For the flexibility and scalability of data mapping, a modular design can be used to decompose the data mapping process into multiple independently run modules for easy expansion and maintenance. Support a variety of data sources and target types, such as relational databases, non-relational databases, file systems, etc., to improve the flexibility and applicability of data mapping.

[0101] The disclosed embodiment converts the structure of original business data into a standardized business data structure according to the correspondence between the structure of original business data and the standardized business data structure in the international trade data standard, thereby completing the standardized data mapping of the original business data. It can map and integrate international trade data from different data sources to ensure the consistency and accuracy of the data.

[0102] S103. Formulate data quality inspection rules and indicators based on international trade data standards.

[0103] In the process of using standardized business data, the business data table inspection rules and corresponding data quality inspection indicators set by the data standard library can be integrated into the verification rule management module. Data quality inspection rules include inspection rules for data integrity, accuracy, consistency, etc., to further control the data quality of business data tables. Data quality inspection indicators can be achieved by setting data quality thresholds. Key data quality indicators such as accuracy, integrity, consistency, reliability, etc. are set to evaluate the quality level of trade data. According to business needs and data characteristics, specific indicator standards and thresholds are set as the basis for evaluation and monitoring.

[0104] S104. Regularly conduct quality inspection and evaluation on standardized business data according to data quality inspection rules and data quality inspection indicators, and generate a quality assessment report.

[0105] Regularly conduct quality assessment and monitoring of standardized business data. Through data quality reports (including abnormal situation monitoring), timely discover and solve data quality problems. Once data quality problems are found, the approval, revision / cancellation process mechanism will be triggered to ensure that data quality is repaired and improved in a timely manner.

[0106] Set up a regular data quality assessment plan, including assessment frequency, assessment scope and assessment method. Use data quality tools and systems to conduct a comprehensive assessment of trade data and generate data quality reports to reflect the status of various data quality indicators. Deploy anomaly monitoring modules to monitor changes and anomalies in trade data in real time. Automatically generate data quality reports to highlight anomalies and problematic data, including missing data, outliers, duplicate data, etc., so as to promptly identify and resolve data quality issues. By establishing a data quality monitoring mechanism, regularly run the data quality check scripts determined in the verification rule management module to check and monitor the data that has been connected and completed data cleaning and standardized business data.

[0107] The disclosed embodiment imports international trade data standards and then performs data mapping on original business data based on the international trade data standards, thereby converting original business data into standardized business data, thereby achieving standardized and normalized management of trade business data. Thereafter, data quality inspection rules and data quality inspection indicators are formulated according to the international trade data standards, and quality inspection and evaluation of the standardized business data are regularly performed according to the data quality inspection rules and data quality inspection indicators, and a quality evaluation report is generated, thereby effectively improving the data quality of trade business data.

[0108] In some embodiments, the method further includes: when performing data mapping, saving the mapping relationship between the international trade data standard and the standardized business data; when the international trade data standard changes, determining the target data in the standardized business data that does not meet the data standard based on the mapping relationship, and issuing a prompt message to remind the operation and maintenance personnel to repair the target data.

[0109] When performing data mapping, the international trade data management system can save the mapping relationship between international trade data standards and standardized business data by establishing a mapping relationship table between the data standard library and the business data table of standardized business data. When the WCO international standard changes, the system will automatically prompt that the standardized business data no longer meets the data standard due to the change in the data standard in the data standard library. The database operation and maintenance personnel will manually repair the data structure of the standardized business data table through the system prompts, and take appropriate cleaning measures or mark the abnormal data caused by the change in the data structure as invalid data.

[0110] In addition, the error logs during the data mapping process can also be recorded, including information such as error type, occurrence time, and impact scope. This helps to quickly locate the problem and take corresponding compensation measures. During the data mapping process, the WCO data standard library and STD system business data tables are backed up regularly, and the backup adopts the traditional database hot standby method. Once a problem occurs, the backup data can be used for rapid data recovery.

[0111] The disclosed embodiment saves the mapping relationship between the international trade data standard and the standardized business data when performing data mapping, so that when the international trade data standard changes, the target data in the standardized business data that does not meet the data standard is determined according to the mapping relationship, and a prompt message is issued to remind the operation and maintenance personnel to repair the target data, thereby timely repairing the problem that the standardized business data no longer meets the data standard due to the change in the data standard.

[0112] In some embodiments, the method further includes: performing data association analysis on the target enterprise's data system based on business data collected from the target enterprise's data system to determine the data system associated with the data; generating an interface change table for the international trade data standard when the international trade data standard changes; determining the target data system based on the source of the target original business data corresponding to the target data, and determining the data system associated with the target data system; and sending the interface change table to the target data system and the data system associated with the target data system.

[0113] For example, by establishing a series of reports for data standardization analysis, a horizontal comparison can be made on the business data of various trade-related enterprises connected to the international trade management system. Since the various trade-related enterprises connected to the international trade management system will conduct business transactions between each other, the two enterprises conducting business transactions will generate some of the same business data. By conducting a horizontal comparison of business data across data systems of different enterprises, data correlation analysis of enterprise data systems can be achieved to determine enterprise data systems whose business data are mutually related.

[0114] When international trade data standards change, the system will generate an interface change status table for international trade data standards because the data interface may need to be changed accordingly. Then, based on the target data in the standardized business data that no longer meets the data standard due to the change in the data standard, determine the target original business data corresponding to the target data, and then determine the target data system affected by the data standard change based on the source of the target original business data, and determine the data system associated with the target data system. Finally, the interface change status table is sent to the target data system and the data system associated with the target data system, so that the associated enterprises can adjust the interfaces of their own enterprise data systems in a timely manner to adapt to the data interface changes caused by the change in data standards.

[0115] The disclosed embodiment performs data association analysis on the target enterprise's data system to determine the data system associated with the data, generates an interface change status table for the international trade data standard when the international trade data standard changes, and then sends the interface change status table to the target data system and the data system associated with the target data system, so that the associated enterprises can promptly adjust the interfaces of their own enterprise data systems to adapt to the data interface changes caused by the change in data standards.

[0116] In addition, the international trade data standardization management device can also be configured with data element management functions and data intelligent retrieval functions. The data element management module uses data encryption, access control, audit tracking and other security measures to ensure the safe storage and access control of sensitive data. Through the diversified intelligent data retrieval function, users can perform standard flexible and efficient data retrieval and analysis according to various needs to meet different business needs.

[0117] Figure 2 The structure diagram of the international trade data standardization management device provided in the embodiment of the present disclosure. The international trade data standardization management device can be a component or assembly in the terminal of the above embodiment. The international trade data standardization management device provided in the embodiment of the present disclosure can execute the processing flow provided in the embodiment of the international trade data standardization management method, such as Figure 2 As shown, the international trade data standardization management device 200 includes:

[0118] Data standard module 201, used to import international trade data standards;

[0119] A data mapping module 202 is used to perform data mapping on the original business data based on the international trade data standard, and convert the original business data into standardized business data;

[0120] The quality management module 203 is used to formulate data quality inspection rules and data quality inspection indicators according to international trade data standards;

[0121] The quality inspection module 204 is used to regularly perform quality inspection and evaluation on the standardized business data according to data quality inspection rules and data quality inspection indicators, and generate a quality evaluation report.

[0122] In some embodiments, when importing international trade data standards, the data standard module 201 is specifically used to: obtain international trade data standards; install database software and create a database instance to establish a data standard library; and import the international trade data standards into the data standard library.

[0123] In some embodiments, after importing the international trade data standards into the data standards library, the data standards module 201 is also used to: regularly collect changes in the international trade data standards; and add and revise the data standards content in the data standards library according to the changes in the international trade data standards.

[0124] In some embodiments, the international trade data standardization management device also includes a data access module 205, which is used to: access the data system of the target enterprise related to trade before data mapping the original business data based on the international trade data standard; collect business data from the data system of the target enterprise, and perform data preprocessing, data cleaning, data encoding and consistency checking on the collected business data to obtain the original business data.

[0125] In some embodiments, when the data mapping module 202 performs data mapping on the original business data based on the international trade data standard and converts the original business data into standardized business data, it is specifically used to: determine the standardized business data structure according to the international trade data standard; convert the structure of the original business data into the standardized business data structure according to the correspondence between the structure of the original business data and the standardized business data structure, and convert the original business data into standardized business data.

[0126] In some embodiments, the data mapping module 202 is also used to: save the mapping relationship between the international trade data standard and the standardized business data when performing data mapping; when the international trade data standard changes, determine the target data in the standardized business data that does not meet the data standard based on the mapping relationship, and issue a prompt message to remind the operation and maintenance personnel to repair the target data.

[0127] In some embodiments, the international trade data standardization management device also includes an association analysis module 206, which is used to: perform data association analysis on the target enterprise's data system based on the business data collected from the target enterprise's data system, and determine the data system associated with the data; when the international trade data standard changes, generate an interface change status table for the international trade data standard; determine the target data system based on the source of the target original business data corresponding to the target data, and determine the data system associated with the target data system; send the interface change status table to the target data system and the data system associated with the target data system.

[0128] Figure 2 The international trade data standardization management device of the illustrated embodiment can be used to execute the technical solution of the above-mentioned method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0129] Figure 3 Schematic diagram of the structure of an electronic device in the embodiment of the present disclosure. Figure 3 , which shows a structural schematic diagram of an electronic device 300 suitable for implementing the embodiments of the present disclosure. Figure 3 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0130] like Figure 3 As shown, the electronic device 300 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage device 308 to a random access memory (RAM) 303 to implement the international trade data standardization management method of the embodiment described in the present disclosure. In the RAM 303, various programs and data required for the operation of the electronic device 300 are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.

[0131] Typically, the following devices may be connected to the I / O interface 305: input devices 306 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 307 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 308 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 309. The communication devices 309 may allow the electronic device 300 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 3 The electronic device 300 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0132] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart, thereby implementing the international trade data standardization management method as described above. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 309, or installed from the storage device 308, or installed from the ROM 302. When the computer program is executed by the processing device 301, the above functions defined in the method of the embodiment of the present disclosure are executed.

[0133] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0134] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0135] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0136] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

[0137] Import international trade data standards;

[0138] Map the original business data based on international trade data standards and convert the original business data into standardized business data;

[0139] Formulate data quality inspection rules and indicators based on international trade data standards;

[0140] Regularly conduct quality inspection and evaluation on standardized business data based on data quality inspection rules and data quality inspection indicators, and generate quality assessment reports.

[0141] Optionally, when the above one or more programs are executed by the electronic device, the electronic device may also execute other steps described in the above embodiments.

[0142] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0143] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0144] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, limit the unit itself.

[0145] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0146] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0147] The embodiments of the present disclosure also provide a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the method of any of the above embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0148] The embodiments of the present disclosure also provide a computer program product, which is stored in a storage medium. When the program product is run, the method of any of the above embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0149] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0150] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0151] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

[0152] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0153] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for standardizing and managing international trade data, characterized in that: include: Import international trade data standards; Performing data mapping on the original business data based on the international trade data standard to convert the original business data into standardized business data; Formulate data quality inspection rules and data quality inspection indicators according to the international trade data standards; Regularly perform quality inspection and evaluation on the standardized business data according to the data quality inspection rules and the data quality inspection indicators, and generate a quality evaluation report.

2. The international trade data standardization management method according to claim 1, characterized in that: The standards for importing international trade data include: Access to international trade data standards; Install database software and create a database instance, and establish a data standard library; Importing the international trade data standard into the data standard library.

3. The international trade data standardization management method according to claim 2, characterized in that: After importing the international trade data standard into the data standard library, the method further includes: Regularly collect information on changes in international trade data standards; The data standard content in the data standard library is added and revised according to the changes in the international trade data standards.

4. The international trade data standardization management method according to claim 1, characterized in that: Before the data mapping of the original business data based on the international trade data standard is performed, the method further includes: Access to the data systems of trade-related target enterprises; Business data is collected from the data system of the target enterprise, and the collected business data is subjected to data preprocessing, data cleaning, data encoding and consistency checking to obtain the original business data.

5. The international trade data standardization management method according to claim 1, characterized in that: The data mapping of the original business data based on the international trade data standard to convert the original business data into standardized business data includes: Determining a standardized business data structure according to the international trade data standard; According to the correspondence between the structure of the original business data and the structure of the standardized business data, the structure of the original business data is converted into the standardized business data structure, and the original business data is converted into the standardized business data.

6. The international trade data standardization management method according to claim 4, characterized in that: The method comprises: When performing the data mapping, saving the mapping relationship between the international trade data standard and the standardized business data; When the international trade data standard changes, the target data in the standardized business data that does not meet the data standard is determined according to the mapping relationship, and a prompt message is issued to remind the operation and maintenance personnel to repair the target data.

7. The international trade data standardization management method according to claim 6, characterized in that: The method further comprises: Performing data association analysis on the data system of the target enterprise based on the business data collected from the data system of the target enterprise to determine the data system associated with the data; When the international trade data standard changes, generating an interface change status table of the international trade data standard; Determine a target data system according to the source of the target original business data corresponding to the target data, and determine a data system associated with the target data system; The interface change status table is sent to the target data system and a data system associated with the target data system.

8. An international trade data standardization management device, characterized in that: include: Data standards module, used to import international trade data standards; A data mapping module, used to perform data mapping on the original business data based on the international trade data standard, and convert the original business data into standardized business data; A quality management module, used to formulate data quality inspection rules and data quality inspection indicators according to the international trade data standards; The quality inspection module is used to regularly perform quality inspection and evaluation on the standardized business data according to the data quality inspection rules and the data quality inspection indicators, and generate a quality evaluation report.

9. An electronic device, characterized in that: The method comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: Program instructions are stored thereon, and when the program instructions are executed, the method according to any one of claims 1 to 7 is implemented.

Images