A data import method, device, equipment and medium
By automatically identifying and updating newly added fields in the data import template during the data flow process, the high cost and low efficiency caused by manual processing in existing technologies are solved, achieving high efficiency and accuracy in data flow.
Patent Information
- Application Number
- CN202111081389.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-15
- Publication Date
- 2025-10-21
- Estimated Expiration
- 2041-09-15
AI Technical Summary
In the process of business data flow, existing technologies require manual reset of data import templates and rules when business changes occur, resulting in high data import costs and low efficiency, which affects business progress.
By matching the data fields of the data to be imported with the data fields of the target import template, and using a preset field library for semantic analysis, the system automatically identifies and updates new fields in the target import template, thus achieving automatic matching and updating of data fields.
It improved the efficiency of data flow between different business units, reduced data flow costs, avoided data import errors, and ensured the accuracy and efficiency of data interaction.
Smart Images

Figure CN113849506B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present invention relate to the field of computer technology, and in particular to a data import method, apparatus, device, and medium. Background Art
[0002] To advance business, business data is often transferred between different business parties involved in business interactions. This involves importing data from the data source to the data connection partner. To efficiently import data, a data import template matching the imported data is typically created on the data connection partner, allowing data to be directly imported into the template.
[0003] However, in the process of implementing the present invention, it was found that there are at least the following technical problems in the existing technology: when the business changes, the fields of the business data will also change accordingly, and the business system operator of the data docking business party will need to reset the data import template and import rules, which will increase the data import cost and the data import efficiency will be low, which will also affect the business process. Summary of the Invention
[0004] Embodiments of the present invention provide a data import method, apparatus, device, and medium to automatically modify data import template fields, improve data flow efficiency between different business parties, and reduce data flow costs.
[0005] In a first aspect, an embodiment of the present invention provides a data import method, the method comprising:
[0006] Obtaining the data to be imported from the data source system, and matching the data fields of the data to be imported with the data fields of the target import template;
[0007] When the data fields of the data to be imported contain newly added fields that are not included in the data fields of the target import template, the newly added fields are analyzed and matched with the field names and the attribute description information corresponding to the field names in the preset field library;
[0008] When a field to be updated corresponding to the newly added field is matched in the preset field library, the target import template is updated according to the field to be updated, and the data to be imported is imported into the updated target import template.
[0009] In a second aspect, an embodiment of the present invention further provides a data import device, the device comprising:
[0010] A template field matching module is used to obtain the data to be imported from the data source system and match the data fields of the data to be imported with the data fields of the target import template;
[0011] A field update identification module is used to analyze and match the newly added fields with the field names and attribute descriptions corresponding to the field names in the preset field library when the data fields of the data to be imported contain newly added fields that are not included in the data fields of the target import template;
[0012] The template update and data import module is used to update the target import template according to the field to be updated when a field to be updated corresponding to the newly added field is matched in the preset field library, and import the data to be imported into the updated target import template.
[0013] In a third aspect, an embodiment of the present invention further provides a computer device, comprising:
[0014] one or more processors;
[0015] a memory for storing one or more programs;
[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement a data import method provided by any embodiment of the present invention.
[0017] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a data import method as provided in any embodiment of the present invention.
[0018] The embodiments of the above invention have the following advantages or beneficial effects:
[0019] The embodiment of the present invention, during the process of importing the data to be imported into the data source system, identifies and matches the data fields of the data to be imported with the data fields of the target import template; when the data fields of the data to be imported contain newly added fields that are not included in the data fields of the target import template, automatically analyzes and matches the newly added fields with the field names in the preset field library and the attribute description information corresponding to each field name; and matches the updated fields corresponding to the newly added fields in the preset field library, updates the target import template, and finally imports the data to be imported into the updated target import template. This solves the problem of high cost and low efficiency of business data import caused by manual processing of changes in the data import relationship corresponding to business data of the business system in the prior art, realizes automatic modification of data import template fields, improves data flow efficiency between different business parties, and reduces data flow costs. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 This is a flow chart of a data import method provided in Example 1 of the present invention;
[0021] Figure 2This is a flow chart of a data import method provided by Embodiment 2 of the present invention;
[0022] Figure 3 This is a schematic diagram of a data field adding interface provided by the second embodiment of the present invention;
[0023] Figure 4 This is a flow chart of a data import method provided by Embodiment 3 of the present invention;
[0024] Figure 5 This is a schematic diagram of a data import template creation interface provided by the third embodiment of the present invention;
[0025] Figure 6 This is a schematic diagram of binding a data import template and a data source system provided by the third embodiment of the present invention;
[0026] Figure 7 This is a schematic diagram of a basic attribute setting interface for a data import template provided in the third embodiment of the present invention;
[0027] Figure 8 This is a schematic diagram of setting data template import rules provided by the third embodiment of the present invention;
[0028] Figure 9 This is a schematic diagram of a data field attribute setting interface provided by the third embodiment of the present invention;
[0029] Figure 10 This is a structural diagram of a data import device provided by the fourth embodiment of the present invention;
[0030] Figure 11 This is a structural diagram of a computer device provided in Example 5 of the present invention. DETAILED DESCRIPTION
[0031] The present invention will be further described in detail below with reference to the accompanying drawings and examples. It will be understood that the specific embodiments described herein are intended only to illustrate the present invention and are not intended to limit the present invention. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions relevant to the present invention, not all structures.
[0032] Example 1
[0033] Figure 1 This is a flowchart of a data import method provided in Example 1 of the present invention. This embodiment is applicable to data transmission between two systems with business interactions. The method can be performed by a data import device, which can be implemented using software and / or hardware and integrated into a computer device with application development capabilities.
[0034] like Figure 1 As shown, the data import method includes the following steps:
[0035] S110 , obtaining data to be imported from a data source system, and matching data fields of the data to be imported with data fields of a target import template.
[0036] The data source system and the system that receives the imported data from the data source are two systems that interact with each other in terms of business operations. Business data typically flows between different systems based on business processes to complete business processing. For example, in the e-commerce business, item order data from the retail system passes through the payment system, warehouse system, and logistics system. During the item sales process, the corresponding business data flows between different business systems based on the progress of the business.
[0037] The data to be imported is usually presented in the form of a database table, with each column representing a data field, which represents an attribute in the data table. Each row in the data table is called a data "record", and each record contains all the attribute information in this row. The data fields of the data to be imported are attributes related to the business link where the data source system is located. During the entire business process, the data fields of the data to be imported when each business system acts as a data source system may contain common attributes or different attribute information. For example, after receiving the data imported by its upstream business system as a data source system, the downstream business system adds a new data field to the data, and when the downstream business system acts as a data source system, it transmits the business data after the newly added data field downward to the downstream business system of the downstream business system.
[0038] The target import template is a personalized import template set according to the business requirements of the data source system. The target import template contains pre-selected business-related data fields. The target import template can establish an association relationship with the data source system through numbering or naming. When the business settings processed by the data source system have different business categories, different personalized import templates can be set for different categories of business and distinguished by corresponding template identifiers. When importing data, the target import template can be automatically matched and selected based on the identifier of the data source system and the business type corresponding to the data to be imported, or the user's selection of the data to be imported and the template can be received to determine the corresponding data to be imported and the target import template.
[0039] S120. When the data fields of the data to be imported include newly added fields that are not included in the data fields of the target import template, the newly added fields are analyzed and matched with the field names and attribute description information corresponding to the field names in the preset field library.
[0040] During the process of matching the data fields of the data to be imported with the data fields of the target import template, if any inconsistency is found between the two, the data to be imported cannot be directly imported smoothly. It is necessary to check whether the target import template is correct and adjust the template to match the data fields of the data to be imported.
[0041] When the data fields of the to-be-imported data contain newly added fields that are not included in the data fields of the target import template, this indicates that the business data attributes in the data source system have changed, but the corresponding data import template has not been updated accordingly. Compared to the conventional inefficient template update method in which the user learns about the attribute changes of the to-be-imported data and then modifies the import template, this embodiment analyzes and matches the newly added fields with the field names and corresponding attribute descriptions in the preset field library to determine the fields to be updated that correspond to the newly added fields.
[0042] Specifically, the attribute description information corresponding to each field name is added when setting up data fields in the data import system. This information includes a description of the field's usage scenario and an explanation of its specific meaning within that scenario. For example, when the data to be imported is item shipping data, the same attribute may have different meanings for different item categories (such as medicine, clothing) or different modes of transportation (such as land, sea, and air). For example, packaging specifications or shipping restrictions may differ in different scenarios, requiring additional notes to further describe the information. By performing semantic analysis on the field names and attribute descriptions corresponding to each field name in the pre-set field library, the fields to be updated are determined, avoiding field usage errors caused by simple text matching. In some cases, data fields in the data source system and the data import system may have the same field names but different business meanings. Directly updating the target import template based on the field name matching results can introduce corrupted data into the data import system, leading to incorrect operational instructions and impacting the business operation of the data entry system. Semantic field matching, however, allows newly added fields to be matched to fields with the same meaning to be updated.
[0043] During the semantic matching process, the newly added fields and the field names in the preset field library as well as the corresponding attribute description information of each field name will be segmented, and the importance of the segmentation results will be scored. Then, the semantic analysis and matching process will be completed based on the preset algorithm network. Finally, the data field with the highest semantic match with the newly added field will be used as the field to be updated.
[0044] S130. When a field to be updated corresponding to the newly added field is matched in the preset field library, the target import template is updated according to the field to be updated, and the data to be imported is imported into the updated target import template.
[0045] After matching the fields to be updated with semantically similar fields to the newly added fields, you can directly update the fields to the target import template to update the target import template. Then, the data to be imported is imported into the corresponding columns (i.e., data fields) of the target import template in columns.
[0046] The technical solution of this embodiment is to identify and match the data fields of the to-be-imported data with the data fields of the target import template during the process of importing the to-be-imported data into the data source system; when the data fields of the to-be-imported data contain newly added fields that are not included in the data fields of the target import template, automatically analyze and match the newly added fields with the field names and attribute description information corresponding to each field name in the preset field library; and match the to-be-updated fields corresponding to the newly added fields in the preset field library, update the target import template, and finally import the to-be-imported data into the updated target import template. This solves the problem of high cost and low efficiency of business data import caused by manual processing of changes in the data import relationship corresponding to business data in the business system in the prior art, realizes automatic modification of data import template fields, improves the efficiency of data flow between different business parties, and reduces data flow costs. In addition, the method of matching the to-be-imported fields based on semantic analysis effectively avoids data import errors caused by the same field names but different specific meanings or usage scenarios between two systems with data interaction.
[0047] Example 2
[0048] Figure 2 This is a flowchart of a data import method provided in Example 2 of the present invention. This embodiment shares the same inventive concept as the data import method in the previous embodiment and further describes the process of updating the data import template during data import. This method can be executed by a data import device, which can be implemented in software and / or hardware and integrated into a computer device with application development capabilities.
[0049] like Figure 2 As shown, the data import method includes the following steps:
[0050] S210: Acquire the data to be imported from the data source system, and match the data fields of the data to be imported with the data fields of the target import template.
[0051] S220. When the data fields of the data to be imported include newly added fields that are not included in the data fields of the target import template, the newly added fields are analyzed and matched with the field names and attribute description information corresponding to the field names in the preset field library.
[0052] For steps S210 - S220 , reference may be made to the relevant contents described in the above embodiment.
[0053] S230: When a field to be updated corresponding to the newly added field is matched in the preset field library, the newly added field is displayed on the target import template creation interface.
[0054] In this embodiment, after semantic analysis is performed on the field names and attribute description information corresponding to the newly added fields and the preset field library, and the fields to be updated are determined, the fields to be updated are not directly updated to the target import template. Instead, the matched fields to be updated (i.e., table attributes) are displayed on the template field adding interface (attribute adding interface) when creating the target import template, as shown in the following example. Figure 3 shown.
[0055] exist Figure 3 In the template, the list of optional attributes on the left shows all fields in the preset field database, while the selected attributes on the right are the fields to be updated, which are matched after semantic analysis. Displaying the fields to be updated on the template field addition page allows users to directly and quickly understand the field matching results and confirm the matching results.
[0056] S240: When a field update confirmation instruction is received in the target import template creation interface, the target import template is updated according to the field to be updated.
[0057] When the user confirms that the automatically matched fields to be updated are correct, a field update confirmation instruction will be issued, and the data import system will update the target import template based on the field update confirmation instruction.
[0058] Preferably, in one embodiment, a field editing entry is provided in the template field adding interface. If the user finds that the matched field to be updated is incorrect, they can issue an update field editing command to directly edit and modify it. Then, after confirming the modification, they can issue a field update confirmation command to complete the update of the target import template.
[0059] S250: Import the data to be imported into the updated target import template.
[0060] After the template is updated, a new mapping relationship can be established between the data fields in the to-be-imported data and the updated data fields to achieve a one-to-one correspondence between the data fields. The to-be-imported data can be directly imported into the updated target import template.
[0061] The technical solution of this embodiment is to identify and match the data fields of the data to be imported with the data fields of the target import template during the process of importing the data to be imported into the data source system; when the data fields of the data to be imported contain new fields that are not included in the data fields of the target import template, automatically analyze and match the new fields with the field names in the preset field library and the attribute description information corresponding to each field name; and display the updated fields that are matched to the new fields in the preset field library in the template field adding interface, update the target import template after user confirmation, and finally import the data to be imported into the updated target import template. By adding a confirmation mechanism, the accuracy of the fields to be updated is further guaranteed. It solves the problem of high cost and low efficiency of business data import caused by manual processing of changes in data import relationships corresponding to business data of the business system in the prior art, and realizes accurate automatic modification of data import template fields, improves data flow efficiency between different business parties, and reduces data flow costs. Example Three
[0062] Figure 4 This is a flowchart of a data import method provided in Example 3 of the present invention. This embodiment, which shares the same inventive concept as the data import method in the previous embodiment, further describes the process of pre-establishing a data import template. This method can be executed by a data import device, which can be implemented in software and / or hardware and integrated into a computer device with application development capabilities.
[0063] like Figure 4 As shown, the data import method includes the following steps:
[0064] S310. According to the template creation instruction, based on the fields in the preset field library, a target import template that matches the preset data source system is pre-established.
[0065] Specifically, in the process of creating the target import template, first, Figure 5 The data import template (attribute set) creation page shown in the figure is used to create a new template (attribute set). On this page, you can set the fields of the attribute set (i.e., the identifier in the data import system), the attribute set name, the general properties of the attribute set, and the notes of the attribute set. After setting, you can save the data and exit the interface. Among them, setting the general properties of the attribute set is to determine whether the newly established attribute set can be placed in the template library in the data import system, searched and used by other data source systems, or to stipulate that the newly established attribute set can only be seen and used by the associated data source system. After the new attribute set is established, you need to add attributes to the attribute set. You can do this in the following ways: Figure 3 In the attribute adding interface shown, select the corresponding attribute from the preset field (attribute) library and add it to the attribute set. Furthermore, you can associate and bind the newly created attribute set with the corresponding data source system. Figure 6 The process shown in Figure 6 In the Attribute Set Library, you can select a newly created attribute set, then select the corresponding data source system for the attribute set. Saving the associated binding completes the setup. For example, if you want to associate the data source system named System 1 with the selected attribute set - Test Attribute Set, when selecting an attribute set (i.e., importing a template), you can select the corresponding attribute set in the list of available attribute sets and click the "Move to Right" control to complete the selection. The selected attribute set will be added to the list of selected attribute sets on the right. Undoing a selection requires the reverse process.
[0066] Furthermore, after creating a new attribute set, you can also set parameters for the attribute set, such as the data reading method and data import rules of the attribute set. Figure 7 The diagram of the basic property setting interface of the import template is as follows. On this interface, you can set the data source, import function type, reading method, column name source, import range and template notes corresponding to the template name. When setting template import rules, you can refer to Figure 8 In the interface shown, you can choose whether to export and display all fields in the imported template, and whether to directly import default values when exporting. Figure 8 In the settings interface, the display of the default value option depends on the default value setting of each data field in the import template when it is created. When the data field is set with a default value, Figure 8 The default value options will be displayed accordingly. Data fields are pre-set by the data import system for selection by various data source systems. The setting page can be referred to Figure 9 The page shown in the figure can be used to set parameters including field identifier, field name, field data type, field input type, field display label, whether the field is required, whether the field can be modified, whether the field can be queried, whether the field is an audit field, field attribute notes, and field default value. Accordingly, in the process of setting template parameters, the data import system will identify the attribute setting information of the data field selected from the preset field library into the target import template. When the attribute setting information includes a default value attribute, the import rule setting interface of the target import template will provide a default value export setting option corresponding to the data field containing the default value attribute to obtain the import rule setting information of the target import template and complete the establishment of the target import template.
[0067] S320: Acquire the data to be imported from the data source system, and match the data fields of the data to be imported with the data fields of the corresponding target import template.
[0068] When importing data, the target import template can be automatically matched and selected based on the identification of the data source system and the business type corresponding to the data to be imported, or the corresponding data to be imported and target import template can be determined by receiving the user's selection of the data to be imported and the template.
[0069] S330. When the data fields of the data to be imported include newly added fields that are not included in the data fields of the target import template, the newly added fields are analyzed and matched with the field names and attribute description information corresponding to the field names in the preset field library.
[0070] S340. When a field to be updated corresponding to the newly added field is matched in the preset field library, the target import template is updated according to the field to be updated, and the data to be imported is imported into the updated target import template.
[0071] The technical solution of this embodiment pre-sets a personalized data import template that matches the data source system. Then, during the process of importing the data to be imported into the data source system, the data fields of the data to be imported are identified and matched with the data fields of the target import template. When the data fields of the data to be imported contain new fields that are not included in the data fields of the target import template, the new fields are automatically analyzed and matched with the field names and attribute descriptions corresponding to the field names in the preset field library. The fields to be updated corresponding to the new fields in the preset field library are matched, the target import template is updated, and finally the data to be imported is imported into the updated target import template. This solves the problems of high cost and low efficiency of business data import caused by manual data import processing in the prior art and changes in the data import relationship between business data in the business system, and realizes automatic modification of data import template fields, improves the efficiency of data flow between different business parties, and reduces data flow costs.
[0072] Furthermore, in a specific application scenario, the data import method can be applied to the field of e-commerce business, such as the logistics transaction fulfillment system. Taking the commodity management background in the logistics scenario as an example, the commodity management background of the logistics company is the data import system, and the systems of the commodity sales merchants who have logistics business with the logistics party are the data source systems for the data to be imported. In the warehousing and distribution business, commodities are the main body of business flow, and unified commodity information is provided to multiple systems for full-process fulfillment delivery, such as the front-end sales platform, orders, inventory, warehousing system, billing system, customs declaration, big data, etc. Therefore, there are many types of commodity attributes and the corresponding number of attributes is greater. The data import method described in any embodiment of the present invention can be used to import data from the merchant data source system into the data import system of the logistics company. Due to differences in commodity types, specifications and transportation requirements, a merchant can set different import templates according to the classification of the commodity. The attributes (fields) that may be included in the import template include specification information, commodity model number, commodity classification code, place of origin, brand name and shelf life, etc., and the corresponding attributes can be set according to the corresponding business needs.
[0073] The following is an embodiment of a data import device provided by an embodiment of the present invention. This device and the data import methods of the aforementioned embodiments are based on the same inventive concept and can implement the data import methods of the aforementioned embodiments. For details not fully described in the embodiment of the data import device, reference can be made to the embodiment of the aforementioned data import method.
[0074] Example 4
[0075] Figure 10 This is a structural diagram of the data import device provided in Example 4 of the present invention. This embodiment is applicable to the situation where data is transmitted between two systems with business interaction. The device can be implemented by software and / or hardware and integrated into a computer device with application development capabilities.
[0076] like Figure 10 As shown, the data importing device includes: a template field matching module 410, a field update identification module 420 and a template update and data importing module 430.
[0077] Among them, the template field matching module 410 is used to obtain the data to be imported from the data source system and match the data fields of the data to be imported with the data fields of the target import template; the field update identification module 420 is used to analyze and match the newly added fields with the field names and attribute description information corresponding to each field name in the preset field library when the data fields of the data to be imported contain newly added fields that are not included in the data fields of the target import template; the template update and data import module 430 is used to update the target import template according to the field to be updated when the field to be updated corresponding to the newly added field is matched in the preset field library, and import the data to be imported into the updated target import template.
[0078] The technical solution of this embodiment is to identify and match the data fields of the data to be imported with the data fields of the target import template during the process of importing the data to be imported into the data source system; when the data fields of the data to be imported contain new fields that are not included in the data fields of the target import template, automatically analyze and match the new fields with the field names in the preset field library and the attribute description information corresponding to each field name; and match the updated fields corresponding to the new fields in the preset field library, update the target import template, and finally import the data to be imported into the updated target import template. This solves the problem of high cost and low efficiency of business data import caused by manual processing of changes in the data import relationship corresponding to business data in the business system in the prior art, realizes automatic modification of data import template fields, improves the efficiency of data flow between different business parties, and reduces data flow costs.
[0079] Optionally, the field update identification module 320 is specifically configured to:
[0080] Perform semantic analysis on the newly added fields and the field names in the preset field library and the attribute description information corresponding to each field name;
[0081] The data field in the preset field library that has the highest semantic matching degree with the newly added field is used as the field to be updated.
[0082] Optionally, the template updating and data importing module 330 specifically includes:
[0083] A new field identification submodule is used to display the new field on the target import template creation interface when a field to be updated corresponding to the new field is matched in the preset field library;
[0084] A new field confirmation submodule is added, which is used to update the target import template according to the field to be updated when a field update confirmation instruction is received in the target import template creation interface.
[0085] Optionally, the template updating and data importing module 330 further includes:
[0086] A new field editing submodule is added to obtain the editing instruction of the field to be updated, and edit and update the field to be updated according to the editing instruction of the field to be updated.
[0087] Optionally, the data importing device further includes:
[0088] The template creation module is used to pre-establish a target import template that matches the data source system based on the fields in the preset field library according to the template creation instruction.
[0089] Optionally, the template creation module is specifically used to:
[0090] Identifying attribute setting information of a data field selected from the preset field library and imported into the target import template;
[0091] When the attribute setting information includes a default value attribute, a default value export setting option corresponding to the data field containing the default value attribute is provided in the import rule setting interface of the target import template to obtain the import rule setting information of the target import template and complete the establishment of the target import template.
[0092] Optionally, the attribute setting information includes at least one of field identifier, field name, field data type, field input type, field display label, whether the field is required, whether the field is modifiable, whether the field is queryable, whether the field is an audit field, field attribute remarks and field default value.
[0093] The data import device provided in the embodiment of the present invention can execute the data import method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.
[0094] Example 5
[0095] Figure 11 A schematic diagram of the structure of a computer device provided in Example 4 of the present invention. Figure 11 A block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention is shown. Figure 11 The computer device 12 shown is only an example and should not limit the functionality and scope of use of the embodiments of the present invention. The computer device 12 can be any terminal device with computing capabilities, such as an intelligent controller, a server, a mobile phone, or other terminal devices.
[0096] like Figure 11As shown, computer device 12 is implemented as a general-purpose computing device. Components of computer device 12 may include, but are not limited to, one or more processors or processing units 16, system memory 28, and a bus 18 that connects various system components (including system memory 28 and processing unit 16).
[0097] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. Examples of these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MAC) bus, an Enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.
[0098] The computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 12, including volatile and non-volatile media, removable and non-removable media.
[0099] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be configured to read and write non-removable, non-volatile magnetic media ( Figure 11 Not shown, often called a "hard drive"). Although Figure 11 Not shown, a magnetic disk drive for reading and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. System memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of various embodiments of the present invention.
[0100] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may include an implementation of a network environment. Program modules 42 generally perform the functions and / or methods of the embodiments described herein.
[0101] The computer device 12 may also communicate with one or more external devices 14 (e.g., a keyboard, a pointing device, a display 24, etc.), one or more devices that enable a user to interact with the computer device 12, and / or any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface 22. Furthermore, the computer device 12 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 20. As shown, the network adapter 20 communicates with the other modules of the computer device 12 via the bus 18. It should be understood that although Figure 11 Not shown, other hardware and / or software modules may be used in conjunction with computer device 12, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0102] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing the data import method provided in the embodiment of the present invention, which includes:
[0103] Obtaining the data to be imported from the data source system, and matching the data fields of the data to be imported with the data fields of the target import template;
[0104] When the data fields of the data to be imported contain newly added fields that are not included in the data fields of the target import template, the newly added fields are analyzed and matched with the field names and the attribute description information corresponding to the field names in the preset field library;
[0105] When a field to be updated corresponding to the newly added field is matched in the preset field library, the target import template is updated according to the field to be updated, and the data to be imported is imported into the updated target import template.
[0106] Example 6
[0107] This sixth embodiment provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, the data import method provided in any embodiment of the present invention is implemented, including:
[0108] Obtaining the data to be imported from the data source system, and matching the data fields of the data to be imported with the data fields of the target import template;
[0109] When the data fields of the data to be imported contain newly added fields that are not included in the data fields of the target import template, the newly added fields are analyzed and matched with the field names and the attribute description information corresponding to the field names in the preset field library;
[0110] When a field to be updated corresponding to the newly added field is matched in the preset field library, the target import template is updated according to the field to be updated, and the data to be imported is imported into the updated target import template.
[0111] The computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device.
[0112] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0113] Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
[0114] The computer program code for performing the operations of the present invention can be written in one or more programming languages, or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0115] Those skilled in the art will appreciate that the modules or steps of the present invention described above can be implemented using a general-purpose computing device. They can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they can be implemented using program code executable by a computer device, which can then be stored in a storage device and executed by the computing device. Alternatively, they can be fabricated into separate integrated circuit modules, or multiple modules or steps can be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
[0116] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the concept of the present invention. The scope of the present invention is determined by the scope of the appended claims.
Claims
1. A data import method, characterized in that: The method comprises: Obtaining the data to be imported from the data source system, and matching the data fields of the data to be imported with the data fields of the target import template; When the data fields of the data to be imported include newly added fields that are not included in the data fields of the target import template, the newly added fields are analyzed and matched with the field names in the preset field library and the attribute description information corresponding to each field name, wherein the attribute description information includes a description of the usage scenario of the field and an explanation of the specific meaning in the usage scenario; When a field to be updated corresponding to the newly added field is matched in the preset field library, the target import template is updated according to the field to be updated, and the data to be imported is imported into the updated target import template; The step of analyzing and matching the newly added fields with the field names and the attribute description information corresponding to the field names in the preset field library includes: Perform semantic analysis on the newly added fields and the field names in the preset field library and the attribute description information corresponding to each field name; The data field in the preset field library that has the highest semantic matching degree with the newly added field is used as the field to be updated.
2. The method according to claim 1, characterized in that When a field to be updated corresponding to the newly added field is matched in the preset field library, updating the target import template according to the field to be updated includes: When a field to be updated corresponding to the newly added field is matched in the preset field library, the newly added field is displayed on the target import template creation interface; When a field update confirmation instruction is received on the target import template creation interface, the target import template is updated according to the field to be updated.
3. The method according to claim 2, characterized in that Before the target import template creation interface receives a field update confirmation instruction, the method further includes: Obtain an editing instruction for the field to be updated, and edit and update the field to be updated according to the editing instruction for the field to be updated.
4. The method according to claim 1, wherein Before obtaining the data to be imported from the data source system, the method further includes: According to the template creation instruction, based on the fields in the preset field library, a target import template matching the data source system is pre-established.
5. The method according to claim 4, characterized in that The step of pre-establishing a target import template that matches the data source system based on the fields in the preset field library includes: Identifying attribute setting information of a data field selected from the preset field library and imported into the target import template; When the attribute setting information includes a default value attribute, a default value export setting option corresponding to the data field containing the default value attribute is provided in the import rule setting interface of the target import template to obtain the import rule setting information of the target import template and complete the establishment of the target import template.
6. The method according to claim 5, characterized in that The attribute setting information includes at least one of field identifier, field name, field data type, field input type, field display label, whether the field is required, whether the field is modifiable, whether the field is queryable, whether the field is an audit field, field attribute remarks and field default value.
7. A data import device, characterized in that: The device comprises: A template field matching module is used to obtain the data to be imported from the data source system and match the data fields of the data to be imported with the data fields of the target import template; a field update identification module configured to, when the data fields of the to-be-imported data include newly added fields that are not included in the data fields of the target import template, analyze and match the newly added fields with the field names and attribute descriptions corresponding to the field names in the preset field library, wherein the attribute descriptions include descriptions of the field usage scenarios and explanations of the specific meanings in the usage scenarios; A template updating and data importing module, configured to update the target import template according to the field to be updated when a field to be updated corresponding to the newly added field is matched in the preset field library, and import the data to be imported into the updated target import template; The field update identification module is specifically used to: Perform semantic analysis on the newly added fields and the field names in the preset field library and the attribute description information corresponding to each field name; The data field in the preset field library that has the highest semantic matching degree with the newly added field is used as the field to be updated.
8. A computer device, characterized in that: The computer device comprises: one or more processors; a memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the data import method according to any one of claims 1 to 6.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the data import method according to any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
A method and device for importing data in a service management software system
CN109271434A
Insurance service development method and device
CN110162300A
Data processing method and device
CN111831629A
Log analysis method and system based on dynamic field template
CN112632960A