Storage method and system based on multi-type data structure

Abstract

The invention discloses a storage method and system based on a multi-type data structure, and the method comprises the steps: responding to a file uploading operation, displaying a file uploading interface, and adding an input file and a data type into a storage list; and when a storage operation is triggered, checking a file name and a header format, and if the file name and the header format are correct, reading non-associated data and associated data in the file. Splitting the non-associated data to generate coded data; based on the association data and the component, an association mapping is established. And storing the coded data and the association mapping into a corresponding database table according to the data type. Therefore, the data structure does not need to be manually selected for data storage, the system automatically analyzes the data type of the imported file and selects the most suitable storage structure, the problem of low storage efficiency can be effectively solved, and storage errors are not prone to occurring.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a storage method and system based on multi-type data structures. Background Art

[0002] Currently, data processing and storage technologies generally use distributed and large-scale data platforms (such as Hadoop, Spark, cloud computing platforms, etc.) to process and display massive amounts of data. However, for smaller amounts of data, the use of big data architecture is often too complex and wastes resources. Since the needs for processing and displaying small amounts of data are highly specific and customized, the market usually conducts customized development based on specific data characteristics and display requirements.

[0003] In existing data processing systems, data storage often requires manual selection of data structures, resulting in low storage efficiency and prone to errors. Data correction requires database personnel to make corrections at the database level. This correction process may differ from the ideal state of business personnel. Due to the differences in technical and business perspectives between data personnel and business personnel, the coordination process is prone to errors and the timeliness of corrections is low. In the process of data presentation, it is usually necessary to read from a two-dimensional database and manually assemble it into different data presentation forms. This manual operation is not only inefficient, but also prone to errors. This manual selection is not only inefficient but also prone to errors. Summary of the invention

[0004] Based on the above-mentioned deficiencies of the prior art, the present application provides a storage method and system based on multi-type data structures to solve the problem of low efficiency brought about by the prior art.

[0005] In order to achieve the above objectives, this application provides the following technical solutions:

[0006] The first aspect of the present application provides a storage method based on a multi-type data structure, comprising:

[0007] In response to triggering a file upload operation in a menu bar in the data processing system, displaying a file upload interface;

[0008] According to the storage file entered in the file upload interface and its corresponding data type, the storage file is displayed in the storage list included in the file upload interface; wherein the storage file is pre-filled according to the template;

[0009] In response to triggering the storage operation in the file upload interface, obtaining the storage file;

[0010] Check whether the name and header format of the incoming file are correct;

[0011] If the name and header format of the input file are correct, read the non-associated data and associated data in the input file;

[0012] Splitting the non-associated data to obtain encoded data, and establishing an associative mapping based on the associated data and its corresponding components;

[0013] According to the data type of the input file, the encoded data and the associated mapping are stored in the type table corresponding to the database.

[0014] Optionally, in the above-mentioned storage method based on a multi-type data structure, before storing the encoded data and the associated mapping in a type table corresponding to a database according to the data type of the input file, it further includes:

[0015] Querying a database whether there is a data item that is consistent with the coded data and the associated mapping;

[0016] If there is a data item in the database that is consistent with the coded data and the associated mapping, the storage of the stored file is skipped and the failure information of the stored file is recorded.

[0017] If there is no data item consistent with the coded data and the associated mapping in the database, the coded data and the associated mapping are stored in the type table corresponding to the database according to the data type of the input file.

[0018] Optionally, in the above storage method based on multi-type data structure, it also includes:

[0019] In response to triggering a data correction operation in a menu bar in the data processing system, displaying a correction page;

[0020] According to the indicator number and the correction instruction entered on the correction page, querying the indicator data corresponding to the indicator number from the database;

[0021] Based on the correction indication and the data type corresponding to the indicator data, the indicator data is corrected to obtain valid data, and the indicator data in the database is updated to the valid data.

[0022] Optionally, in the above storage method based on multi-type data structure, it also includes:

[0023] When receiving a data display request sent by a user, obtaining the target indicator number included in the data display request;

[0024] Acquire the display data corresponding to the target indicator number from the database;

[0025] The display data is assembled by using preset codes to obtain assembled data, and the assembled data is visually displayed.

[0026] Optionally, in the above-mentioned storage method based on a multi-type data structure, after storing the encoded data and the associated mapping in a type table corresponding to a database according to the data type of the input file, the method further includes:

[0027] Preprocess each data according to the data type corresponding to each data in the database.

[0028] Optionally, in the above-mentioned storage method based on multi-type data structure, after checking whether the format of the name and the header of the stored file are correct, it also includes:

[0029] If the format of the name and header of the incoming file is found to be incorrect, a prompt message will be fed back to the front end.

[0030] A second aspect of the present application provides a storage system based on a multi-type data structure, including:

[0031] A first display unit, configured to display a file upload interface in response to triggering a file upload operation in a menu bar in the data processing system;

[0032] A second display unit is used to display the incoming files in the incoming list included in the file upload interface according to the incoming files typed in the file upload interface and their corresponding data types; wherein the incoming files are pre-filled according to the template;

[0033] A file acquisition unit, configured to acquire the stored file in response to triggering the storage operation in the file upload interface;

[0034] A verification unit, used to verify whether the name and header format of the incoming file are correct;

[0035] A reading unit, used for reading the non-associated data and associated data in the input file if the format of the name and the header of the input file are correct;

[0036] A splitting unit, configured to split the non-associated data to obtain coded data, and to establish an associated mapping based on the associated data and its corresponding components;

[0037] The storage unit is used to store the encoded data and the associated mapping in a type table corresponding to the database according to the data type of the input file.

[0038] Optionally, in the above storage system based on multi-type data structure, it also includes:

[0039] A query unit, used for querying whether there is a data item consistent with the coded data and the associated map in the database; wherein, when the query unit finds that there is no data item consistent with the coded data and the associated map in the database, the storage unit executes the data type of the input file to store the coded data and the associated map in the type table corresponding to the database;

[0040] A recording unit is used to skip the storage of the stored file and record the failure information of the stored file if there is a data item consistent with the encoded data and the associated mapping in the database.

[0041] Optionally, in the above storage system based on multi-type data structure, it also includes:

[0042] a third display unit, for displaying a correction page in response to triggering a data correction operation in a menu bar in the data processing system;

[0043] A data query unit, configured to query the indicator data corresponding to the indicator number from the database according to the indicator number and the correction instruction entered on the correction page;

[0044] A correction unit is used to correct the indicator data based on the correction indication and the data type corresponding to the indicator data to obtain valid data, and update the indicator data in the database to the valid data.

[0045] Optionally, in the above storage system based on multi-type data structure, it also includes:

[0046] A number acquisition unit, configured to, when receiving a data display request sent by a user, acquire a target indicator number included in the data display request;

[0047] A data acquisition unit, used to acquire display data corresponding to the target indicator number from the database;

[0048] The display unit is used to assemble the display data through preset codes to obtain assembled data, and visually display the assembled data.

[0049] Optionally, in the above storage system based on multi-type data structure, it also includes:

[0050] The preprocessing unit is used to preprocess each data in the database according to the data type corresponding to each data.

[0051] Optionally, in the above storage system based on multi-type data structure, it also includes:

[0052] The feedback unit is used to feed back prompt information to the front end if the format of the name and header of the incoming file is incorrect.

[0053] The present application provides a storage method based on a multi-type data structure, which displays a file upload interface in response to a file upload operation in a menu bar in a triggering data processing system, and then displays the stored file in a stored list contained in the file upload interface according to the stored file typed in the file upload interface and its corresponding data type, wherein the stored file is pre-filled according to a template, and then in response to the stored operation in the triggering file upload interface, the stored file is obtained, and then the name of the stored file and the format of the header are checked to see if they are correct. If the name of the stored file and the format of the header are correct, the non-associated data and the associated data in the stored file are read, and then the non-associated data are split to obtain the coded data, and based on the associated data and its corresponding components, an associated mapping is established, and finally, according to the data type of the stored file, the coded data and the associated mapping are stored in the type table corresponding to the database. Therefore, the storage of data no longer requires manual selection of the data structure, but the system automatically analyzes the data type of the imported file and selects the most suitable storage structure, which can effectively solve the problem of low storage efficiency and is not prone to storage errors. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0055] Figure 1 A flowchart of a storage method based on a multi-type data structure provided in an embodiment of the present application;

[0056] Figure 2 A schematic diagram of the structure of a header template provided in an embodiment of the present application;

[0057] Figure 3 A flowchart of a method for correcting data is provided for another embodiment of the present application;

[0058] Figure 4 A schematic diagram of the structure of an indicator system provided in an embodiment of the present application;

[0059] Figure 5 A flowchart of a data visualization method is provided for another embodiment of the present application;

[0060] Figure 6A schematic diagram of a data visualization structure provided in an embodiment of the present application;

[0061] Figure 7 A schematic diagram of the structure of a storage system based on multi-type data structures provided in another embodiment of the present application. DETAILED DESCRIPTION

[0062] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0063] In this application, relational terms such as first and second, etc. are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0064] The present application embodiment provides a storage method based on multi-type data structure, such as Figure 1 As shown, the specific steps include:

[0065] S101. In response to triggering a file upload operation in a menu bar in a data processing system, display a file upload interface.

[0066] Specifically, when the user selects a template from multiple templates provided by the front-end database to fill in the file of the stored data, he can click the file upload function in the menu bar contained in the data processing system, so that the data processing system will respond to the user's file upload operation on the front-end, and then display the file upload interface to the user.

[0067] In addition, the header level of the database template filled in by the user on the front end can be dynamically adjusted according to the actual needs of the user. The data can be divided into multi-level headers. There are usually multiple first-level headers, and the second-level header is regarded as the included content of the first-level header, and so on. The database configuration template and the corresponding header information in the template and other data are queried according to the selected template. The template information includes the number of header rows and columns, the sheet page name and the header column content. The template is generated according to the template information. If it contains map linkage data, the template will give an example in this column, such as: company location, XX Township | XX Town. At the same time, a code value table of Hebei Province (5 levels of province, city, county, village and township) will be attached after the template sheet page for reference. For details, please refer to the header template. Figure 2 The content shown.

[0068] S102. According to the input files entered in the file upload interface and their corresponding data types, the input files are displayed in the input list included in the file upload interface.

[0069] Among them, the storage file is filled in in advance according to the template.

[0070] It should be noted that when the user clicks the upload button on the file upload interface, the user can first check the incoming file on the file upload interface to ensure the format, quality and integrity of the data, and then transfer the library file and select the data type corresponding to the incoming file on the file upload interface for uploading.

[0071] After uploading the incoming files, the system will display them in the incoming list contained in the file upload interface, so that users can select the files to be uploaded in the incoming list for upload (the incoming files in the incoming list can be selected in batches).

[0072] In addition, the selectable data types are a systematic analysis of all commonly used data display types in advance, which are classified into four categories: kv\list\json\multidimensional. Optionally, the data types can be expanded later according to needs.

[0073] S103: In response to triggering the storage operation in the file upload interface, obtain the storage file.

[0074] Specifically, when the files to be stored are displayed in the storage list, the user can select the files to be stored in the file upload interface, and then click the "Store Button" so that the system can perform data reading and data storage operations.

[0075] It can be understood that in the embodiment of the present application, file uploading and file storage are divided into two steps to avoid errors after uploading, thereby reducing errors in storage operations.

[0076] S104. Check whether the name and header format of the incoming file are correct.

[0077] It should be noted that after the storage file is uploaded to the system, the system needs to check the storage file before storing it. Therefore, it will check whether the name and header format of the storage file are correct, so as to avoid storage failure operations that do not conform to the configuration template. Therefore, if the name and header format of the storage file are correct, it means that the storage file conforms to the configuration template, so step S105 is executed.

[0078] Optionally, after executing step S104, the method further includes:

[0079] If the format of the name and header of the inspection incoming file is incorrect, a prompt message will be fed back to the front end.

[0080] It is understandable that when the format of the name and header of the inspection file is incorrect, the system will not be able to recognize the file. At this time, the front-end will feedback a prompt message, which is used to prompt the user to upload using the specified template.

[0081] Optionally, if an error occurs during the process of importing files, the system log will record the entire process, so if the import fails, you can view the failure information.

[0082] S105, reading the non-associated data and associated data in the stored file.

[0083] Specifically, when the name and header format of the incoming file are correct, it indicates that the incoming file can be stored in the database. Therefore, non-associated data and associated data will be read from the incoming file at this time, so that the system can correctly use these data in subsequent database operations, queries and analyses to support the normal operation of the business.

[0084] Among them, non-related data: data that is not directly related to other data tables or records.

[0085] Related data: Data that has a dependency relationship with other data tables or records, usually needs to be linked with the data in other tables through certain related fields (such as ID, foreign key, etc.).

[0086] S106: Split the non-associated data to obtain encoded data, and establish an associated mapping based on the associated data and its corresponding components.

[0087] It should be noted that after reading the data, the system will split the non-related data into system-internal codes to facilitate system processing, especially mapping it to a reusable coding system. Specifically, for non-related data, especially fields containing a large number of categories or attributes (such as product categories, brands, regions, etc.), you can create coding rules to convert these text or other formats of data into standardized coding forms. For example: Category coding: Map the text data in the "Product Category" field (such as "Electronic Products", "Household Supplies") to digital codes (such as 1, 2, etc.). Date coding: Convert date data into digital format, such as "December 23, 2024" can be converted to "20241223".

[0088] Custom coding: For example, assign a unique ID value to the "customer name" based on the frequency of occurrence, or generate an ID based on certain business rules. Specific methods of splitting include: Column splitting: Split multiple pieces of information in a field into multiple fields. For example, the "address" field can be split into "province", "city", and "district". Code mapping: For data that needs to be mapped to a code, the original data is replaced with the corresponding code value through the pre-defined coding rules.

[0089] And an association mapping will be established for the associated data and its corresponding components, so that cross-table data query and integration can be realized through the mapping of associated data, ensuring the correct linkage between data. Specifically, first, analyze the association structure between associated data. Common association relationships include: one-to-many: for example, a customer can have multiple orders. Many-to-many: for example, the relationship between students and courses, multiple students can take multiple courses. One-to-one: for example, the relationship between employees and work numbers, one employee corresponds to a unique work number, and then based on the preset association mapping rules, data integration and storage are performed. Specific methods may include: Merge components: In some scenarios, components of associated data (such as customer information, order information, product information, etc.) need to be merged into a complete record or data set in different systems or databases to facilitate subsequent use and analysis, so that the data can be more structured and standardized, thereby improving system performance and data consistency.

[0090] Optionally, before storing the incoming file into the database, in order to avoid storing duplicate data in the database, thereby wasting storage resources, after executing step S106 and before step S107, another embodiment of the present application provides a data duplication checking method, which specifically includes the following steps:

[0091] Query the database to see if there is a data item that is consistent with the coded data and associated mapping.

[0092] Specifically, in order to avoid duplicate storage of data, thereby improving storage efficiency, reducing data redundancy, and saving storage space, the database will be queried according to each area and indicator number in the database to see whether there are data items that are consistent with the coded data and the associated mapping. Therefore, if there are data items that are consistent with the coded data and the associated mapping in the database, it means that the coded data and the associated mapping are duplicate data, so the storage of the storage file corresponding to the coded data and the associated mapping can be skipped, and the failure information of the storage file can be recorded, so that the reason for the failure of the subsequent duplicate storage can be checked with the recorded log.

[0093] Furthermore, if there is no data item consistent with the coded data and the associated mapping in the database, it means that the coded data and the associated mapping are not duplicate data, so the storage operation can be performed, that is, step S107 is executed.

[0094] S107. According to the data type of the input file, the coded data and the associated mapping are stored in the type table corresponding to the database.

[0095] It is understandable that in the database, in order to facilitate data management, the data will be stored in the corresponding type table according to the data type. Therefore, when the data meets the storage conditions, the encoded data and the associated mapping will be stored in the corresponding type table of the database according to the data type of the storage file, which will help ensure data consistency, reduce redundancy, improve query performance, and provide support for data expansion and maintenance.

[0096] Optionally, after the data is stored in the database, the system will pre-process the stored data to ensure the integrity and consistency of the data in the database. Therefore, after executing step S107, another embodiment of the present application provides a data pre-processing method, which specifically includes:

[0097] Preprocess each data according to the data type corresponding to each data in the database.

[0098] Specifically, the system will preprocess the data according to the data type of each data, thereby eliminating problems in the data and providing a reliable basis for subsequent data analysis. The preprocessing method can be data cleaning by removing duplicates (ensuring data uniqueness), supplementing missing values ​​(using 0 filling, mean, median, etc.), correcting erroneous data (such as date format, value out of range, etc.), standardization (such as date format unification, value retention of decimal places, etc.), and then assembling data structures such as kv\json and storing them in the warehouse.

[0099] For example, the preprocessing example of kv data type:

[0100] {"INDEX_CODE":"hb001","INDEX_CODE":"32"}

[0101] For the preprocessing example of json data type:

[0102] {"yAxis":["HB009003"],"xAxis":["primary school","junior high school","senior high school","college and above"],"series":{"yAxis[0]":["22824","22768","22786","22824"]}}.

[0103] Optionally, after the data is successfully stored in the database, the user can also modify the stored data according to his / her needs. Therefore, in another embodiment of the present application, the stored data can also be modified. Optionally, Figure 3 As shown, another embodiment of the present application provides a method for correcting data, comprising the following steps:

[0104] S301 . In response to triggering a data modification operation in a menu bar in a data processing system, display a modification page.

[0105] It can be understood that the embodiment of the present application, by establishing a visual online correction page, displays the structured data stored in the database in a business rather than a technical manner for online modification of the page. Therefore, when the user has a correction demand, the data correction operation in the menu bar in the data processing system can be triggered, and the system will display the correction page to the user, so that the user can find the data that he needs to correct on the correction page.

[0106] S302: According to the indicator number and the correction instruction entered on the correction page, query the indicator data corresponding to the indicator number from the database.

[0107] It should be noted that before modifying the data, the user needs to write the indicator number and modification instructions in the input box provided on the modification page so that the system can find the corresponding data from the database based on the indicator number for the user to modify.

[0108] Optionally, after the data is stored in the database, the system will assign a unique indicator number to the newly stored data in the database, and send the indicator number to the corresponding user so that the user can perform corresponding operations based on the indicator number.

[0109] In addition, users build indicator systems based on page requirements, such as Figure 4 The indicators and data templates displayed in the data import and display relationship are established through the indicator name, and the import data template is defined. When importing, it will match the table header name in Excel and the configured indicators. External interface data import can directly establish the data and display relationship.

[0110] S303: Based on the correction instruction and the data type corresponding to the indicator data, the indicator data is corrected to obtain valid data, and the indicator data in the database is updated to the valid data.

[0111] Specifically, a correction instruction refers to a modification rule or requirement provided by a user for storing data. Correction instructions may include: modifying the value of data, deleting data or records, supplementing missing data, correcting data format, and correcting data type errors, etc. Then, the indicator data is modified according to the correction instruction and data type. If the correction instruction requires updating the value, the data is modified directly. If a record is required to be deleted, the record is removed from the data set, and during the correction process, the integrity of the data needs to be ensured. For example, some fields may require non-empty values. If the data is missing, it needs to be corrected by filling, extrapolating, or other means. Finally, the indicator data in the database is updated to the corrected indicator data to ensure the correctness of the data.

[0112] Optionally, after the data is successfully stored in the database, the user can also visualize the data in the database, so optionally, Figure 5 As shown, another embodiment of the present application provides a method for visualizing data, which specifically includes the following steps:

[0113] S501. When receiving a data display request sent by a user, obtain a target indicator number included in the data display request.

[0114] It should be noted that the data display of the embodiment of the present application is divided into background management end data display and user end data display. Among them, the management end data display is the data displayed in a table form, and the associated information is the system code, including: indicator code, indicator name, and indicator corresponding data. The user end data display is the front end requesting the background data through the fixed system code of the page, and the data is assembled into a specific data format and data content through the name of the fixed code. Therefore, when the system receives the sent data display request, it will then obtain the target indicator number in the data display request package, so as to subsequently find the corresponding display data from the database.

[0115] In addition, the embodiments of the present application also involve permission access, which controls the database through resource permissions and data range permissions.

[0116] S502: Obtain display data corresponding to the target indicator number from the database.

[0117] S503: Assemble the display data through preset codes to obtain assembled data, and visualize the assembled data.

[0118] Specifically, you can choose an appropriate encoding method, then preprocess the display data to ensure that the data format is correct and suitable for encoding, then use the encoding method to assemble the preprocessed display data, that is, convert the display data into a format suitable for display, and finally use visualization tools to display the data, and present the assembled data through charts to help users intuitively understand the data.

[0119] For example, see Figure 6 Schematic diagram of the structure of data visualization shown.

[0120] The present application provides a storage method based on a multi-type data structure, which displays a file upload interface in response to a file upload operation in a menu bar in a triggering data processing system, and then displays the stored file in a stored list contained in the file upload interface according to the stored file typed in the file upload interface and its corresponding data type, wherein the stored file is pre-filled according to a template, and then in response to the stored operation in the triggering file upload interface, the stored file is obtained, and then the name of the stored file and the format of the header are checked to see if they are correct. If the name of the stored file and the format of the header are correct, the non-associated data and the associated data in the stored file are read, and then the non-associated data are split to obtain the coded data, and based on the associated data and its corresponding components, an associated mapping is established, and finally, according to the data type of the stored file, the coded data and the associated mapping are stored in the type table corresponding to the database. Therefore, the storage of data no longer requires manual selection of the data structure, but the system automatically analyzes the data type of the imported file and selects the most suitable storage structure, which can effectively solve the problem of low storage efficiency and is not prone to storage errors.

[0121] Another embodiment of the present application provides a storage system based on multiple types of data structures, such as Figure 7 As shown, it includes the following units:

[0122] The first display unit 701 is used to display a file upload interface in response to triggering a file upload operation in a menu bar in the data processing system.

[0123] The second display unit 702 is used to display the incoming files in the incoming list included in the file upload interface according to the incoming files entered in the file upload interface and their corresponding data types. The incoming files are pre-filled according to the template.

[0124] The file acquisition unit 703 is used to acquire the stored file in response to the storage operation in the triggering file upload interface.

[0125] The verification unit 704 is used to verify whether the name and header format of the incoming file are correct.

[0126] The reading unit 705 is used to read the non-associated data and associated data in the stored file if the name and the header format of the stored file are correct.

[0127] The splitting unit 706 is used to split the non-associated data to obtain the encoded data, and to establish an associated mapping based on the associated data and its corresponding components.

[0128] The storage unit 707 is used to store the coded data and the associated mapping into the type table corresponding to the database according to the data type of the input file.

[0129] It should be noted that the specific working process of the above-mentioned units in the embodiment of the present application can refer to steps S101 to S107 in the above-mentioned method embodiment, and will not be repeated here.

[0130] Optionally, another embodiment of the present application provides a storage system based on a multi-type data structure, further comprising:

[0131] The query unit is used to query whether there are data items consistent with the coded data and the associated mapping in the database. When the query unit finds that there are no data items consistent with the coded data and the associated mapping in the database, the storage unit executes the data type of the input file and stores the coded data and the associated mapping in the type table corresponding to the database.

[0132] The recording unit is used to skip the storage of the file into the library and record the failure information of the file into the library if there is a data item consistent with the encoding data and the associated mapping in the database.

[0133] Optionally, another embodiment of the present application provides a storage system based on a multi-type data structure, further comprising:

[0134] The third display unit is used to display a correction page in response to triggering a data correction operation in a menu bar in the data processing system.

[0135] The data query unit is used to query the indicator data corresponding to the indicator number from the database according to the indicator number and the correction instruction entered on the correction page.

[0136] The correction unit is used to correct the indicator data based on the correction indication and the data type corresponding to the indicator data to obtain valid data, and update the indicator data in the database to the valid data.

[0137] Optionally, another embodiment of the present application provides a storage system based on a multi-type data structure, further comprising:

[0138] The number acquisition unit is used to acquire the target indicator number contained in the data display request when receiving the data display request sent by the user.

[0139] The data acquisition unit is used to acquire the display data corresponding to the target indicator number from the database.

[0140] The display unit is used to assemble the display data through preset codes to obtain assembled data and to visually display the assembled data.

[0141] Optionally, another embodiment of the present application provides a storage system based on a multi-type data structure, further comprising:

[0142] The preprocessing unit is used to preprocess each data according to the data type corresponding to each data in the database.

[0143] Optionally, another embodiment of the present application provides a storage system based on a multi-type data structure, further comprising:

[0144] The feedback unit is used to provide feedback information to the front end if the format of the name and header of the inspection incoming file is incorrect.

[0145] It should be noted that the specific working process of each unit provided in the above embodiments of the present application can refer to the corresponding steps in the above method embodiments, and will not be repeated here.

[0146] It should also be noted that the storage system based on a multi-type data structure provided in the embodiment of the present application has the technical effects of any of the above embodiments, and the embodiments of the present application are not described in detail here.

[0147] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0148] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A storage method based on multi-type data structure, characterized in that: include: In response to triggering a file upload operation in a menu bar in the data processing system, displaying a file upload interface; According to the storage file entered in the file upload interface and its corresponding data type, the storage file is displayed in the storage list included in the file upload interface; wherein the storage file is pre-filled according to the template; In response to triggering the storage operation in the file upload interface, obtaining the storage file; Check whether the name and header format of the incoming file are correct; If the name and header format of the input file are correct, read the non-associated data and associated data in the input file; Splitting the non-associated data to obtain encoded data, and establishing an associative mapping based on the associated data and its corresponding components; According to the data type of the input file, the encoded data and the associated mapping are stored in the type table corresponding to the database.

2. The method according to claim 1, characterized in that: Before storing the coded data and the associated mapping in the type table corresponding to the database according to the data type of the input file, the method further includes: Querying a database whether there is a data item that is consistent with the coded data and the associated mapping; If there is a data item in the database that is consistent with the coded data and the associated mapping, then the storage of the stored file is skipped, and failure information of the stored file is recorded; If there is no data item consistent with the coded data and the associated mapping in the database, the coded data and the associated mapping are stored in the type table corresponding to the database according to the data type of the input file.

3. The method according to claim 1, characterized in that Also includes: In response to triggering a data correction operation in a menu bar in the data processing system, displaying a correction page; According to the indicator number and the correction instruction entered on the correction page, querying the indicator data corresponding to the indicator number from the database; Based on the correction indication and the data type corresponding to the indicator data, the indicator data is corrected to obtain valid data, and the indicator data in the database is updated to the valid data.

4. The method according to any one of claims 1 to 3, characterized in that Also includes: When receiving a data display request sent by a user, obtaining the target indicator number included in the data display request; Acquire the display data corresponding to the target indicator number from the database; The display data is assembled by using preset codes to obtain assembled data, and the assembled data is visually displayed.

5. The method according to claim 1, characterized in that After storing the coded data and the associated mapping in a type table corresponding to the database according to the data type of the input file, the method further includes: Preprocess each data according to the data type corresponding to each data in the database.

6. The method according to claim 1, characterized in that After checking whether the name and header format of the incoming file are correct, the following steps are also included: If the format of the name and header of the incoming file is found to be incorrect, a prompt message will be fed back to the front end.

7. A storage system based on multi-type data structure, characterized in that: include: A first display unit, configured to display a file upload interface in response to triggering a file upload operation in a menu bar in the data processing system; A second display unit is used to display the incoming files in the incoming list included in the file upload interface according to the incoming files typed in the file upload interface and their corresponding data types; wherein the incoming files are pre-filled according to the template; A file acquisition unit, configured to acquire the stored file in response to triggering the storage operation in the file upload interface; A verification unit, used to verify whether the name and header format of the incoming file are correct; A reading unit, used for reading the non-associated data and associated data in the input file if the format of the name and the header of the input file are correct; A splitting unit, configured to split the non-associated data to obtain coded data, and to establish an associated mapping based on the associated data and its corresponding components; The storage unit is used to store the encoded data and the associated mapping in a type table corresponding to the database according to the data type of the input file.

8. The system according to claim 7, characterized in that Also includes: A query unit, used for querying whether there is a data item consistent with the coded data and the associated map in the database; wherein, when the query unit finds that there is no data item consistent with the coded data and the associated map in the database, the storage unit executes the data type of the input file to store the coded data and the associated map in the type table corresponding to the database; A recording unit is used to skip the storage of the stored file and record the failure information of the stored file if there is a data item consistent with the encoded data and the associated mapping in the database.

9. The system according to claim 7, characterized in that Also includes: a third display unit, for displaying a correction page in response to triggering a data correction operation in a menu bar in the data processing system; A data query unit, configured to query the indicator data corresponding to the indicator number from the database according to the indicator number and the correction instruction entered on the correction page; A correction unit is used to correct the indicator data based on the correction indication and the data type corresponding to the indicator data to obtain valid data, and update the indicator data in the database to the valid data.

10. The system according to any one of claims 7 to 9, characterized in that: Also includes: A number acquisition unit, configured to, when receiving a data display request sent by a user, acquire a target indicator number included in the data display request; A data acquisition unit, used to acquire display data corresponding to the target indicator number from the database; The display unit is used to assemble the display data through preset codes to obtain assembled data, and visually display the assembled data.

Images