A list management method, system, device and readable storage medium

Abstract

The present invention relates to the field of computer information technology, and discloses a list management method, system, device and readable storage medium, the method comprising: a data import unit imports multiple list data into a data preprocessing unit, the list data comprising fixed list data, newly added list data and custom list data; the data preprocessing unit preprocesses the multiple list data, and sends the preprocessed list data and the original list data to a first database for storage and standby; the data processing unit performs secondary processing on the preprocessed list data to obtain target list data, and sends the target list data to a second database for storage and standby. The present application solves the technical problems of insufficient compatibility, inability to personalize, poor timeliness and low standardization in the management of list data in the prior art, and achieves the technical effect of improving the compatibility, timeliness and standardization of list data management.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of computer information technology, and in particular to a list management method, system, device and readable storage medium. Background Art

[0002] The existing management of list data mainly includes the following shortcomings: the management system lacks compatibility and cannot support the simultaneous import of list data in different formats; it has low flexibility and cannot personalize the list data according to user needs; it has poor timeliness and cannot update the list in a timely manner; the degree of standardization is not high, and there is little standardized processing of list data, which leads to frequent errors and omissions in list data. Summary of the invention

[0003] The embodiments of the present invention provide a list management method, system, device and readable storage medium, which solve the technical problems of insufficient compatibility, inability to customize, poor timeliness and low standardization in the management of list data in the prior art.

[0004] In a first aspect, an embodiment of the present invention provides a list management method, the list management method comprising:

[0005] The data importing unit imports a plurality of list data into the data preprocessing unit, wherein the list data includes fixed list data, newly added list data and user-defined list data;

[0006] The data preprocessing unit preprocesses the plurality of list data, and sends the preprocessed list data and the original list data to the first database for storage and standby use;

[0007] The data processing unit performs secondary processing on the pre-processed list data to obtain target list data, and sends the target list data to the second database for storage and standby use.

[0008] In a second aspect, an embodiment of the present invention further provides a list management system, the list management system comprising:

[0009] A data import unit, used for importing a plurality of list data into the data preprocessing unit, wherein the list data includes fixed list data, newly added list data and user-defined list data;

[0010] The data preprocessing unit is used to preprocess the plurality of list data, and send the preprocessed list data and the original list data to the first database for storage and standby use;

[0011] The data processing unit is used to perform secondary processing on the pre-processed list data to obtain target list data, and send the target list data to the second database for storage and standby use.

[0012] In a third aspect, an embodiment of the present invention further provides a list management device, the list management device comprising:

[0013] one or more processors;

[0014] A storage device for storing one or more programs;

[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement any list management method as described in the first aspect of the embodiment of the present invention.

[0016] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements any list management method as described in the first aspect of the embodiment of the present invention.

[0017] The embodiment of the present invention discloses a list management method, system, device and readable storage medium, the method comprising: a data import unit imports multiple list data into a data preprocessing unit, the list data includes fixed list data, newly added list data and custom list data; the data preprocessing unit preprocesses the multiple list data, and sends the preprocessed list data and the original list data to a first database for storage and standby; the data processing unit performs secondary processing on the preprocessed list data to obtain target list data, and sends the target list data to a second database for storage and standby. The present application solves the technical problems of insufficient compatibility, inability to personalize, poor timeliness and low standardization in the management of list data in the prior art, and achieves the technical effect of improving the compatibility, timeliness and standardization of list data management. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a structural diagram of a list management system provided by an embodiment of the present invention;

[0019] Figure 2 is a flow chart of a list management method provided by an embodiment of the present invention;

[0020] Figure 3 is a flow chart of another list management method provided by an embodiment of the present invention;

[0021] Figure 4 is a flow chart of another list management method provided by an embodiment of the present invention;

[0022] Figure 5A schematic diagram of the structure of a list management device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0023] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0024] It should be noted that the terms "first", "second", etc. in the specification, claims and drawings of the present invention are used to distinguish different objects, rather than to limit a specific order. The following embodiments of the present invention can be implemented separately, or in combination with each other, and the embodiments of the present invention do not impose specific limitations on this.

[0025] Figure 1 is a structural diagram of a list management system provided by an embodiment of the present invention, such as Figure 1 As shown, the list management system includes a data import unit 10, a data preprocessing unit 20 and a data processing unit 30, wherein the data import unit 10 is electrically connected to the data preprocessing unit 20, and the data preprocessing unit 20 is electrically connected to the data processing unit 30; the data import unit 10 is used to import multiple list data into the data preprocessing unit 20; the data preprocessing unit 20 is used to preprocess multiple list data, and send the preprocessed list data and the original list data to the first database 40 for storage and standby; the data processing unit 30 is used to perform secondary processing on the preprocessed list data to obtain target list data, and send the target list data to the second database 50 for storage and standby.

[0026] Figure 2 This is a flow chart of a list management method provided by an embodiment of the present invention. The list management method can be applied to all situations where list management is required, and the list can be a device list, an equipment list, a commodity list or a personnel list. The list management method can be executed by a list management system, which can be implemented in hardware and / or software and can generally be integrated in a server.

[0027] like Figure 2 As shown, the list management method specifically includes the following steps:

[0028] S101, the data importing unit 10 imports a plurality of list data into the data preprocessing unit 20, the list data including fixed list data, newly added list data and user-defined list data.

[0029] Specifically, before importing the list data, it is necessary to pre-load the configuration information table related to the import. The configuration information table includes the country code value table, the agency code value table for publishing the list data, etc. It is mainly used as the basis for determining the preset rules, and the preset rules can be used as the basis for subsequent processing of the list data.

[0030] Specifically, in order to improve the compatibility of the list management system and increase the momentum of personalized customization, the list data is divided into three categories. Among them, the fixed list data is the user's original list data, the newly added list data is the list data added at any time according to the needs, and the custom list data is the list data customized according to the user's required data attributes, data types, etc.

[0031] Optionally, the data import unit 10 imports multiple list data into the data preprocessing unit 20, including at least one of the following: directly importing fixed list data into the data preprocessing unit 20 at one time; importing new list data into the data preprocessing unit 20 at preset time intervals; importing custom list data into the data preprocessing unit 20 in real time according to the update status.

[0032] Specifically, since the fixed list data is the user's original list data, the data import unit 10 needs to import the fixed list data into the data preprocessing unit 20 in full at one time; the newly added list data is the newly added list data at irregular intervals, which is a supplement to the fixed list data. If it is added in real time, it will increase the workload of the list management system and cause unnecessary waste. Therefore, it only needs to be imported into the system at preset intervals; the custom list data is the list data customized by the user according to the data attributes or data types required for his own management. Therefore, as long as the user generates custom list data, the data import unit 10 will import it into the data preprocessing unit 20 in real time.

[0033] Optionally, the custom list data includes custom blacklist data, custom whitelist data and custom graylist data; wherein, the custom blacklist data is list data that does not comply with preset rules, the custom whitelist data is list data that complies with preset rules, and the custom graylist data is list data for which it is yet to be determined whether it complies with preset rules.

[0034] Specifically, the preset rules can be set by the user according to their needs to facilitate the classification, comparison, search, etc. of the list data.

[0035] S102, the data preprocessing unit 20 preprocesses the plurality of list data, and sends the preprocessed list data and the original list data to the first database 40 for storage and standby use.

[0036] Alternatively, if Figure 1As shown, the list management system further includes a first database 40, which is used to store the list data before and after preprocessing by the data preprocessing unit 20.

[0037] Specifically, the data preprocessing unit 20 is mainly used to perform data analysis, data splitting and data assembly on multiple list data of different formats and different sources. After preprocessing, list data consisting of multiple target data that are uniformly packaged and classified can be obtained, and the preprocessed list data is stored in the first database 40 for standby use. At the same time, in order to facilitate subsequent search and use, the data preprocessing unit 20 will also store the list data before preprocessing, that is, the above-mentioned original list data, in the first database 40 for standby use.

[0038] S103, the data processing unit 30 performs secondary processing on the pre-processed list data to obtain target list data, and sends the target list data to the second database 50 for storage and standby use.

[0039] Alternatively, if Figure 1 As shown, the list management system further includes a second database 50 , and the second database 50 is used to store the target list data obtained after secondary processing by the data processing unit 30 .

[0040] Specifically, after the data preprocessing unit 20 preprocesses the list data, the data processing unit 30 can perform secondary processing on the preprocessed list data. The secondary processing includes further converting the preprocessed list data so that list data of different formats, different attributes, and different categories can be processed into list data that can be used by the list management system.

[0041] The present application imports multiple categories of list data in different ways, and pre-processes and re-processes the list data, so that list data of different formats, different attributes, and different categories can be processed into target list data of unified format, unified packaging, and different classifications for standby use; it solves the technical problems of insufficient compatibility, inability to customize, poor timeliness, and low degree of standardization in the management of list data in the prior art, and achieves the technical effect of improving the compatibility, timeliness, and degree of standardization of list data management.

[0042] On the basis of the above technical solutions, Figure 3 is a flow chart of another list management method provided by an embodiment of the present invention. Figure 3 As shown, in the above step S102, the data preprocessing unit 20 preprocesses the plurality of list data, specifically including:

[0043] S301, the data preprocessing unit 20 performs data analysis, data splitting and data assembly on a plurality of list data in sequence.

[0044] Optionally, in S301, the data preprocessing unit 20 performs data parsing on multiple list data including: encapsulating the list data, and performing cursor reading on the encapsulated list data; and packaging the read list data into multiple data sets based on a preset parameter threshold, wherein the preset parameter threshold is a preset parsing quantity value.

[0045] Specifically, after receiving the list data imported by the data import unit 10, the data preprocessing unit 20 first needs to perform object-oriented encapsulation on the list data, and then read the encapsulated list data one by one in a cursor manner by monitoring the start and end tags of the XML (Extensible Markup Language) child nodes in the list data; finally, the read list data is packaged into individual data sets with a configurable parameter threshold, that is, the above-mentioned preset parameter threshold. It should be noted that the preset parameter threshold indicates the amount of data that the list management system can parse at one time.

[0046] Optionally, in S301, the data preprocessing unit 20 splits the multiple list data into data including: splitting the data set into different types of data information based on a first preset rule, wherein the first preset rule is a pre-set basis for classifying the data set.

[0047] Specifically, the data set obtained through data analysis is split into multiple categories of data according to the first preset rule. For example, taking the management of the employee list within the enterprise as an example, the first preset rule is to split according to the attributes of the personnel list, which may be gender, list type, publishing agency, external resources, position, related events, former name information, passport information, etc. It should be noted that the above examples belong to the legal management of employee list data within the unit, and when the above attribute information is stored and / or processed, it complies with the relevant provisions of national laws and regulations.

[0048] Optionally, in S301, the data preprocessing unit 20 assembles the multiple list data, including: assembling the data information into different target data according to a second preset rule, wherein the second preset rule is a data assembly basis determined according to a preset code value table.

[0049] Specifically, the data information obtained after data splitting is assembled into different target data according to a second preset rule, wherein the second preset rule is a data assembly basis determined according to a configuration information table pre-loaded and imported before importing the data, and assembling the data information into target data specifically includes encapsulating the data information according to different preset code value tables.

[0050] After the data preprocessing unit 20 preprocesses the list data to obtain the target data, the list data before preprocessing, ie, the original list data, is stored together with the target data in the first database 40 for later use.

[0051] On the basis of the above technical solutions, Figure 4 is a flow chart of another list management method provided by an embodiment of the present invention. Figure 4 As shown, in the above step S103, the data processing unit 30 performs secondary processing on the pre-processed list data to obtain the target list data, which specifically includes:

[0052] S401, the data processing unit 30 performs data conversion and secondary data splitting on the pre-processed list data in sequence to obtain target list data.

[0053] Optionally, the data processing unit 30 performs data conversion on the preprocessed list data, including: performing data cleaning on the preprocessed list data; and converting the cleaned list data into a data object set in a unified format.

[0054] Specifically, after the data preprocessing unit 20 preprocesses the list data and obtains the target data, the book processing unit 30 will clean the target data, take its effective data package, and then convert the cleaned list data into a data object set in a unified format, thereby enabling the list management system to adapt to list data of multiple attributes, multiple types, and multiple formats.

[0055] Optionally, the data processing unit 30 performs secondary data splitting on the preprocessed list data including: splitting the data object set into data sets of different categories based on a third preset rule, wherein the third preset rule is a classification basis determined based on the attributes of each data item in the list data; and integrating the data sets of different categories obtained by the splitting respectively to obtain target list data of different categories.

[0056] Specifically, after the target data is converted, the obtained data object set can be split into multiple categories of data sets according to the third preset rule. For example, taking the management of the employee list within the enterprise as an example, the third preset rule can be to split the data object set into data sets of categories such as basic list information, name information, certificate information, address information, etc.; then the data sets of different categories obtained by splitting are respectively integrated to form a variety of list data. For example, the integration can include removing invalid names, merging the same names, deriving new names from different names of the same employee according to different combination rules, translating the original name into names in various languages, etc. For example, Chinese names include traditional Chinese, simplified Chinese, four-corner code, Cantonese, etc. By integrating the data sets into target list data in different languages, the list management system provided by the embodiment of the present invention can adapt to the management of lists in multiple regions and languages.

[0057] In the embodiment of the present invention, different categories of target list data are obtained by integrating the data sets respectively, so that the target list data finally processed in the list management system is more diversified and can be applied to different scenarios.

[0058] Figure 5 A structural diagram of a list management device provided by an embodiment of the present invention, such as Figure 5 As shown, the list management device includes a processor 51, a memory 52, an input device 53 and an output device 54; the number of processors 51 in the list management device can be one or more. Figure 5 A processor 51 is taken as an example; the processor 51, the memory 52, the input device 53 and the output device 54 in the list management device can be connected by a bus or other means, Figure 5 The example of connecting through bus is taken in the following.

[0059] The memory 52 is a computer-readable storage medium that can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the list management method in the embodiment of the present invention (for example, the data import unit 10, the data preprocessing unit 20 and the data processing unit 30 in the list management device). The processor 51 executes the various functional applications and data processing of the list management device by running the software programs, instructions and modules stored in the memory 52, that is, implements the above-mentioned list management method.

[0060] The memory 52 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 52 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 52 may further include a memory remotely arranged relative to the processor 51, and these remote memories may be connected to the list management device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0061] The input device 53 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the list management device. The output device 54 may include a display device such as a display screen.

[0062] An embodiment of the present invention further provides a storage medium containing computer executable instructions, wherein the computer executable instructions are used to execute a list management method when executed by a computer processor.

[0063] Specifically, the list management method includes:

[0064] The data import unit imports a plurality of list data into the data preprocessing unit, the list data including fixed list data, newly added list data and user-defined list data;

[0065] The data preprocessing unit preprocesses the plurality of list data, and sends the preprocessed list data and the original list data to the first database for storage and standby use;

[0066] The data processing unit performs secondary processing on the pre-processed list data to obtain target list data, and sends the target list data to the second database for storage and standby use.

[0067] Of course, the computer executable instructions of a storage medium including computer executable instructions provided by an embodiment of the present invention are not limited to the operations of the method described above, and can also execute related operations in the list management method provided by any embodiment of the present invention.

[0068] Through the above description of the implementation methods, the technicians in the relevant field can clearly understand that the present invention can be implemented by means of software and necessary general hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, a read-only memory (ROM), a random access memory (RAM), a flash memory (FLASH), a hard disk or an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0069] It is worth noting that in the embodiment of the above-mentioned search device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0070] In the description of the embodiments of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0071] Finally, it should be noted that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A list management method, characterized in that: The list management method comprises: The data importing unit imports a plurality of list data into the data preprocessing unit, wherein the list data includes fixed list data, newly added list data and user-defined list data; The data preprocessing unit preprocesses the plurality of list data, and sends the preprocessed list data and the original list data to the first database for storage and standby use; The data processing unit performs secondary processing on the pre-processed list data to obtain target list data, and sends the target list data to the second database for storage and standby use; The data preprocessing unit preprocesses the plurality of list data including: The data preprocessing unit sequentially performs data analysis, data splitting and data assembly on the plurality of list data; The data preprocessing unit performs data parsing on the plurality of list data, including: Encapsulating the list data, and performing cursor reading on the encapsulated list data; Packing the read list data into multiple data sets based on a preset parameter threshold, wherein the preset parameter threshold is a preset parsing quantity value; The data preprocessing unit splits the plurality of list data into data comprising: Splitting the data set into different types of data information based on a first preset rule, wherein the first preset rule is a preset basis for classifying the data set; The data preprocessing unit assembles the plurality of list data into data, including: Assembling the data information into different target data according to a second preset rule, wherein the second preset rule is a data assembly basis determined according to a preset code value table; The data processing unit performs secondary processing on the pre-processed list data to obtain the target list data, including: The data processing unit sequentially performs data conversion and secondary data splitting on the pre-processed list data to obtain the target list data.

2. The list management method according to claim 1, characterized in that: The data importing unit imports a plurality of list data into the data preprocessing unit, including at least one of the following: Directly importing the fixed list data into the data preprocessing unit at one time; Importing the newly added list data into the data preprocessing unit at intervals of a preset time; The custom list data is imported into the data preprocessing unit in real time according to the update status.

3. The list management method according to claim 1, characterized in that: The custom list data includes custom blacklist data, custom whitelist data and custom greylist data; Among them, the custom blacklist data is the list data that does not comply with the preset rules, the custom whitelist data is the list data that complies with the preset rules, and the custom graylist data is the list data that is yet to be determined whether it complies with the preset rules.

4. The list management method according to claim 1, characterized in that: The data processing unit performs data conversion on the pre-processed list data, including: Performing data cleaning on the preprocessed list data; The cleaned list data is converted into a data object set in a unified format.

5. The list management method according to claim 4, characterized in that: The data processing unit performs secondary data splitting on the pre-processed list data, including: Splitting the data object set into data sets of different categories based on a third preset rule, wherein the third preset rule is a classification basis determined based on the attributes of each data item in the list data; The data sets of different categories obtained by splitting are respectively integrated to obtain the target list data of different categories.

6. A list management system, characterized in that: The list management system includes: A data import unit, used for importing a plurality of list data into the data preprocessing unit, wherein the list data includes fixed list data, newly added list data and user-defined list data; The data preprocessing unit is used to preprocess the plurality of list data, and send the preprocessed list data and the original list data to the first database for storage and standby use; A data processing unit, used for performing secondary processing on the pre-processed list data to obtain target list data, and sending the target list data to a second database for storage and standby use; The data preprocessing unit preprocesses the plurality of list data including: The data preprocessing unit sequentially performs data analysis, data splitting and data assembly on the plurality of list data; The data preprocessing unit performs data parsing on the plurality of list data, including: Encapsulating the list data, and performing cursor reading on the encapsulated list data; Packing the read list data into multiple data sets based on a preset parameter threshold, wherein the preset parameter threshold is a preset parsing quantity value; The data preprocessing unit splits the plurality of list data into data comprising: Splitting the data set into different types of data information based on a first preset rule, wherein the first preset rule is a preset basis for classifying the data set; The data preprocessing unit assembles the plurality of list data into data, including: Assembling the data information into different target data according to a second preset rule, wherein the second preset rule is a data assembly basis determined according to a preset code value table; The data processing unit performs secondary processing on the pre-processed list data to obtain the target list data, including: The data processing unit sequentially performs data conversion and secondary data splitting on the pre-processed list data to obtain the target list data.

7. A list management device, characterized in that: The list management device comprises: one or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the list management method as described in any one of claims 1 to 5.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the list management method as described in any one of claims 1 to 5 is implemented.

Images