A structured data management method, device, storage medium and electronic device

Abstract

The present application proposes a structured data management method, device, storage medium and electronic device, which obtain data collection information transmitted by a user terminal, wherein the data collection information includes at least one target information and the attributes of the target information; determine the storage location of the target information in the target form based on metadata field information, wherein the metadata field information represents the mapping relationship between at least one attribute of the target information and the storage location; write the target information to the storage location, wherein the storage location allows at most one target information to be written. By writing the target information to the storage location, the structured data is constructed. By limiting each storage location to only allow one target information to be written, it is convenient for later retrieval management.

Description

Technical Field

[0001] The present application relates to the field of data, and in particular, to a method, device, storage medium and electronic device for managing structured data. Background Art

[0002] With the rapid development of big data, people's lives have been greatly facilitated. Two important steps in big data are data collection and storage. One scenario of data collection is form data collection. However, due to the differences in collection scenarios, collection objects, and collection requirements, the content and format of data collection tables are not completely unified.

[0003] How to complete unified data storage when there are many types of data collection tables and various formats has become a difficult problem that troubles technical personnel in this field. Summary of the invention

[0004] The purpose of this application is to provide a structured data management method, device, storage medium and electronic device to partially improve the above-mentioned problems.

[0005] In order to achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:

[0006] In a first aspect, an embodiment of the present application provides a method for managing structured data, the method comprising:

[0007] Acquire data collection information transmitted by a user terminal, wherein the data collection information includes at least one type of target information and attributes of the target information;

[0008] Determining a storage location of the target information in the target form according to metadata field information, wherein the metadata field information represents a mapping relationship between at least one attribute of the target information and the storage location;

[0009] The target information is written into the storage location, wherein at most one target information is allowed to be written into the storage location.

[0010] In a second aspect, an embodiment of the present application provides a structured data management device, wherein the device includes:

[0011] An information acquisition unit, configured to acquire data acquisition information transmitted by a user terminal, wherein the data acquisition information includes at least one type of target information and attributes of the target information;

[0012] A processing unit, configured to determine a storage location of the target information in a target form according to metadata field information, wherein the metadata field information represents a mapping relationship between at least one attribute of the target information and the storage location;

[0013] The processing unit is further configured to write the target information into the storage location, wherein at most one target information is allowed to be written into the storage location.

[0014] In a third aspect, an embodiment of the present application provides a storage medium on which a computer program is stored, and the computer program implements the above method when executed by a processor.

[0015] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising: a processor and a memory, wherein the memory is used to store one or more programs; when the one or more programs are executed by the processor, the above method is implemented.

[0016] Compared with the prior art, the embodiments of the present application provide a structured data management method, device, storage medium and electronic device, which obtain data collection information transmitted by a user terminal, wherein the data collection information includes at least one target information and the attributes of the target information; determine the storage location of the target information in the target form based on the metadata field information, wherein the metadata field information represents the mapping relationship between at least one attribute of the target information and the storage location; write the target information to the storage location, wherein the storage location allows at most one target information to be written. By writing the target information to the storage location, the structured data is constructed. By limiting each storage location to only allow one target information to be written, it is convenient for later retrieval management.

[0017] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0020] Figure 2 A flowchart of a method for managing structured data provided in an embodiment of the present application;

[0021] Figure 3 One of the flowcharts of the method for managing structured data provided in the embodiment of the present application;

[0022] Figure 4One of the flowcharts of the method for managing structured data provided in the embodiment of the present application;

[0023] Figure 5 One of the flowcharts of the method for managing structured data provided in the embodiment of the present application;

[0024] Figure 6 One of the flowcharts of the method for managing structured data provided in the embodiment of the present application;

[0025] Figure 7 A schematic diagram of units of a structured data management device provided in an embodiment of the present application.

[0026] In the figure: 10 - processor; 11 - memory; 12 - bus; 13 - communication interface; 301 - information acquisition unit; 302 - processing unit. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0028] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0029] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0030] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0031] In the description of the present application, it should be noted that the terms "upper", "lower", "inside", "outside", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, or are the orientations or positional relationships in which the product of the application is usually placed when in use. They are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0032] In the description of this application, it is also necessary to explain that, unless otherwise clearly specified and limited, the terms "disposed" and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be an indirect connection through an intermediate medium, or it can be the internal communication of two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0033] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0034] The present application embodiment provides an electronic device, which may be a server device. Figure 1 , a schematic diagram of the structure of an electronic device. The electronic device includes a processor 10, a memory 11, and a bus 12. The processor 10 and the memory 11 are connected via the bus 12, and the processor 10 is used to execute an executable module stored in the memory 11, such as a computer program.

[0035] The processor 10 may be an integrated circuit chip having signal processing capabilities. In the implementation process, each step of the structured data management method may be completed by an integrated logic circuit of hardware in the processor 10 or by instructions in the form of software. The above-mentioned processor 10 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gates or transistor logic devices, or discrete hardware components.

[0036] The memory 11 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk memory.

[0037] The bus 12 may be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus. Figure 1 Although only one bidirectional arrow is used in the figure, it does not mean that there is only one bus 12 or only one type of bus 12 .

[0038] The memory 11 is used to store programs, such as programs corresponding to the structured data management device. The structured data management device includes at least one software function module that can be stored in the memory 11 in the form of software or firmware or fixed in the operating system (OS) of the electronic device. After receiving the execution instruction, the processor 10 executes the program to implement the structured data management method.

[0039] Possibly, the electronic device provided in the embodiment of the present application further includes a communication interface 13. The communication interface 13 is connected to the processor 10 via a bus. The electronic device can communicate with other terminals via the communication interface 13, for example, receiving a retrieval request or storage request transmitted by other terminals.

[0040] It should be understood that Figure 1 The structure shown is only a schematic diagram of a portion of the electronic device. The electronic device may also include Figure 1 More or fewer components as shown, or with Figure 1 Different configurations shown. Figure 1 Each component shown in the figure can be implemented by hardware, software or a combination thereof.

[0041] The present invention provides a method for managing structured data, which can be applied to but is not limited to Figure 1 For detailed procedures, please refer to the electronic equipment shown in Figure 2 , the structured data management method includes: S101, S102 and S103, which are specifically described as follows.

[0042] S101, obtaining data collection information transmitted by a user terminal.

[0043] The data collection information includes at least one type of target information and attributes of the target information.

[0044] It should be understood that the target information may be age information, name information, address information, work information, hobby information, etc. The attribute of the target information may be the target category of the target information, for example, the age information is "23", and the corresponding target category is "age"; the name information is "XX", and the corresponding target category is "name". The user terminal may transmit data collection information of one or more collection objects.

[0045] S102: Determine the storage location of the target information in the target form according to the metadata field information.

[0046] The metadata field information represents a mapping relationship between at least one attribute of the target information and the storage location.

[0047] Optionally, the storage location corresponding to the attribute is determined according to the mapping relationship. It should be understood that the storage location is a space in the target form.

[0048] S103, writing the target information into the storage location.

[0049] Among them, the storage location allows at most one target information to be written. By writing the target information into the storage location, the structured data is constructed. By limiting each grid (storage location) to only allow one target information to be written, it is convenient for later retrieval management.

[0050] In summary, the embodiment of the present application provides a method for managing structured data, obtaining data collection information transmitted by a user terminal, wherein the data collection information includes at least one target information and attributes of the target information; determining the storage location of the target information in the target form based on metadata field information, wherein the metadata field information represents a mapping relationship between at least one attribute of the target information and the storage location; writing the target information to the storage location, wherein the storage location allows at most one target information to be written. By writing the target information to the storage location, the structured data is constructed. By limiting each grid (storage location) to only allow one target information to be written, it is convenient for later retrieval management.

[0051] In a possible implementation, the attributes of the target information include the target category and format of the target information, and the metadata field information includes a first mapping relationship and a second mapping relationship. The first mapping relationship is the correspondence between the target category and the row identifier of the target form, and the second mapping relationship is the correspondence between the format of the target information and the column identifier of the target form. Figure 2 S102 in this application also provides a possible implementation method, please refer to Figure 3 , S102 includes S102-1, S102-2 and S102-3, which are described in detail as follows.

[0052] S102-1, determining a row identifier of a target form according to a target category and a first mapping relationship.

[0053] Please refer to Table 1 below, which shows a possible target form structure. Optionally, the same target category may correspond to multiple rows in the target form. For example, if the target category is "age", it corresponds to the "age" row in the target form. In a possible implementation, the target form may include multiple "age" rows.

[0054]

[0055] Table 1

[0056] S102-2, determining the column identifier of the target form according to the format of the target information and the second mapping relationship.

[0057] It should be understood that the target information may be in the format of text, numerical value, timestamp, etc. Different formats correspond to different columns of the target form, so the column identifier of the target form needs to be determined according to the second mapping relationship.

[0058] Please continue to refer to Table 1. The "fieldStrValue" column corresponds to the text format, the "fieldNumValue" column corresponds to the numeric format, and the "fieldTimeValue" column corresponds to the timestamp format.

[0059] S102-3, determine the storage location according to the row identifier and the column identifier.

[0060] Optionally, the intersection of the row identifier and the column identifier is determined as the storage location. For example, the name information is "Zhang San", the target type of the name information is "name", and "name" corresponds to the "name" row; the format of "Zhang San" is text format and the "fieldStrValue" column, so the storage location corresponding to the name "Zhang San" is the intersection of the "name" row and the "fieldStrValue" column. Similarly. The storage location corresponding to the age "20" is the intersection of the "age" row and the "fieldNumValue" column.

[0061] In a possible implementation, the metadata field information is configured by a manager on a management terminal, and the management terminal uploads the configured metadata field information to an electronic device, which stores the metadata field information.

[0062] exist Figure 2 Based on the storage of multiple target information belonging to the same category, the present application embodiment also provides a possible implementation method, please refer to Figure 3 , after S103, the structured data management method further includes: S104 and S105, which are described in detail as follows.

[0063] S104, determine whether the target information belongs to the multi-information target category. If yes, execute S105, if no, skip.

[0064] Among them, the multi-information target category is a target category including multiple target information.

[0065] Please continue to refer to Table 1 above. The target information is address information, corresponding to "address". The address information includes "51", "01" and "02". "51", "01" and "02" need to be stored in different storage locations. The location information corresponding to "51", "01" and "02" needs to be recorded in the target form, so S105 needs to be executed; otherwise, it is skipped directly.

[0066] S105, writing the sequence number value into the sequence number column of the row where the storage location is located.

[0067] The sequence number value represents the order of the target information in the information corresponding to the multi-information target category.

[0068] Optionally, the sequence number column is, for example, the "dimension" column in Table 1, and the sequence number value is, for example, "0", "1", and "2", etc. The sequence number value facilitates accurate combination of target information.

[0069] In a possible manner, when the target category is "hobbies", the corresponding target information may include "basketball", "swimming", "travel" and "reading", etc. All the above target information needs to be stored according to the steps shown in S101 to S105.

[0070] In a possible implementation, the data collection information also includes the identification of the target collection object. In this case, when executing Figure 2 After the steps shown, regarding how to associate the target information with the target acquisition object, the embodiment of the present application also provides a possible implementation method, please refer to Figure 4 , after S103 , the method for managing structured data further includes: S106 , which is specifically described as follows.

[0071] S106, writing the target characteristic symbol into the identification column of the row where the storage location is located.

[0072] The target characteristic symbol is a symbol corresponding to the identification of the target acquisition object, and the row where the target characteristic symbol is located is only used to store the target information of the target acquisition object.

[0073] Please refer to Table 1. The identification column may be the "basedatald" column in Table 1. For example, for a user named "Zhang San", the corresponding target feature symbol is "1".

[0074] Optionally, the identifier of the target acquisition object may be a user ID, that is, an ID that submits the data acquisition information. It should be noted that, in order to avoid chaotic storage that affects subsequent retrieval results, any row is only allowed to store at most one target acquisition corresponding to the target information, which is convenient for later screening.

[0075] exist Figure 4 Based on the steps shown, the present application embodiment also provides a possible implementation method for how to search based on the target form, please refer to Figure 5 , the structured data management method also includes: S201 and S202, which are specifically described as follows.

[0076] S201, when receiving a search request including at least two search conditions, obtaining a subset of target characteristic symbols of a row where target information that satisfies any one of the search conditions is located.

[0077] For example, if the search condition is age greater than 18 years old and the search category is age, the age must be greater than 18 years old, so that the target characteristic symbols of age greater than 18 years old can be filtered out. If the search condition is gender is male, the target characteristic symbols of gender is male can be filtered out.

[0078] S202, obtaining a union of at least two subsets, and using information of the target acquisition object corresponding to the target feature symbol in the union as a feedback result of the search request.

[0079] It should be understood that the collection objects corresponding to the target characteristic symbols in the union simultaneously satisfy all the search conditions in the search request.

[0080] Since the search conditions can efficiently hit the index, the query speed will be very fast, which can support real-time query of 7-digit business data. The effect is not much different from the database table optimized for customized business development.

[0081] Optionally, the feedback result is snapshot information of the data collection information of the target collection object.

[0082] Optionally, the target characteristic symbol finally obtained may be used to obtain the original protocol data in the basic data storage table, that is, the snapshot information of the data collection information, for returning to the client and providing client rendering.

[0083] exist Figure 2 On the basis of how to store sub-information when the target information has sub-information, the embodiment of the present application also provides a possible implementation method, please refer to Figure 6 , the structured data management method also includes: S107, which is specifically described as follows.

[0084] S107, writing the sub-information into the sub-information column of the row where the storage location is located.

[0085] For example, the target information is work experience in "AAA Company", and the sub-information is the position of the subject in AAA Company. The sub-information column is, for example, the "fieldinnername" column in Table 1. By storing the sub-information, the form content information is enriched, which is convenient for statistics.

[0086] See also Figure 7 , Figure 7 An embodiment of the present application provides a structured data management device. Optionally, the structured data management device is applied to the electronic device described above.

[0087] The structured data management device includes: an information acquisition unit 301 and a processing unit 302

[0088] The information acquisition unit 301 is used to acquire data acquisition information transmitted by the user terminal, wherein the data acquisition information includes at least one target information and attributes of the target information;

[0089] The processing unit 302 is used to determine the storage location of the target information in the target form according to the metadata field information, wherein the metadata field information represents a mapping relationship between at least one attribute of the target information and the storage location;

[0090] The processing unit 302 is further configured to write the target information into a storage location, wherein a storage location allows at most one target information to be written into the storage location.

[0091] Optionally, the information acquisition unit 301 may also execute the above S101, and the processing unit 302 may also execute the above S102 to S107, S201 to S202.

[0092] It should be noted that the structured data management device provided in this embodiment can execute the method flow shown in the above method flow embodiment to achieve the corresponding technical effect. For the sake of brief description, for parts not mentioned in this embodiment, reference can be made to the corresponding contents in the above embodiment.

[0093] The present application also provides a storage medium, which stores computer instructions and programs, which, when read and executed, execute the structured data management method of the above embodiment. The storage medium may include memory, flash memory, registers, or a combination thereof.

[0094] The following provides an electronic device, which may be a server device. Figure 1 As shown, the above-mentioned structured data management method can be implemented; specifically, the electronic device includes: a processor 10, a memory 11, and a bus 12. The processor 10 can be a CPU. The memory 11 is used to store one or more programs. When the one or more programs are executed by the processor 10, the structured data management method of the above-mentioned embodiment is executed.

[0095] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to the multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of boxes in the block diagram and / or the flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0096] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0097] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0098] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

[0099] It will be apparent to those skilled in the art that the present application is not limited to the details of the exemplary embodiments described above, and that the present application can be implemented in other specific forms without departing from the spirit or essential features of the present application. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the present application is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims be included in the present application. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.

Claims

1. A method for managing structured data, characterized in that: The method comprises: Acquire data collection information transmitted by a user terminal, wherein the data collection information includes at least one type of target information and attributes of the target information; Determining a storage location of the target information in the target form according to metadata field information, wherein the metadata field information represents a mapping relationship between at least one attribute of the target information and the storage location; Writing the target information into the storage location, wherein at most one target information is allowed to be written into the storage location; The attributes of the target information include the target category and format of the target information, the metadata field information includes a first mapping relationship and a second mapping relationship, the first mapping relationship is a correspondence relationship between the target category and a row identifier of a target form, the second mapping relationship is a correspondence relationship between the format of the target information and a column identifier of the target form, and determining the storage location of the target information in the target form according to the metadata field information includes: Determining a row identifier of a target form according to the target category and the first mapping relationship; Determining a column identifier of a target form according to the format of the target information and the second mapping relationship; The storage location is determined according to the row identifier and the column identifier.

2. The method for managing structured data according to claim 1, wherein: After writing the target information into the storage location, the method further includes: determining whether the target information belongs to a multi-information target category, wherein the multi-information target category is a target category including multiple target information; If so, a sequence number value is written into the sequence number column of the row where the storage location is located, wherein the sequence number value represents the order of the target information in the information corresponding to the multi-information target category.

3. The method for managing structured data according to claim 1, wherein: The data collection information also includes an identifier of a target collection object. After writing the target information into the storage location, the method further includes: A target characteristic symbol is written in the identification column of the row where the storage location is located, wherein the target characteristic symbol is a symbol corresponding to the identification of the target acquisition object, and the row where the target characteristic symbol is located is only used to store the target information of the target acquisition object.

4. The method for managing structured data according to claim 3, wherein: The method further comprises: Upon receiving a search request including at least two search conditions, obtaining a subset of target characteristic symbols of a row of target information that satisfies any one of the search conditions, wherein the search condition is a condition that needs to be satisfied by the search category; A union of at least two subsets is obtained, and information of the target acquisition object corresponding to the target feature symbol in the union is used as a feedback result of the search request.

5. The method for managing structured data according to claim 4, characterized in that: The feedback result is snapshot information of the data collection information of the target collection object.

6. The method for managing structured data according to claim 1, wherein: When the target information has sub-information, after writing the target information into the storage location, the method further includes: The sub-information is written into the sub-information column of the row where the storage location is located.

7. A structured data management device, characterized in that: The device comprises: An information acquisition unit, configured to acquire data acquisition information transmitted by a user terminal, wherein the data acquisition information includes at least one type of target information and attributes of the target information; A processing unit, configured to determine a storage location of the target information in a target form according to metadata field information, wherein the metadata field information represents a mapping relationship between at least one attribute of the target information and the storage location; The processing unit is further used to write the target information into the storage location, wherein the storage location allows at most one target information to be written; The attributes of the target information include the target category and format of the target information, the metadata field information includes a first mapping relationship and a second mapping relationship, the first mapping relationship is the correspondence between the target category and the row identifier of the target form, the second mapping relationship is the correspondence between the format of the target information and the column identifier of the target form, and determining the storage location of the target information in the target form based on the metadata field information includes: determining the row identifier of the target form based on the target category and the first mapping relationship; determining the column identifier of the target form based on the format of the target information and the second mapping relationship; and determining the storage location based on the row identifier and the column identifier.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

9. An electronic device, characterized in that: include: A processor and a memory, the memory being used to store one or more programs; When the one or more programs are executed by the processor, the method according to any one of claims 1 to 6 is implemented.

Images