Method, device and electronic device for processing atlas data
By setting preset conditions in the graph data to filter out valid data, the problem of unavailable graph structure data is solved, and the extraction and storage optimization of effective data is achieved.
Patent Information
- Application Number
- CN202210239403.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-11
- Publication Date
- 2025-08-15
- Estimated Expiration
- 2042-03-11
AI Technical Summary
Existing data filtering methods cannot effectively filter data stored in the graph structure, resulting in the inability to extract effective data and waste storage space and computing resources.
By setting the first preset condition and the second preset condition, filter the graph data, process the data nodes and association relationships respectively, split and merge data, and ensure that valid data is filtered out.
It realizes effective screening of data stored in the form of graph structure, saves storage space, reduces waste of computing resources, and improves the accuracy of data analysis.
Smart Images

Figure CN114707029B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of graph data processing, and in particular to a method, device and electronic device for processing graph data. Background Art
[0002] With the development of graph data processing technology, all types of data generated by each company in its daily operations will be stored in the server. The server will analyze the stored data and generate corresponding data analysis results. The data analysis results will serve as an important basis for the company to make business decisions. Since there is a large amount of invalid data stored in the server, invalid data is data not involved in the data analysis results. It should be noted that valid data is data involved in the data analysis results. In order to save storage space and avoid the invalid data consuming a large amount of computer resources, the stored data will be filtered.
[0003] Currently, in order to filter the data stored in the server, a data filtering method is used. This method filters the data stored in the form of a data table, assigns different identification information to different columns / rows in the data table, extracts the column data / row data corresponding to each identification information in the data table, and uses the filtering conditions associated with each identification information to filter the column data / row data corresponding to the identification information, thereby filtering out valid data. However, data stored in the form of a graph structure exists in the form of a graph, and the graph structure does not have row attributes and column attributes. The schematic diagram of data stored in the form of a graph structure is as follows Figure 1 As shown, a circle represents a data node, and a straight line represents the association relationship between data nodes. When the data stored in the form of a graph structure is filtered according to the existing data filtering method, valid data cannot be extracted from the data stored in the form of a graph structure, and thus the data stored in the form of a graph structure cannot be effectively filtered. Summary of the Invention
[0004] The present application provides a method, device and electronic device for processing atlas data, which filters the initial atlas data by setting a first preset condition and a second preset condition to ensure that valid atlas data can be filtered out from the initial atlas data, avoiding the inability to extract valid data from data stored in the atlas structure form, thereby enabling effective screening of data stored in the atlas structure form.
[0005] In a first aspect, the present application provides a method for processing atlas data, the method comprising:
[0006] Receive initial graph data sent by a user terminal, and obtain first data and second data corresponding to the initial graph data, wherein the first data is the data in each data node in the initial graph data, and the second data is the association relationship between each data node and other data nodes in the initial graph data;
[0007] Filtering the first data based on a first preset condition to obtain first valid data in the first data;
[0008] Filtering the second data based on a second preset condition to obtain second valid data in the second data;
[0009] Valid atlas data corresponding to the initial atlas data is generated according to the first valid data and the second valid data.
[0010] In one possible design, obtaining second data corresponding to the initial atlas data includes:
[0011] Detecting whether there is first merged data associated with the first digital identifier in the initial graph data, wherein the first merged data is data obtained by merging identical data nodes;
[0012] When it is determined that the initial atlas data contains first merged data, the first merged data is split to obtain at least two second data corresponding to the first merged data.
[0013] In a possible design, splitting the first merged data includes:
[0014] A first digital identifier associated with the first merged data is obtained, and the first merged data is split into a number of second data corresponding to the first digital identifier.
[0015] In one possible design, screening the first data based on a first preset condition to obtain first valid data from the first data includes:
[0016] extracting identity information and / or address information corresponding to the first data;
[0017] Screening out data from the first data whose identity information is consistent with the preset identity information in the first preset condition, and using the data as the first valid data; and / or
[0018] Data whose address information is consistent with the preset address information in the first preset condition is screened out from the first data, and the data is used as the first valid data.
[0019] In a possible design, the data is used as the first valid data, including:
[0020] taking data not filtered out from the first data as first invalid data, and obtaining first associated data associated with the first invalid data;
[0021] When the first invalid data, the first associated data and the first valid data have identical data, the identical data is deleted from the first valid data to obtain first valid data.
[0022] In one possible design, obtaining first valid data includes:
[0023] Detect whether there is first valid data that has no association relationship with other data nodes;
[0024] When it is determined that there is first valid data that has no association relationship with other data nodes, the first valid data that has no association relationship with other data nodes is deleted to obtain the first valid data.
[0025] In one possible design, screening the second data based on a second preset condition to obtain second valid data from the second data includes:
[0026] Extracting time information when the second data is stored and / or association relationship information with other data nodes;
[0027] Filtering out data from the second data, wherein the time information is consistent with the preset time information in the second preset condition, and using the data as the second valid data; and / or
[0028] Data whose association relationship information is consistent with the preset association relationship information in the second preset condition is screened out from the second data, and the data is used as the second valid data.
[0029] In a possible design, the data is used as the second valid data, including:
[0030] taking the unfiltered data in the second data as second invalid data, and obtaining second associated data associated with the second invalid data;
[0031] When the second invalid data and the second associated data have identical data with the second valid data, the identical data is deleted from the second valid data to obtain second valid data.
[0032] In one possible design, obtaining the second valid data includes:
[0033] Detect whether there is second valid data that has no association with other data nodes;
[0034] When it is determined that there is second valid data that has no association relationship with other data nodes, the second valid data that has no association relationship with other data nodes is deleted to obtain the second valid data.
[0035] In one possible design, screening the second data based on a second preset condition to obtain second valid data corresponding to the second data further includes:
[0036] Obtaining second data corresponding to the first combined data;
[0037] Filtering the second data based on a second preset condition, and merging the filtered data with the same data nodes to generate second merged data;
[0038] Counting the number of associations to be merged, and generating a second digital identifier according to the number;
[0039] The second combined data is associated with the second digital identifier, and the data obtained by associating the second combined data with the second digital identifier is used as the second valid data.
[0040] In a second aspect, the present application provides a device for processing atlas data, the device comprising:
[0041] A receiving module, configured to receive initial graph data sent by a user terminal, and obtain first data and second data corresponding to the initial graph data;
[0042] a screening module, configured to screen the first data based on a first preset condition to obtain first valid data from the first data, and to screen the second data based on a second preset condition to obtain second valid data from the second data;
[0043] A generating module is used to generate valid atlas data corresponding to the initial atlas data according to the first valid data and the second valid data.
[0044] In one possible design, the receiving module is specifically used to detect whether there is first merged data associated with the first digital identifier in the initial map data. When it is determined that the first merged data exists in the initial map data, the first merged data is split to obtain at least two second data corresponding to the first merged data.
[0045] In a possible design, the receiving module is further used to obtain a first digital identifier associated with the first merged data, and split the first merged data into a number of second data corresponding to the first digital identifier.
[0046] In one possible design, the filtering module is specifically used to extract the identity information and / or address information corresponding to the first data, filter out data in the first data whose identity information is consistent with the preset identity information in the first preset condition, and use the data as the first valid data, and / or filter out data in the first data whose address information is consistent with the preset address information in the first preset condition, and use the data as the first valid data.
[0047] In one possible design, the screening module is also used to treat the data that is not screened out in the first data as first invalid data, and obtain associated data associated with the first invalid data. When the first invalid data and the associated data have identical data with the first valid data, the identical data is deleted from the first valid data to obtain the first valid data.
[0048] In one possible design, the screening module is also used to detect whether there is first valid data that has no association with other data nodes. When it is determined that there is first valid data that has no association with other data nodes, the first valid data that has no association with other data nodes is deleted to obtain the first valid data.
[0049] In one possible design, the filtering module is also used to extract the time information when the second data is stored and / or the association relationship information with other data nodes, filter out the data in the second data whose time information is consistent with the preset time information in the second preset condition, and use the data as the second valid data, and / or filter out the data in the second data whose association relationship information is consistent with the preset association relationship information in the second preset condition, and use the data as the second valid data.
[0050] In one possible design, the screening module is also used to treat the unfiltered data in the second data as second invalid data, and obtain associated data associated with the second invalid data. When the second invalid data and the associated data have identical data with the second valid data, the identical data is deleted from the second valid data to obtain second valid data.
[0051] In one possible design, the screening module is also used to detect whether there is second valid data that has no association with other data nodes. When it is determined that there is second valid data that has no association with other data nodes, the second valid data that has no association with other data nodes is deleted to obtain the second valid data.
[0052] In one possible design, the screening module is also used to obtain second data corresponding to the first merged data, screen the second data based on a second preset condition, merge the screened data with the same data node to generate second merged data, count the number of association relationships corresponding to the merge, and generate a second digital identifier based on the number, associate the second merged data with the second digital identifier, and use the data after the second merged data is associated with the second digital identifier as the second valid data.
[0053] In a third aspect, the present application provides an electronic device, comprising:
[0054] Memory for storing computer programs;
[0055] The processor is used to implement the above-mentioned method steps for processing atlas data when executing the computer program stored in the memory.
[0056] In a fourth aspect, a computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements the above-mentioned method steps for processing atlas data.
[0057] For each of the above-mentioned aspects from the first to the fourth aspects and the technical effects that may be achieved by each of the aspects, please refer to the above-mentioned description of the technical effects that can be achieved by the first aspect or various possible solutions in the first aspect, and no further details will be given here. BRIEF DESCRIPTION OF THE DRAWINGS
[0058] Figure 1 A schematic diagram of data stored in the form of a graph structure provided in this application;
[0059] Figure 2 A schematic diagram of the structure of a method for processing graph data provided in this application;
[0060] Figure 3 A schematic diagram of the merging process and splitting process of the first merged data provided in this application;
[0061] Figure 4 A schematic diagram of the structure of a device for processing atlas data provided in this application;
[0062] Figure 5 This is a schematic diagram of the structure of an electronic device provided in this application. DETAILED DESCRIPTION
[0063] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail with reference to the accompanying drawings. The specific operating methods in the method embodiments can also be applied to device embodiments or system embodiments. It should be noted that in the description of the present application, "multiple" is understood as "at least two". "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the following three situations: A exists alone, A and B exist at the same time, and B exists alone. A is connected to B, which can represent the following two situations: A is directly connected to B and A is connected to B through C. In addition, in the description of the present application, words such as "first" and "second" are only used to distinguish the purpose of description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order.
[0064] In previous technologies, filtering data stored in servers employed a data filtering method. This method filters data stored in a table format by assigning different identification information to different columns and rows in the table, extracting the column and row data corresponding to each identification information, and then filtering the column and row data corresponding to each identification information using the filtering conditions associated with each identification information, thereby filtering out valid data. However, because graph-structured data lacks row and column attributes, this data filtering method is unable to extract valid data from graph-structured data, making it impossible to effectively filter graph-structured data.
[0065] To address the aforementioned issues, the present invention provides a method for processing graph data, which is used to filter out valid data from data stored in a graph structure, thereby effectively filtering the data stored in the graph structure. The method and device described in the present invention are based on the same technical concept. Since the principles of the problems solved by the method and device are similar, the embodiments of the device and method can refer to each other, and any repetitions will not be repeated.
[0066] The embodiments of the present application are described in detail below with reference to the accompanying drawings.
[0067] Reference Figure 2 The present application provides a method for processing graph data, which can filter out valid data from data stored in the graph form, thereby effectively filtering the data stored in the graph form. The implementation process of the method is as follows:
[0068] Step S21: receiving initial graph data sent by the user terminal, and obtaining first data and second data corresponding to the initial graph data.
[0069] In order to extract valid data from data stored in the form of a graph, the embodiment of the present application stores data in the form of a graph. Therefore, the embodiment of the present application ultimately obtains valid graph data. In order to extract the valid graph data, first, it is necessary to obtain initial graph data from the user end. After obtaining the initial graph data from the user end, in order to effectively filter the initial graph data, the initial graph data is filtered at the data level and the graph structure level. The data extracted from the initial graph data at the data level and the graph structure level are as follows:
[0070] Screening the initial graph data from the data level requires extracting first data from the initial graph data, where the first data is the data in each data node in the initial graph data.
[0071] Screening the initial graph data from the graph structure level requires extracting second data from the initial graph data. The second data is the association relationship between each data node and other data nodes in the initial graph data.
[0072] It should be further explained that the data in the initial graph can be composed of multiple association graphs. When there is first merged data in the initial graph data, in order to effectively screen the first merged data, the first merged data needs to be split into at least two second data. The first merged data is formed by merging the same data nodes in different association graphs, thereby merging multiple association graphs into one association graph. The first digital identifier will be marked on the association relationship between the merged data nodes and the data nodes. The first digital identifier indicates the number of association graphs before the data nodes are merged, such as Figure 3 The figure shows the merging process and splitting process of the first merged data. From left to right, it represents the merging process of the first merged data, and from right to left, it represents the splitting process of the first merged data. Figure 3 In the figure, the data 1 node and the data 2 node are both associated with the same data a node and data b node. Therefore, the data a node and the data b node can be merged. At the same time, the data 1 node and the data 2 node are hidden, and the first digital identifier 2 represents the number of the two association relationship graphs before the merge.
[0073] In the embodiment of the present application, the first merged data may also represent a data master node and a data sub-node. Figure 3 For example, data node a and data node b are data master nodes, data node 1 and data node 2 are data child nodes, and the data child nodes are merged. However, the number of data nodes in the different association relationship graphs to be merged should be the same, and the number of association relationships between data nodes should be consistent. For other merging data, refer to the merging and splitting process. Figure 3The splitting and merging process of the first merged data is described in detail here, so we will not elaborate on it in detail.
[0074] After the first merged data is split, since the first merged data is at least two association relationship maps merged, there are at least two association relationship maps after the first merged data is split. The association relationship maps after the first merged data is split are used as second data, and the number of second data is also at least two.
[0075] The first data extracted from the initial atlas data is processed according to step S22, and the second data extracted from the initial atlas data is processed according to step S23.
[0076] Through the above method, the initial atlas data is classified according to the data level and the atlas structure level, the first merged data is split and then processed, and the initial atlas data is carefully classified, which is conducive to extracting valid atlas data from the initial atlas data.
[0077] Step S22: Filtering the first data based on a first preset condition to obtain first valid data in the first data.
[0078] After extracting the first data from the initial atlas data, in order to extract the first valid data from the first data, it is necessary to filter the first valid data from the first data using the first preset condition. The specific filtering process for filtering the first valid data from the first data in different ways is as follows:
[0079] Method 1: When the first preset condition is preset identity information, the identity information corresponding to each data node in the first data is extracted, and whether the identity information of each data node is consistent with the preset identity information in the first preset condition is detected; if the identity information of the data node is consistent with the preset identity information in the first preset condition, the data in the data node is used as the first valid data; if the identity information of the data node is inconsistent with the preset identity information in the first preset condition, the data in the data node is used as the first invalid data.
[0080] Method 2: When the first preset condition is preset address information, the address information corresponding to each data node in the first data is extracted, and whether the address information of each data node is consistent with the preset address information in the first preset condition is detected; if the address information of the data node is consistent with the preset address information in the first preset condition, the data in the data node is used as the first valid data; if the address information of the data node is inconsistent with the preset address information in the first preset condition, the data in the data node is used as the first invalid data.
[0081] It should be noted in the embodiments of the present application that method one and / or method two can be used to filter out the first valid data from the first data. When method one and method two are used, when the identity information of the data in each data node in the first data is consistent with the preset identity, method two detection will be performed. After method two detection, when the address information of the data in the data node is consistent with the preset address, it can be determined that the data in the data node is the first valid data. The specific detection process refers to the above-mentioned method one and / or method two, and will not be elaborated here.
[0082] Furthermore, in the above description, obtaining the first valid data is based on screening at the data level. Since the data is stored in the form of a graph and there is an association between data nodes, it is necessary to further screen the first valid data from the graph structure level. In order to ensure the accuracy of screening out the first valid data from the first data, it is necessary to obtain the first invalid data and the data associated with the first invalid data. After obtaining the first invalid data and the data associated with the first invalid data, the first invalid data and the data associated with the first invalid data are deleted.
[0083] After taking the steps described above, the accuracy of the first valid data obtained can be ensured. The user end stores data in the form of a graph because the graph can intuitively display the association between data. The valid graph data obtained from the initial graph data is also displayed in the form of a graph. In order to extract the first valid data as data with an associated relationship, it is also necessary to delete the first valid data that has no association with other data nodes in the first valid data to obtain the final first valid data.
[0084] Through the above method, from the data level, the first preset condition is used to filter out the first valid data from the first data, and from the graph structure level, the first valid data filtered out at the data level is screened again to ensure that the first valid data finally obtained is valid data at both the data level and the graph structure level.
[0085] Step S23: Filtering the second data based on a second preset condition to obtain second valid data in the second data.
[0086] After obtaining the second data from the initial atlas data, in order to ensure that the atlas data formed based on the second valid data obtained from the second data is valid atlas data, it is necessary to screen the second data from the data level and the atlas structure level. The specific process of screening the second data from the data level is as follows:
[0087] Filtering out the second valid data from the second data from the data level will be achieved through the second preset condition. The second preset condition is the preset time information of the second data storage and / or the association relationship information with other data nodes. The association relationship information with other data nodes includes the association relationship information between people and cars, the association relationship information between student numbers and attendance dates, etc. In the embodiment of the present application, the association relationship information with other data nodes is the association relationship information between category 1 and category 2. In the above example, people, cars, student numbers, and attendance dates are different categories. As long as they meet the association relationship information between category 1 and category 2, category 1 and category 2 are different categories, which will not be elaborated here.
[0088] Based on the above description of the second preset condition, the second preset condition is used to filter out second valid data from the second data at the data level. The specific filtering process for filtering out the second valid data from the second data is as follows:
[0089] Method 1: When the second preset condition is the preset time information, the time information of each association relationship in the second data stored in the server is extracted, and whether the time information of each association relationship in the second data stored in the server is consistent with the preset time information is detected. If the time information is consistent with the preset time information, the association relationship is used as the second valid data; if the time information is inconsistent with the preset time information, the association relationship is used as the second invalid data.
[0090] Method 2: When the second preset condition is the preset association relationship information with other data nodes, extract the association relationship information corresponding to each association relationship in the second data, and detect whether the association relationship information corresponding to each association relationship is consistent with the preset association relationship information. If the association relationship information corresponding to each association relationship is consistent with the preset association relationship information, then the association relationship is regarded as the second valid data; if the association relationship information corresponding to each association relationship is inconsistent with the preset association relationship information, then the association relationship is regarded as the second invalid data.
[0091] Using method one or method two described above, the second valid data can be filtered out from the second data. In an embodiment of the present application, method one and method two can also be combined to filter the second data. When using method one and method two, when the time information of each association relationship in the second data stored in the server is consistent with the preset time information, method two will be used to detect the second data. Only when the association relationship information corresponding to the association relationship in the second data is consistent with the preset association relationship information can the second valid data be determined from the second data.
[0092] It should be further explained that when there is merged data in the initial atlas data, in order to filter out valid data in the merged data, the merged data needs to be split. Taking the first merged data as an example, the second data corresponding to the first merged data is obtained, and the second data corresponding to the first merged data is filtered according to the second preset condition. When the number of remaining second data corresponding to the first merged data is not less than 2, in order to simplify the association relationship in the valid atlas data, the remaining second data will be merged again. The specific process of merging the remaining second data in the first merged data is as follows:
[0093] Calculate the number of association relationships in the remaining second data, generate a second digital identifier based on the number, and at the same time, merge the data with the same data nodes in the remaining second data to generate second merged data. After obtaining the second merged data, associate the second merged data with the second digital identifier, and use the association relationship as the second valid data.
[0094] After filtering out the second valid data from the second data at the data level through the above steps, the second valid data will be filtered again at the graph structure level. The specific process of filtering the second valid data again at the graph structure level is as follows:
[0095] After screening at the data level, in order to ensure the accuracy of the screened second valid data, it is necessary to obtain the second invalid data corresponding to the second data and the associated data of the second invalid data, and delete the second invalid data and the data associated with the second invalid data from the second data.
[0096] After deleting the second invalid data and the data associated with the second invalid data, since what is finally obtained from the initial graph data is valid graph data, the valid graph data shows the association relationship between data nodes. Therefore, after deleting the second invalid data and the data associated with the second invalid data, it is necessary to detect whether there is second valid data in the second valid data that has no association relationship with other data nodes. If there is second valid data that has no association relationship with other data nodes, the second valid data will be deleted. If there is no second valid data that has no association relationship with other data nodes, no operation will be performed.
[0097] Through the method described above, the second valid data is filtered out from the second data at the data level. In order to ensure that the valid graph data generated based on the second valid data is data associated with each data node, the second valid data is further filtered to ensure that the final second valid data is valid data at the data level and the graph structure level.
[0098] Step S24: generating valid atlas data corresponding to the initial atlas data according to the first valid data and the second valid data.
[0099] After the first valid data and the second valid data are screened out from the initial atlas data through the steps described above, atlas data is generated based on the first valid data and the second valid data, and the atlas data is used as valid atlas data. In the embodiment of the present application, converting data into atlases is a technology well known to those skilled in the art, so it will not be elaborated on here.
[0100] Through the method described above, the initial graph data is divided into first data and second data. At the data level, the first data is screened according to the first preset condition and the second data is screened according to the second preset condition. Then, the first valid data and the second valid data are screened at the graph structure level to obtain the final first valid data and the second valid data. Finally, the valid graph data is generated based on the first valid data and the second valid data, which ensures that the data stored in each data node in the valid graph data is valid data. There are specific screening conditions for the data stored in the graph form, which realizes the effective screening of the data stored in the graph form.
[0101] Based on the same inventive concept, the present application also provides a method for processing atlas data. Figure 4 , the device comprises:
[0102] The receiving module 401 is configured to receive initial graph data sent by a user terminal and obtain first data and second data corresponding to the initial graph data;
[0103] A screening module 402 is configured to screen the first data based on a first preset condition to obtain first valid data from the first data, and to screen the second data based on a second preset condition to obtain second valid data from the second data;
[0104] The generating module 403 is configured to generate valid atlas data corresponding to the initial atlas data according to the first valid data and the second valid data.
[0105] In one possible design, the receiving module 401 is specifically used to detect whether there is first merged data associated with the first digital identifier in the initial map data. When it is determined that there is first merged data in the initial map data, the first merged data is split to obtain at least two second data corresponding to the first merged data.
[0106] In a possible design, the receiving module 401 is further used to obtain a first digital identifier associated with the first merged data, and split the first merged data into a number of second data corresponding to the first digital identifier.
[0107] In one possible design, the filtering module 402 is specifically used to extract the identity information and / or address information corresponding to the first data, filter out data in the first data whose identity information is consistent with the preset identity information in the first preset condition, and use the data as the first valid data, and / or filter out data in the first data whose address information is consistent with the preset address information in the first preset condition, and use the data as the first valid data.
[0108] In one possible design, the screening module 402 is also used to treat the data that is not screened out in the first data as first invalid data, and obtain first associated data associated with the first invalid data. When the first invalid data and the first associated data have identical data with the first valid data, the identical data is deleted from the first valid data to obtain the first valid data.
[0109] In one possible design, the screening module 402 is also used to detect whether there is first valid data that has no association with other data nodes. When it is determined that there is first valid data that has no association with other data nodes, the first valid data that has no association with other data nodes is deleted to obtain the first valid data.
[0110] In one possible design, the filtering module 402 is also used to extract the time information when the second data is stored and / or the association relationship information with other data nodes, filter out the data in the second data whose time information is consistent with the preset time information in the second preset condition, and use the data as the second valid data, and / or filter out the data in the second data whose association relationship information is consistent with the preset association relationship information in the second preset condition, and use the data as the second valid data.
[0111] In one possible design, the filtering module 402 is also used to treat the unfiltered data in the second data as second invalid data, and obtain second associated data associated with the second invalid data. When the second invalid data and the second associated data have identical data with the second valid data, the identical data is deleted from the second valid data to obtain second valid data.
[0112] In one possible design, the screening module 402 is also used to detect whether there is second valid data that has no association with other data nodes. When it is determined that there is second valid data that has no association with other data nodes, the second valid data that has no association with other data nodes is deleted to obtain the second valid data.
[0113] In one possible design, the screening module 402 is also used to obtain second data corresponding to the first merged data, screen the second data based on a second preset condition, merge the screened data with the same data nodes to generate second merged data, count the number of association relationships corresponding to the merger, and generate a second digital identifier based on the number, associate the second merged data with the second digital identifier, and use the data after the second merged data is associated with the second digital identifier as the second valid data.
[0114] Based on the same inventive concept, an electronic device is also provided in the embodiment of the present application, and the electronic device can realize the function of the aforementioned atlas data processing device, referring to Figure 5 , the electronic device includes:
[0115] At least one processor 501, and a memory 502 connected to the at least one processor 501. The specific connection medium between the processor 501 and the memory 502 is not limited in the embodiment of the present application. Figure 5 In the example, the processor 501 and the memory 502 are connected via a bus 500. Figure 5 The bus 500 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 5 The diagram is represented by only one thick line, but this does not mean that there is only one bus or one type of bus. Alternatively, the processor 501 may also be referred to as a controller, without limitation to the name.
[0116] In the embodiment of the present application, the memory 502 stores instructions that can be executed by at least one processor 501. The at least one processor 501 can execute the method for processing the atlas data discussed above by executing the instructions stored in the memory 502. The processor 501 can implement Figure 4 The functions of each module in the device shown.
[0117] Among them, the processor 501 is the control center of the device, which can use various interfaces and lines to connect the various parts of the entire control device, and monitor the device as a whole by running or executing instructions stored in the memory 502 and calling data stored in the memory 502, the various functions of the device and processing data.
[0118] In one possible design, processor 501 may include one or more processing units. Processor 501 may integrate an application processor and a modem processor. The application processor primarily processes the operating system, user interface, and application programs, while the modem processor primarily processes wireless communications. It is understood that the modem processor may not be integrated into processor 501. In some embodiments, processor 501 and memory 502 may be implemented on the same chip. In some embodiments, they may also be implemented on separate chips.
[0119] The processor 501 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the method for processing atlas data disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor.
[0120] The memory 502 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 502 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory, a random access memory (Random Access Memory, RAM), a static random access memory (Static Random Access Memory, SRAM), a programmable read-only memory (Programmable Read Only Memory, PROM), a read-only memory (Read Only Memory, ROM), an electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), a magnetic memory, a disk, an optical disk, etc. The memory 502 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 502 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.
[0121] By designing and programming the processor 501, the code corresponding to the method for processing the atlas data described in the above embodiment can be fixed into the chip, so that the chip can execute the code when running. Figure 2 The steps of processing the atlas data in the embodiment shown are as follows: How to design and program the processor 501 is a technique well known to those skilled in the art and will not be described in detail here.
[0122] Based on the same inventive concept, an embodiment of the present application also provides a storage medium, which stores computer instructions. When the computer instructions are executed on a computer, the computer executes a method for processing graph data discussed above.
[0123] In some possible implementations, various aspects of a method for processing graph data provided by the present application may also be implemented in the form of a program product, which includes program code. When the program product is run on an apparatus, the program code is used to enable the control device to execute the steps of a method for processing graph data according to various exemplary implementations of the present application described above in this specification.
[0124] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0125] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0126] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.
[0127] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0128] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.
Claims
1. A method for processing atlas data, characterized in that: include: Receive initial graph data sent by a user terminal, obtain first data corresponding to the initial graph data, and detect whether there is first merged data associated with a first digital identifier in the initial graph data. When it is determined that the first merged data exists in the initial graph data, obtain the first digital identifier associated with the first merged data, and split the first merged data into at least two second data corresponding to the first digital identifier; wherein the first data is the data in each data node in the initial graph data, the first merged data is the data of merging the same data nodes, and the second data is the association relationship between each data node and other data nodes in the initial graph data; Filtering the first data based on a first preset condition to obtain first valid data in the first data; The second data is screened based on a second preset condition, and the screened data having the same data node is merged to generate second merged data; a number of associated relationships to be merged is counted, and a second digital identifier is generated based on the number; the second merged data is associated with the second digital identifier, and the data resulting from the association between the second merged data and the second digital identifier is used as the second valid data; Valid atlas data corresponding to the initial atlas data is generated according to the first valid data and the second valid data.
2. The method according to claim 1, wherein Filtering the first data based on a first preset condition to obtain first valid data from the first data includes: extracting identity information and / or address information corresponding to the first data; Screening out data from the first data whose identity information is consistent with the preset identity information in the first preset condition, and using the data as the first valid data; and / or Data whose address information is consistent with the preset address information in the first preset condition is screened out from the first data, and the data is used as the first valid data.
3. The method according to claim 2, wherein The data is taken as the first valid data, including: taking data not filtered out from the first data as first invalid data, and obtaining first associated data associated with the first invalid data; When the first invalid data, the first associated data and the first valid data have identical data, the identical data is deleted from the first valid data to obtain first valid data.
4. The method according to claim 3, wherein Obtain the first valid data, including: Detect whether there is first valid data that has no association relationship with other data nodes; When it is determined that there is first valid data that has no association relationship with other data nodes, the first valid data that has no association relationship with other data nodes is deleted to obtain the first valid data.
5. The method according to claim 1, wherein Filtering the second data based on a second preset condition to obtain second valid data from the second data includes: Extracting time information when the second data is stored and / or association relationship information with other data nodes; Filtering out data from the second data, wherein the time information is consistent with the preset time information in the second preset condition, and using the data as the second valid data; and / or Data whose association relationship information is consistent with the preset association relationship information in the second preset condition is screened out from the second data, and the data is used as the second valid data.
6. The method according to claim 5, wherein The data is used as the second valid data, including: taking the unfiltered data in the second data as second invalid data, and obtaining second associated data associated with the second invalid data; When the second invalid data and the second associated data have identical data with the second valid data, the identical data is deleted from the second valid data to obtain second valid data.
7. The method according to claim 6, wherein Obtain the second valid data, including: Detect whether there is second valid data that has no association with other data nodes; When it is determined that there is second valid data that has no association relationship with other data nodes, the second valid data that has no association relationship with other data nodes is deleted to obtain the second valid data.
8. A device for processing atlas data, characterized in that: The device comprises: A receiving module, configured to receive initial graph data sent by a user terminal, obtain first data corresponding to the initial graph data, and detect whether first merged data associated with a first digital identifier exists in the initial graph data; upon determining that first merged data exists in the initial graph data, obtain the first digital identifier associated with the first merged data, and split the first merged data into at least two second data corresponding to the first digital identifier; wherein the first data is data in each data node in the initial graph data, the first merged data is data obtained by merging identical data nodes, and the second data is an association relationship between each data node and other data nodes in the initial graph data; a screening module, configured to screen the first data based on a first preset condition to obtain first valid data from the first data, and screen the second data based on a second preset condition, merge the screened data having the same data node to generate second merged data; count the number of associations corresponding to the merged relationships, and generate a second digital identifier based on the number; associate the second merged data with the second digital identifier, and use the data resulting from the association between the second merged data and the second digital identifier as second valid data; A generating module is used to generate valid atlas data corresponding to the initial atlas data according to the first valid data and the second valid data.
9. The device according to claim 8, wherein The filtering module is specifically used to extract the identity information and / or address information corresponding to the first data, filter out data in the first data whose identity information is consistent with the preset identity information in the first preset condition, and use the data as the first valid data, and / or filter out data in the first data whose address information is consistent with the preset address information in the first preset condition, and use the data as the first valid data.
10. The device according to claim 8, wherein The screening module is further configured to treat the data that has not been screened out in the first data as first invalid data, and obtain associated data associated with the first invalid data; when the first invalid data and the associated data have identical data with the first valid data, the identical data is deleted from the first valid data to obtain first valid data.
11. The device according to claim 8, wherein The screening module is further configured to detect whether there is first valid data that has no association with other data nodes, and when it is determined that there is first valid data that has no association with other data nodes, delete the first valid data that has no association with other data nodes to obtain the first valid data.
12. The device according to claim 8, wherein The filtering module is further used to extract the time information when the second data is stored and / or the association relationship information with other data nodes, filter out data in the second data whose time information is consistent with the preset time information in the second preset condition, and use the data as the second valid data, and / or filter out data in the second data whose association relationship information is consistent with the preset association relationship information in the second preset condition, and use the data as the second valid data.
13. The device according to claim 8, wherein The screening module is further configured to treat unfiltered data in the second data as second invalid data, and obtain associated data associated with the second invalid data; and when the second invalid data and the associated data have identical data with the second valid data, delete the identical data from the second valid data to obtain second valid data.
14. The device according to claim 8, wherein The screening module is further used to detect whether there is second valid data that has no association with other data nodes. When it is determined that there is second valid data that has no association with other data nodes, the second valid data that has no association with other data nodes is deleted to obtain second valid data.
15. An electronic device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the method steps described in any one of claims 1 to 7 when executing the computer program stored in the memory.
16. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Relationship graph display method and device and computer readable storage medium
CN112966099A
Model training method and system and electronic equipment
CN114021716A