Tag real-time update method and system
A real-time update and labeling technology, which is applied in the direction of using information identifiers to retrieve web data, instruments, and other databases, can solve problems such as inability to support analysis and screening and exporting people, poor data writing and exporting performance, and limited use scenarios
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0046] Since most index files are immutable, if you want to update the information of a certain field, the existing label update method needs to delete the entire row first, and then insert a new row (for example, HBase, Lucene, etc.) . Such as Figure 1A As shown, the score value of row ID 1002 needs to be changed. The process of changing the existing label update method is as follows Figure 1B shown. It can be seen that the update method of the prior art has the following two steps:
[0047] Delete the row mark to be updated;
[0048] Insert a new row, which contains the latest value of the field to be updated, while the values of other fields remain unchanged.
[0049] The big disadvantage of this method is: for fields that have not been updated, they must be reinserted. If there are too many fields, the update cost is too high, which seriously affects performance.
[0050] The real-time tag update method provided by the embodiment of the present invention is as fol...
Embodiment approach
[0055] Such as Figure 4 As shown, the real-time tag update method of the present invention provides a preferred implementation, including the following steps;
[0056] Step S10: Locate the field to be changed;
[0057] Step S11: Obtain the changed value of the field to be changed;
[0058] Step S12: stack the changed value on the old field value of the field;
[0059] Step S13: For a field, create a generation for each change value, and sort by the establishment time of each generation;
[0060] Step S14: When reading the tag information, for the field that has been changed, extract the changed value corresponding to the generation with the latest creation time as the field value of the field.
[0061] Step S15: When the set merge field value period arrives, for each field that has been changed, use the changed value corresponding to the generation with the latest creation time as the field value of the field, and delete the remaining changed values and the corresponding...
Embodiment 2
[0067] Embodiment 2 of the present invention provides a real-time label update system, including a coordination node module 100, a label data node module 200, a data query node module 300, a client 400, an application coordination service module 500, a distributed file system 600 and a database 700 , the label data node module 200 is respectively connected to the data query node module 300, the client 400, the application program coordination service module 500, the distributed file system module 600 and the database 700, and the coordination node module 100 is respectively connected to the client terminal 400 and the application program coordination service module 500;
[0068] Coordinating node module 100: for managing label data node module 200;
[0069] Label data node module 200: used to receive the label data transmitted from the client 400, and modify the label by executing the application program. When the application program is executed, the following label real-time ...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More