Unlock instant, AI-driven research and patent intelligence for your innovation.

A data update method, device and system

A data update and database technology, applied in the computer field, can solve problems that affect the utilization of system bandwidth resources, occupy resources of application platform servers, useless polling, etc.

Active Publication Date: 2022-05-13
YOUXINPAI BEIJING INFORMATION TECH CO LTD
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Although the vehicle information management platform shown in the prior art can realize incremental updates, the timing interval is not easy to control. If it is too long, the real-time performance of the elasticsearch search engine is very poor.
When the interval is too short, if there is no data change in the database, it will cause useless polling, occupy the resources of the application platform server, and affect the system bandwidth and resource utilization

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data update method, device and system
  • A data update method, device and system
  • A data update method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0074] The first aspect of the embodiment of the present application shows a data update system, please refer to figure 1 , the system includes: an application platform server 31, a query database 32 connected to the application platform server 31, the query database 32 is arranged inside or independently of the application platform server 31, and the application platform server 31 Connect with the Java terminal 33 through the Internet;

[0075] The Java end 33 is used to search out the update data based on the update document ID, and use the update data to update the index corresponding to the Elasticsearch search engine, and the data.

[0076] It is worth noting that the application platform server 31 will update the document ID, encapsulate it into a message and send it to the message queue;

[0077] The Java end 33 is used to monitor the message queue; parse the message queue, query the latest data from the query data according to the update document ID, and update the in...

Embodiment 2

[0087] The second aspect of the embodiment of this application shows a data update method, please refer to figure 2 , the method includes:

[0088] S101 Determine the update item, the update item includes: update column name, and update data, the update column name is the column name corresponding to the update data;

[0089] The update item is historical data, which is inconsistent with real-time data;

[0090] for example:

[0091] historical data:

[0092] VIN code color car age 123 red 1 year 124 red 2 years 125 red 3 years

[0093] Real-time data:

[0094]

[0095]

[0096] It can be seen that for the vehicle with VIN code 123, the real-time data is different from the historical data. At this time, the update item is defined as: update column name: vehicle age, update data: 4 years.

[0097] S102 Determine the target index according to the updated column name and the updated data;

[0098] It is worth noting that, in ...

Embodiment 3

[0112] see image 3 ;

[0113] In order to further shorten the rate of obtaining update items and ensure the real-time performance of the method shown in the embodiment of the present application, the embodiment of the present application shows a method for comparing historical data and real-time data. For details, please refer to image 3 ;

[0114] Embodiment 3 and the technical solution shown in embodiment 2 have similar steps, the only difference is that step S101 in the technical solution shown in embodiment 2 includes the following steps:

[0115] Optionally, the step of determining an update item includes:

[0116] S1011 Acquire monitoring data, the monitoring data includes: historical data, and real-time data;

[0117] Acquisition of monitoring data includes active acquisition of the application platform database and active push of the query database;

[0118] When updating, include even-numbered rows: such as 2 rows, then 0 is the data before the update, and 1 is ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present application shows a data update method, device and system. In the method shown in the embodiment of the present application, the solution monitors the binlog log, and the binlog log includes historical data and real-time data. When there is a difference between the real-time data and the historical data When the update item is generated, the target index corresponding to the update item is determined, and the update document ID of all updated documents is determined through the target index, and the update document ID is encapsulated into a message and sent to the message queue, and sent to the Java end, and the Java end receives the message. Parse the message, search for the latest data from the query database according to the updated document ID, and update the index and document corresponding to elasticsearch with the latest data. The technical solution shown in the embodiment of this application This solution listens to the binlog log, and when the database performs an update operation, it will Actively notify the program monitoring mechanism to determine which indexes are affected according to the changed columns, and then determine whether to update the documents in the index.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data updating method, device and system. Background technique [0002] Nowadays, automobiles have entered thousands of households, and the industries related to automobiles have also developed vigorously. For some automotive industries, large and complex vehicle information needs to be managed and processed. For example, the vehicle information management platform displays the latest vehicle data to users in real time to ensure that users can obtain accurate vehicle information. For the use of vehicles, the maintenance records are updated in real time, which makes the vehicle information management platform update the data in real time to ensure that the data shown on the platform is accurate. [0003] The vehicle information management platform shown in the prior art has a built-in Elasticsearch search engine in the vehicle information management platform, and comp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/23
Inventor 李军浩赵帅王亮巩仔明邱慧
Owner YOUXINPAI BEIJING INFORMATION TECH CO LTD