Incremental data query method and device, storage medium and electronic equipment

A technology of incremental data and query methods, applied in the field of data processing, to achieve the effect of improving compatibility, reducing implementation difficulty, and maintaining source system performance

Inactive Publication Date: 2018-05-08
NEUSOFT CORP
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] To sum up, there are certain defects in the commonly used incremental data processing schemes at present.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Incremental data query method and device, storage medium and electronic equipment
  • Incremental data query method and device, storage medium and electronic equipment
  • Incremental data query method and device, storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] Specific embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to illustrate and explain the present disclosure, and are not intended to limit the present disclosure.

[0051] see figure 1 , shows a schematic flowchart of the incremental data query method of the present disclosure. The method may include the steps of:

[0052] Step 101, establishing a Java database connection JDBC connection to a source database.

[0053] In the disclosed solution, when necessary, the corresponding JDBC (English: JavaDataBase Connectivity, Chinese: java database connection) implementation class can be selected for different databases, and the connection between JDBC and the source database can be established. Read incremental data in.

[0054]Understandably, in the disclosed solution, although different databases may correspond to differ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an incremental data query method and device, a storage medium and electronic equipment. The method includes the steps: establishing connection from JDBC (Java database connectivity) to a source database; acquiring query parameters and determining an incremental data query starting point in the source database according to values of the query parameters; acquiring data written after the starting point as incremental data from the source database through the JDBC; acquiring the auto-increment value of the query parameter corresponding to the last incremental datum, updating the values of the query parameters by the auto-increment value, and subsequently determining the starting point of next incremental data query in the source database according to the auto-increment value. The query parameters are auto-increment parameters. Therefore, compatibility of an incremental data query scheme and data extraction performance can be improved.

Description

technical field [0001] The present disclosure relates to the field of data processing, and in particular, to an incremental data query method and device, a computer-readable storage medium, and electronic equipment. Background technique [0002] In the daily application process, the database is faced with a large number of data updates at any time, for example, the insertion of new data, the modification and deletion of original data, and so on. For new data, most of the following five schemes are currently used for incremental data processing: [0003] Solution 1: Create an insert trigger on the source table. When new data appears in the source table, the new data can be written into the incremental log table through the insert trigger, so that the target table can be identified through the incremental log table Add data. Such a solution, due to the addition of the insertion trigger, has a certain degree of intrusion on the source system, and has a relatively large impact...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/24535G06F16/2455G06F16/25G06F16/254
Inventor 郭安邦于明光
Owner NEUSOFT CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products