Unlock instant, AI-driven research and patent intelligence for your innovation.

Data import verification method, device and medium

A data import and verification method technology, applied in the field of data processing, can solve problems such as low verification performance, reduce access times, optimize data import verification performance, and improve concurrency and throughput.

Pending Publication Date: 2021-10-26
INSPUR COMMON SOFTWARE
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a data import verification method, device and medium, which are used to solve the problem of low verification performance of the application system when a large amount of data is imported

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data import verification method, device and medium
  • Data import verification method, device and medium
  • Data import verification method, device and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0024] Some embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0025] figure 1 It is a schematic flowchart of a data import verification method provided in the embodiment of this application. The method can be applied to different business fields, for example, the Internet financial business field, the e-com...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data import verification method, device and medium, and the method comprises the steps: obtaining a to-be-verified data column, and determining a source database on which the to-be-verified data column depends; loading to-be-verified data of a preset row number in the to-be-verified data column in batches, and judging whether the to-be-verified data is matched with cache data of a first cache variable in a memory or not; if not, retrieving the to-be-verified data in the source database through a structured query language (SQL) script, and determining a retrieval result set; and combining the retrieval result set to the first cache variable, and verifying the to-be-verified data through the merged cache data in the first cache variable. According to the embodiment of the invention, by judging whether the to-be-verified data is matched with the cache data of the first cache variable in the memory, the to-be-verified data can be subjected to deduplication processing, and by searching whether the to-be-verified data exists in the source database and performing memory cache processing on the search result set, the data import verification performance of an application system is optimized.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a data import verification method, device and medium. Background technique [0002] When a large amount of data is imported and verified in the application system, it usually leads to performance bottlenecks. If the data volume problem is not handled properly, memory overflow and response timeout may occur. [0003] Among them, if the amount of data to be verified is small, you can directly loop through it, and if the amount of data in the verification data source is small, you can add it all to the memory at one time, which can also reduce frequent SQL (Structured Query Language, Structured Query Language )ask. [0004] However, for large-scale application systems, usually the amount of data to be verified is relatively large, and the verification depends on more data sources, resulting in the situation that the system does not respond or even crashes, the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/25G06F16/2455G06F16/242G06F16/215
CPCG06F16/252G06F16/24552G06F16/2433G06F16/215Y02D10/00
Inventor 王召冠
Owner INSPUR COMMON SOFTWARE