Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data verification method and system and terminal equipment

A data and data storage technology, applied in the field of big data technology and data processing, can solve the problems of incomplete data consistency, online business impact, and inability to guarantee complete reliability, so as to achieve the effect of no data omission and ensure data accuracy

Inactive Publication Date:
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since the data extraction process cannot be guaranteed to be completely reliable, for example, abnormal conditions such as illegal characters in the data, data extraction system or the crash of the task itself may cause the data obtained by the online system to be inconsistent with the data processed by the offline system. impact on business

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data verification method and system and terminal equipment
  • Data verification method and system and terminal equipment
  • Data verification method and system and terminal equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0019] According to an example implementation of the present disclosure, the message queue middleware runs on a message queue server.

[0020] According to the second aspect of the present disclosure, a system for checking consistency between online data and offline data is disclosed, including:

[0021] The offline data extraction module is used to extract the required data from the offline data to the online and store it as online data, and send the unique identification mark of the extracted data to the message queue middleware;

[0022] The online data return module is used to retrieve the unique identification mark from the message queue middleware, and read the online data according to the unique identification mark; and

[0023] Consistency check module: used to compare the read online data with the offline data.

[0024] According to an exemplary embodiment of the present disclosure, the system further includes an alarm / notification system, configured to issue an alar...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of big data technology and data processing, and provides an online data and offline data consistency verification method and system and terminal equipment.The online data and offline data consistency verification method comprises the steps of extracting required data from offline data to be online and storing the required data as online data, and sending a unique identification mark of the extracted data to message queue middleware; retrieving a unique identification mark from the message queue middleware, and reading online data according to the unique identification mark; and comparing the read online data with the offline data. On-line and off-line data consistency verification is carried out through a data real-time backflow mechanism, andthe effect of completing off-line and on-line data consistency verification work on the premise that an on-line system is not affected is achieved.

Description

technical field [0001] The present disclosure relates to the fields of big data technology and data processing technology, and in particular to a method, system and terminal equipment for consistency verification of online data and offline data. Background technique [0002] Big data refers to a collection of data that cannot be captured, managed and processed by conventional software tools within a certain period of time. , high growth rates and diverse information assets. [0003] As another disruptive technology in the IT industry after cloud computing and the Internet of Things, big data technology has attracted much attention. Big data is everywhere, and all walks of life in society, including finance, automobiles, retail, catering, telecommunications, energy, government affairs, medical care, sports, entertainment, etc., have been integrated into the imprint of big data, and big data has great impact on human social production. and life will have a significant and fa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/23G06F16/27G06F9/54
CPCG06F9/546G06F2209/548G06F16/2365G06F16/27
Inventor 李立威罗翔
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products