Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device

A data processing and data technology, applied in the computer field, can solve problems such as discarding, and achieve the effect of reducing processing delay, high performance, and rapid data processing

Inactive Publication Date: 2019-09-17
爱信诺征信有限公司
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, limited by the memory capacity, the system needs to discard the original historical data, and cannot achieve low-latency, high-real-time ad-hoc (Ad-Hoc) query analysis and processing on the complete large data set

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] Implementing any technical solution of the embodiments of the present application does not necessarily need to achieve all the above advantages at the same time.

[0031] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the following will clearly and completely describe the technical solutions in the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. Obviously, the described The embodiments are only some of the embodiments of the present application, but not all of them. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments in the embodiments of the present application shall fall within the protection scope of the embodiments of the present application.

[0032] The specific implementation of the embodiment of the present application will be further described below in conjunct...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data processing method and device. The data processing method comprises the steps that logic processing is conducted on obtained distributed real-time data, and the processed distributed real-time data are stored in an offline storage engine; a data reading request is obtained according to the obtained data reading request; the description information of the distributed real-time data stored in the offline storage engine is stored in an appointed cache, so that the data processing is faster, the processing delay is reduced, the capability of completing the landing storage of mass data with higher performance and higher reliability is obtained, and the data service performance is improved.

Description

technical field [0001] The present application relates to the field of computers, in particular to a data processing method and device thereof. Background technique [0002] With the development of science and technology, the wide application of big data technology has made it a key supporting technology to lead the technological progress of many industries and promote the growth of benefits. According to the timeliness of data processing, big data processing systems can be divided into batch big data processing and streaming big data processing. Among them, streaming big data is also called real-time big data. [0003] At present, the widely used streaming big data processing systems include Storm, Flink, etc., which load real-time data into a high-performance memory database one by one through stream processing for query. This type of system can query the latest real-time data with high-efficiency preset analysis and processing models, with low data lag. However, limite...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455
Inventor 靳亚雷曾祥旺
Owner 爱信诺征信有限公司