Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and device, equipment and computer readable medium

A technology for processing data and data, which is applied in the computer field, can solve problems such as data empty window period and fluctuation, and achieve the effect of reducing data fluctuation and shortening the empty window period

Pending Publication Date: 2021-12-17
BEIJING WODONG TIANJUN INFORMATION TECH CO LTD +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the process of realizing the present invention, the inventor found that there are at least the following problems in the prior art: because the data needs to be deleted first, and then after a period of time, the data has a window period and violent fluctuations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, equipment and computer readable medium
  • Data processing method and device, equipment and computer readable medium
  • Data processing method and device, equipment and computer readable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0048] At present, the commonly used deduction method is to obtain the required data from the data source first. As a real-time analytical database, Clickhouse itself undertakes more query functions. This requires business data to be processed and stored in databases such as MySQL, Hive, and Kafka, and then the result data is transferred to Clickhouse. Therefore, data pus...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and device, equipment and a computer readable medium, and relates to the technical field of computers. According to one specific embodiment, the method comprises the steps of selecting data corresponding to a table partition in a version table according to the table partition in a data source, wherien the table partition is preset according to service requirements; pushing data of a table partition in a data source to a corresponding table partition in the version table, wherein the format of the version table is consistent with that of a formal table; and after the data in the corresponding table partition in the version table is verified successfully, copying the data in the corresponding table partition in the version table into the formal table. According to the embodiment, the window period of the data pushing process can be shortened, and data fluctuation can be reduced.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a method, device, device and computer-readable medium for processing data. Background technique [0002] Data push is an important part of the data link. The currently commonly used method of deriving numbers is to first obtain the required data from the data source, and then import the data according to the partition field. If there is already data under the partition, first delete the data under the partition and then push the data. [0003] In the process of implementing the present invention, the inventors found at least the following problems in the prior art: because the data needs to be deleted first, and then the data needs to be pushed for a period of time, resulting in empty windows and violent fluctuations in the data. Contents of the invention [0004] In view of this, embodiments of the present invention provide a data processing method, device, device, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F40/166G06F40/177G06F40/197G06F16/27
CPCG06F40/166G06F40/177G06F40/197G06F16/278
Inventor 陈洪健钱叶屠志强
Owner BEIJING WODONG TIANJUN INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com