Unlock instant, AI-driven research and patent intelligence for your innovation.

Templated data processing method and device

A data processing and big data processing technology, applied in the field of image processing, can solve problems such as high development and maintenance costs, achieve the effect of saving development and maintenance costs and improving development and maintenance efficiency

Active Publication Date: 2020-07-28
北京百分点科技集团股份有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] It can be seen that in order to adapt to various big data processing frameworks and develop multiple operators separately, it requires high development and maintenance costs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Templated data processing method and device
  • Templated data processing method and device
  • Templated data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] This embodiment provides a templated data processing method, which can save development and maintenance costs when implementing data processing by adapting to different big data processing frameworks, thereby improving development and maintenance efficiency. It is assumed that the execution subject of this method can be a server. The specific flow chart of the method is shown in figure 1 shown, including:

[0042] Step 102: Determine the data processing request including the data to be processed and the framework identifier.

[0043] In practical applications, specific data processing methods can usually be used to implement data processing on the data to be processed. The data to be processed here can refer to the data that needs to be processed. For example, in the field of e-commerce, the data to be processed can be multiple transaction records, and in the financial field, the data to be processed can be multiple business records such as savings and loans. . In th...

Embodiment 2

[0080] Based on the same idea, Embodiment 2 of the present application provides a templated data processing device, which can save development and maintenance costs when implementing data processing by adapting to different big data processing frameworks, thereby improving the efficiency of development and maintenance. Suppose the device Can be applied to the server. The schematic diagram of the device is shown in image 3 As shown, it includes: a determination unit 202, an acquisition unit 204, a generation unit 206, and an execution unit 208, wherein,

[0081] The determination unit 202 may be configured to determine a data processing request including data to be processed and a framework identifier;

[0082] The obtaining unit 204 can be used to obtain the special processing logic preset for the big data processing framework corresponding to the frame identifier, and the special processing logic includes special processing logic compared with other big data processing fram...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a templated data processing method and device. The method comprises the steps of determining a data processing request containing to-be-processed data and a frame identifier; obtaining special processing logic preset for a big data processing framework corresponding to the framework identifier, the special processing logic comprising processing logic with specificity compared with other big data processing frameworks; according to the special processing logic and a preset operator template, generating a target operator adapted to the big data processing framework, the preset operator template including general processing logic adapted to various big data processing frameworks and vacancies reserved for the special processing logic; and in response to the data processing request, executing data processing by utilizing the target operator according to the to-be-processed data.

Description

technical field [0001] The present application relates to the field of image processing, in particular to a templated data processing method and device. Background technique [0002] In a big data processing environment, a variety of different big data processing frameworks may be deployed due to different considerations. For example, a variety of different big data processing frameworks, or different versions of the same framework, can be deployed for different time limit factors or different data volume factors. [0003] However, in practical applications, in order to realize data processing, different big data processing frameworks need to be adapted respectively. In related technologies, it is usually possible to adapt corresponding operators for each type of big data processing framework. During data processing, corresponding operators can be used to implement data processing according to different big data processing frameworks. A sub can represent a data processing ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/36
CPCG06F8/36
Inventor 高体伟邹立民贾喜顺苏萌刘钰孙伟
Owner 北京百分点科技集团股份有限公司