Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing logic grouping method and device and electronic equipment

A data processing and grouping technology, applied in the computer field, can solve the problems of data processing timing cannot be guaranteed, calculation time is long, blocking data processing, etc.

Pending Publication Date: 2022-03-25
ROOTCLOUD TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the above parallel processing process, data from the same data source can be assigned to different computing units according to certain rules for parallel computing (for example, user operation records can be allocated to different computing units according to the user's unique identifier), but, Since there may be strict timing requirements before and after the calculation of the same type of data (for example, the user's operation timing may be: login → browse → add shopping cart → place an order → log out, the corresponding five operation logs are sequential), if put If they are executed in parallel in different computing units, the timing of data processing will not be guaranteed. Therefore, the same type of data is usually handed over to a specific computing unit for execution when grouping.
However, when the data pattern of the same type of data is too large, the calculation time is relatively long, which will block the processing of subsequent data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing logic grouping method and device and electronic equipment
  • Data processing logic grouping method and device and electronic equipment
  • Data processing logic grouping method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0069] According to an embodiment of the present invention, an embodiment of a data processing logic grouping method is provided. It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0070] figure 2 is a flowchart of a data processing logic grouping method according to an embodiment of the present invention, such as figure 2 As shown, the method includes the following steps:

[0071] Step S202, obtaining the attribute node reference relationship diagram of the data processing logic, the cost of each attribute node in the attribute node reference relationship graph, the cost of the root node dependency tree, the cost of the attribute node reference relation graph, the maximum co...

Embodiment 2

[0168] The embodiment of the present invention also provides a data processing logic grouping device, the data processing logic grouping device is mainly used to execute the data processing logic grouping method provided in the first embodiment of the present invention, the following provides the embodiment of the present invention The grouping device of data processing logic will be introduced in detail.

[0169] Figure 6 is a schematic diagram of a data processing logic grouping device according to an embodiment of the present invention, such as Figure 6 As shown, the device mainly includes: an acquisition unit 10, a first grouping unit 20 and a second grouping unit 30, wherein:

[0170] The acquisition unit is used to obtain the attribute node reference graph of data processing logic, the cost of each attribute node in the attribute node reference graph, the cost of the root node dependency tree, the cost of the attribute node reference graph, and the maximum value of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data processing logic grouping method and device and electronic device.According to the method, before a processing task is submitted to a real-time data processing engine, input and output attributes are grouped according to input and output mode definition and mapping calculation logic of a user to each calculation processor in a model, and the processing task is submitted to a real-time data processing engine; large-mode computational logic can be split, parallelization is facilitated, and computational resources are fully utilized.

Description

technical field [0001] The present invention relates to the technical field of computers, in particular to a data processing logic grouping method, device and electronic equipment. Background technique [0002] The real-time data processing logic includes the following information: information of the source (source) (data source, type of data source, configuration of the data source), information of the sink (data sink, type of data sink, configuration of the data sink) ) and computing processor (Processor) information (including: input data and output data schema (Schema, name, data type, etc.), mapping calculation logic from each attribute of input data to each attribute of output data, such as figure 1 shown), where the real-time data processing logic can be: Source→Processor1→Processor2→…→Processor N→Sink. [0003] The general real-time data processing engine can generate real-time data processing logic according to the user's definition. Specifically, first read the d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N7/00
CPCG06N7/00
Inventor 顾敬潇丁宇张建国陈垚亮
Owner ROOTCLOUD TECH CO LTD