Unlock instant, AI-driven research and patent intelligence for your innovation.

Systems and methods for performing aggregate processing on each piece of received data

A technology for receiving data and data, which is applied in special data processing applications, database models, database indexes, etc., and can solve problems such as expensive development

Active Publication Date: 2018-10-12
INT BUSINESS MASCH CORP
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, aggregation processing for a large amount of data involves an extremely large amount of data access processing, and the above-mentioned application cannot be easily made to handle aggregation processing for a large amount of data, and furthermore, development is extremely expensive

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Systems and methods for performing aggregate processing on each piece of received data
  • Systems and methods for performing aggregate processing on each piece of received data
  • Systems and methods for performing aggregate processing on each piece of received data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In the following, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0040]

[0041] figure 1 is a diagram showing an example of a schematic configuration of the aggregation processing system 1 according to the embodiment of the present invention. The aggregation processing system 1 is a system that executes aggregation processing each time a piece of data arrives when many pieces of data are arriving one after another from the outside, and it is not necessary to perform processing collectively after accumulating individual pieces of data. In the embodiment, the aggregation process refers to a process of performing arithmetic processing on the arriving data, saving the result, and updating the database after merging the arriving data with the already held data.

[0042] The aggregation processing according to the embodiment is performed based on the following rules. When data arrives at the aggregate proce...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An aggregation processing system includes a data transmission unit for transforming data which is a target of an aggregation process into a format of a tuple having a key and for transmitting the tuple to a data processing unit, and the data processing unit for performing an aggregation process of a tuple which has been transmitted. When a tuple transmitted from the data transmission unit is received, the data processing unit invokes an operator and performs an aggregation process. In the aggregation process, aggregated data is generated based on the tuple received by the data processing unit and a related input table, and writing to an output table or generation of an output tuple is performed based on the generated aggregated data. A plurality of aggregation processes are implemented by combining processes by the operators, and the plurality of aggregation processes are performed as one transaction.

Description

technical field [0001] The present invention relates to a system, method and program for performing aggregation processing for each piece of received data. Background technique [0002] Conventionally, as a method of processing a large amount of incoming or arriving events or data, there has been a method of temporarily accumulating received events or individual pieces of data, and building on them by performing batch processing in units of days, weeks, months, etc. Processing is performed collectively. On the other hand, there is a growing need for methods to process arriving data in real-time. For example, a technique called CEP (Complex Event Processing) is known, according to which the processing content or analysis scene of data is set in advance, and when the arriving data matches the condition, the preset action (for example, See Patent Document 1). There is also a technique called ETL (Extract Transform Load) that performs processing of collectively transforming p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/46
CPCG06F16/22G06F16/285
Inventor 山本学马屋原宪明佐佐木卓细川馨
Owner INT BUSINESS MASCH CORP