Stream processing device and stream processing system

A streaming processing and parameter configuration technology, which is applied to program control devices, creating/generating source code, programming languages/examples, etc., can solve the problems of complicated calling process and increase the learning curve of developers, so as to simplify the development difficulty and realize the Configurable, easy-to-change effects

Inactive Publication Date: 2016-11-09
CHINA CONSTRUCTION BANK
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This kind of product status leads to the fact that in the face of so many dazzling products, as a front-line code developer, they face many difficulties and pressures

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stream processing device and stream processing system
  • Stream processing device and stream processing system
  • Stream processing device and stream processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] In order to facilitate the understanding of various aspects, features and advantages of the technical solutions of the present invention, the present invention will be specifically described below in conjunction with the accompanying drawings. It should be understood that the various implementations described below are only for illustration, rather than limiting the protection scope of the present invention.

[0016] Firstly, the names or terms that may be involved in the present invention are explained.

[0017] Real-time: The business system continuously generates events (messages / calls) according to different operations, and then causes a series of timely processing and analysis processes.

[0018] Stream processing: Business systems generate events (messages / calls) in real-time. After a series of processing and analysis, this process is distributed across multiple computers and completed in parallel. It looks like events are continuously flowing through multiple com...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a stream processing device and a stream processing system. The stream processing device comprises an interface, computing frameworks, a configuration file and a loading processing module. The interface is used for being called by application; the computing frameworks are used for operating executable instances; the configuration file is configured with stream processing related configuration parameters; the loading processing module is used for loading the configuration file and generating the executable instances according to the configuration parameters. The stream processing device and the stream processing system have the advantages that the stream processing related configuration parameters can be configured by the aid of the configuration file and are configurable, the computing frameworks (or computing models) are transparent for developers, and accordingly technicians can flexibly change the configuration parameters; the unified interface can be called by the application, accordingly, uncertain factors due to new technical change can be shielded, the development difficulty can be lowered for the developers, and learning curves can be simplified for the developers.

Description

technical field [0001] The present invention relates to the field of stream processing, and more specifically, to a stream processing device and a stream processing system. Background technique [0002] With the advent of the era of cloud computing, big data has also attracted more and more attention. Big data is often used to describe large amounts of unstructured and semi-structured data that would take too much time and money to download to a relational database for analysis. Big data analysis is often associated with cloud computing because real-time analysis of large data sets requires a framework like MapReduce (an existing programming model) to distribute work to tens, hundreds, or even thousands of worker nodes. [0003] IBM proposed the 5V characteristics of big data: Volume (large amount), Velocity (high speed), Variety (variety), Value (value) and Veracity (authenticity). Big data requires special techniques to efficiently handle large volumes of data that toler...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/44
CPCG06F8/31
Inventor 常涛黎育龙聂砂
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap