Unlock instant, AI-driven research and patent intelligence for your innovation.

A visualization flow processing engine of distributed flow calculation and a use method thereof

A processing engine and stream processing technology, applied in visual/graphic programming, requirements analysis, program code conversion, etc., can solve problems such as large workload, poor code reusability, and high capability requirements, so as to simplify the business processing process Effect

Active Publication Date: 2019-05-03
福建南威软件有限公司
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, for specific application processes that require distributed stream computing, currently only a single
[0005] After the stream processing platform, the programming operation is performed and then executed. The operati

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A visualization flow processing engine of distributed flow calculation and a use method thereof
  • A visualization flow processing engine of distributed flow calculation and a use method thereof
  • A visualization flow processing engine of distributed flow calculation and a use method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the features and advantages of this patent more obvious and understandable, the following examples are specially cited in conjunction with the drawings, and detailed descriptions are as follows:

[0027] Such as figure 1 As shown, the visual process processing engine for distributed stream computing provided by this embodiment includes:

[0028] Stream processing visual orchestration engine, stream processing process definition file generation engine and stream processing publishing engine.

[0029] The visual orchestration engine includes a coupled front-end visualization interface and background program code; the front-end visualization interface includes a desktop and multiple tags, and connections can be established between tags located on the desktop; each tag has the same name streaming analysis framework in the background program code Operators form a one-to-one mapping relationship, so that the selection of tags in the foreground is equivalent to calli...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a visual process processing engine for distributed stream computing and a use method thereof. The visual process processing engine comprises a stream processing visual orchestration engine, a stream processing process definition file generation engine and a stream processing release engine, wherein the visual orchestration engine comprises a foreground visual interface and abackground program code which are coupled with each other; wherein the foreground visual interface comprises a desktop and a plurality of tags; wherein each label and a same-name stream analysis framework operator in a background program code form a one-to-one corresponding mapping relation; wherein the stream processing process definition file generation engine is used for converting a process defined by a label for establishing connection on a desktop into a stream processing process definition file; the stream processing publish engine includes a plurality of processing unit operator adapters for a stream analysis platform. A set of flow type conversion engine implementation method based on visualization dragging, flow conversion and flow type processing engine adaptation is realized;and on-demand selection of the streaming analysis execution platform is realized.

Description

Technical field [0001] The invention relates to the field of distributed stream computing, in particular to a visual process processing engine for distributed stream computing based on SPARK STREAMING / FLINK / STORM and a use method thereof. Background technique [0002] Stream processing is an important big data processing method, and its main feature is that the data it processes is continuous and coming in real time. Distributed stream processing is a fine-grained processing mode oriented to dynamic data, which is based on distributed memory to process dynamic data that is continuously generated. Its features such as fast, efficient, and low latency for data processing play an increasingly important role in big data processing. [0003] In the current explosive development of Internet informatization, there are more and more big data analysis and the need for real-time processing of massive amounts of concurrent data. As an important technical means to solve this demand, distribu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F8/10G06F8/34G06F8/41G06F8/71
Inventor 阮义清
Owner 福建南威软件有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More