Stream computing engine testing method and device

A test method and a technology of a test device, applied in the field of data processing, can solve problems such as inability to ensure the selection of the most suitable stream computing engine, low efficiency, and inability to ensure the selection of a stream computing engine, so as to improve data processing efficiency, high efficiency, logic simple effect

Active Publication Date: 2017-05-10
SHENZHEN AUDAQUE DATA TECH
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This approach is inefficient and cannot guarantee the selection of the most suitable stream computing engine
[0005] Therefore, the defect in the existing technology is that using different stream computing engines for data p

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stream computing engine testing method and device
  • Stream computing engine testing method and device
  • Stream computing engine testing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] figure 1 It shows a flow chart of a testing method for a stream computing engine provided by an embodiment of the present invention; figure 1 As shown, Embodiment 1 of the present invention provides a test method for a stream computing engine, including:

[0049] Step S1, acquiring the target scene;

[0050] Step S2, selecting a plurality of measurement parameters corresponding to the target scene, where the plurality of measurement parameters are pre-saved measurement parameters;

[0051] Step S3, call the flow computing engine, process the sample data through the flow computing engine, and obtain the running result of the flow computing, and the sample data is the data corresponding to the target scene;

[0052] Step S4, according to the running result of the flow calculation, obtain the measurement values ​​corresponding to a plurality of measurement parameters;

[0053] Step S5, according to the measurement values ​​corresponding to the multiple measurement param...

Embodiment 2

[0086] Based on the testing method of the streaming computing engine in the first embodiment and the testing device 10 of the streaming computing engine, combined with the specific development language environment and application scenarios, the specific testing process of the streaming computing engine is described.

[0087] The testing method and device of the stream computing engine provided by the present invention, the development language environment is Java. Combining flink-related concepts to express the abstract logic of stream computing in detail: the abstract content of stream computing scenarios is to process (operate, also called operations, the input stream) on the computing engine. Mixed in the following), and the process of processing data can be decomposed into multiple operators (operators, also called operators, mixed in the following) and the data flow (stream) between operators, and combined into a complex Processing logic (topology).

[0088] Then classif...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a stream computing engine testing method and device. The method comprises the steps that a target scene is acquired, multiple measuring parameters corresponding to the target scene are selected, stream computing engines are called, and sample data is processed with the stream computing engines to obtain stream computing running results; measuring values corresponding to the measuring parameters are obtained according to the stream computing running results, and testing results of the stream computing engines are obtained through analyzing. According to the stream computing engine testing method and device, different stream computing engines are automatically called through programs, the running results of the stream computing engines are collected, and an appropriate stream computing engine is selected by analyzing the running result; evaluation on the stream computing engines is abstracted into a plurality of testing parameters, the running process of the stream computing engines is monitored by calling the stream computing engines, therefore, the measuring values of all the testing parameters are acquired, the performances of the stream computing engines are objectively reflected, and the efficiency is high.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a testing method and device for a stream computing engine. Background technique [0002] The flow computing engine is used to analyze large-scale flow data in real time during the changing movement process. Its application scenarios are wide and varied. For example, for data processing in the financial field. [0003] In the daily operation of the financial and banking field, a large amount of data is often generated, and the timeliness of these data is often short. Therefore, the financial and banking field is one of the most typical application scenarios of big data streaming computing, and it is also the earliest application field of big data streaming computing. Within the financial banking system, a large amount of often structured data flows between various systems every moment, and real-time calculation is required. At the same time, the financial banking system and othe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/36
CPCG06F11/3688
Inventor 何婷边旭贾西贝
Owner SHENZHEN AUDAQUE DATA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap