Method and device for real-time data processing

A technology of real-time data processing and equipment, applied in the field of data processing, can solve problems such as inability to process data effectively in real time, and achieve the effect of real-time data processing and optimal configuration

Active Publication Date: 2016-12-14
EMC IP HLDG CO LLC
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Therefore, in the face of the defect that the existing parallel processing schemes cannot process data effectively in real time, how to realize real-time and efficient data processing without increasing the existing hardware investment as much as possible has become an urgent problem to be solved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for real-time data processing
  • Method and device for real-time data processing
  • Method and device for real-time data processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logic devices for implementing the specified Executable instructions for a function. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention relate to methods and apparatus for real-time data processing. According to one embodiment, a method for real-time data processing is provided. The method includes: in response to receiving a plurality of jobs, analyzing a constraint relationship among the plurality of jobs to obtain pipeline information; reading at least a part of data to be processed; and executing a plurality of jobs based on the pipeline information and on the data to be processed to generate at least Part of the processing results. According to another embodiment, an apparatus for real-time data processing is provided.

Description

technical field [0001] Various embodiments of the present invention relate to data processing, and more particularly, to methods, devices and related computer program products for real-time processing of data. Background technique [0002] With the development of computer hardware and software technology, existing applications can provide more and more powerful data processing capabilities. For example, many computing devices can be deployed in a cluster, and multiple computing devices in the cluster can perform data processing in parallel. For users who submit data processing requests to the cluster, they / they don't care which computing device is processing their requests, but usually care more about how long data processing takes. For massive data processing (especially for data processing with high real-time requirements), how to improve data processing efficiency and return processing results to users as soon as possible has become a key factor in evaluating the perform...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/38
Inventor 杨子夜陈继东陈弢向东
Owner EMC IP HLDG CO LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap