Method, device and system for data processing

A data processing and data technology, applied in the Internet field, can solve problems such as poor real-time performance and poor scalability

Active Publication Date: 2013-03-06
ALIBABA GRP HLDG LTD
View PDF3 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The embodiment of the present application provides a data processing method, device and system to solve the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device and system for data processing
  • Method, device and system for data processing
  • Method, device and system for data processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Since the data processing method in the prior art is mainly limited by the ability of the data processing device, the data processing device cannot continuously perform processing operations, but can only save the data first, and batch processing at a set time interval Process the data. Therefore, in the embodiments of the present application, in order to continuously process the data in the data stream and improve the real-time performance of data processing, a distributed system is used to process the data in the data stream, and the entire process of data processing is split. For several data processing tasks, different processing nodes in the distributed system perform different data processing tasks to share the pressure of data processing, so as to continuously process the data in the data stream and improve the real-time performance of data processing. purpose. In addition, in order to improve the scalability of the data processing system, in the embodiment of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method, a device and a system for data processing and aims to solve the problem that data processing by the prior art is poor in timeliness and expandability. The method includes: allowing one processing node to acquire every data processing task configured for the processing node from a coordinator server; receiving every data flow output by a higher-level processing node; extracting data satisfying input conditions from data included in each data flow according to corresponding input conditions of the acquired data processing tasks; processing the extracted data according to corresponding processing logic of the data processing tasks; when presence of a lower-level processing node is confirmed, transmitting the processed data to the lower-level processing node for processing; and when the presence is not confirmed, outputting the processed data as processing result. Timeliness in data processing is improved, and expandability of the data processing system is improved.

Description

Technical field [0001] This application relates to the field of Internet technology, and in particular to a method, device and system for data processing. Background technique [0002] With the increase of Internet users and the increasing number of visits to large websites, a large number of data streams have appeared on the Internet. Among them, the data stream is composed of multiple data, and the data constituting the data stream carries the data stream identifier corresponding to the data stream. information. [0003] Each data in the data stream often has strong real-time performance, and the data processing device is required to process each data in the data stream in time. For example, the data in the data stream includes the amount of visits a user visits to a certain website. The timely processing of the data including the amount of visits can reflect the changes in the amount of visits to the website and analyze the visits of users to the website every hour of the day ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/801
Inventor 张维王晓哲郑培祥原攀峰张茂森朱震杰
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap