Real-time data calculation method and device

A technology of real-time data and real-time data processing, which is applied in computing, multi-programming devices, electrical digital data processing, etc., can solve the problems of increased processing delay, difficult support, and limited types of algorithms, so as to reduce system delay and improve The stability of the system and the effect of improving timeliness

Active Publication Date: 2017-08-25
ADVANCED NEW TECH CO LTD
View PDF6 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] On the one hand, although in the existing real-time data processing platform, the algorithm library in the algorithm platform can also be expanded by doing related algorithm development, but because the types of algorithms supported by the existing algorithm library on the platform are limited, only It is suitable for algorithm support for some stable businesses, but it is difficult to support those fast-changing business scenarios (such as large-scale promotional businesses in a short period of time)
[0006] On the other hand, in the existing real-time data processin

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time data calculation method and device
  • Real-time data calculation method and device
  • Real-time data calculation method and device

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0025] This application aims to propose a way to separate real-time computing tasks from the traditional real-time data platform, and use the python-based algorithm operating environment and algorithm library carried in the online business system docking with the real-time data platform to complete the real-time data platform Real-time data processing solution for computing tasks in real-time business data.

[0026] When implemented, the online business system can be equipped with a python-based algorithm operating environment and algorithm library. When real-time business data needs to be calculated, the online business system can obtain real-time business data from the docked real-time data processing platform, and based on the The target algorithm in the algorithm library generates a python computing task for the real-time business data, and assigns a computing node device to the python computing task based on a preset scheduling strategy, and sends the task to the computing no...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a real-time data calculation method. The method is applied to an online business system, wherein the online business system carries a python language-based algorithm operation environment and an algorithm library. The method comprises the following steps of: obtaining real-time business data from a butted real-time data processing platform by the online business system; generating a python calculation task for the real-time business data on the basis of a target algorithm in the algorithm library; distributing calculation node equipment for the python calculation task on the basis of a preset scheduling strategy, and issuing the python calculation task to the calculation node equipment to be executed; and outputting a calculation result, returned by the calculation node equipment, of the python calculation task through a visual interface. According to the method provided by the invention, the effectiveness of real-time calculation can be enhanced, and the calculation time delay can be reduced.

Description

technical field [0001] The present application relates to the field of computer applications, in particular to a method and device for calculating real-time data. Background technique [0002] In related technologies, real-time data processing platforms are usually equipped with an independent algorithm platform, and use the general solutions provided by the algorithm platform to provide relevant algorithm services to business operators; for example, the real-time data processing platform independently developed by Ali Group Take ODPS (Open Data Processing Service) as an example. The ODPS platform is usually equipped with algorithm platforms such as XLib and PAI to provide various types of algorithm services for Ali Group. [0003] The algorithm platform carried on the real-time data processing platform usually uses the message middleware integrated in the platform to collect the original business data by collecting the log files generated by the business system, and returns...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48
CPCG06F9/4881
Inventor 何凯程磊
Owner ADVANCED NEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap