Multi-language mixed stream processing method and device

A processing method and multi-language technology, applied in the field of artificial intelligence, can solve problems such as the inability to support multi-language mixed stream processing, and achieve the effect of reducing data serialization and high performance

Active Publication Date: 2022-06-03
ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This requires stream processing engines to support multilingual mixed stream processing, but most of the existing stream processing engines cannot support multilingual mixed stream processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-language mixed stream processing method and device
  • Multi-language mixed stream processing method and device
  • Multi-language mixed stream processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] The solution provided in this specification will be described below with reference to the accompanying drawings.

[0018] First of all, it should be noted that the terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise.

[0019] It should be understood that the term "and / or" used in this document is only an association relationship to describe the associated objects, indicating that there may be three kinds of relationships, for example, A and / or B, which may indicate that A exists alone, and A and B exist at the same time. B, there are three cases of B alone. In addition, the character " / " in this document generally indicates that the related obj...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a multi-language mixed stream processing method and device. According to the specific technical scheme, the method comprises the steps that JobGraph (work graph) is generated according to the multi-language mixed flow, and at least one work node in the JobGraph is provided with a language type attribute tag; according to the JobGraph, generating an Execution Graph (Execution Graph), wherein the Execution Graph comprises task nodes of different language types; and respectively creating independent task processes for the task nodes of different language types so as to execute processing tasks corresponding to the task nodes.

Description

technical field [0001] One or more embodiments of this specification relate to the technical field of artificial intelligence, and in particular, to a method and apparatus for processing multilingual mixed streams. Background technique [0002] As the requirements for real-time data become higher and higher, more and more businesses place more emphasis on timeliness. For example, real-time recommendation, risk control, weather forecast and other services. These services have made the application of stream computing more and more popular, and stream processing engines such as Flink, Sparkstreaming, and ray reltime have emerged, and are gradually applied in the field of artificial intelligence. Since languages ​​such as Java and Python have their own advantages, the processing of different languages ​​is often included in the application of online learning. This requires the stream processing engine to support multilingual mixed stream processing. However, most of the existi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/46
CPCG06F9/465
Inventor甘润生程红伟吴华
OwnerALIPAY (HANGZHOU) INFORMATION TECH CO LTD