Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device of streaming computing system, electronic equipment and medium

A stream computing and data processing technology, applied in the field of data processing, can solve problems such as not being able to solve problems well, and achieve the effect of reducing storage costs

Active Publication Date: 2021-11-12
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the traditional data processing flow cannot solve the problem well in some real-time search application environments

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device of streaming computing system, electronic equipment and medium
  • Data processing method and device of streaming computing system, electronic equipment and medium
  • Data processing method and device of streaming computing system, electronic equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0023] In the present disclosure, unless otherwise stated, using the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, temporal relationship or importance relationship of these elements, and such terms are only used for Distinguishes one element from another. In some examples, the first element and the second ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data processing method and device of a streaming computing system, electronic equipment, a computer readable storage medium and a computer program product, and relates to the field of data processing, in particular to the technical field of streaming computing and data storage. According to the implementation scheme, the method comprises the following steps: obtaining result data obtained by processing original data in a first data stream fragment; determining a data type of the result data, with the data type comprising a random read-write type and a sequential read-write type; and writing the determined data of the random read-write type into a first storage area of a storage system in the form of a first data block and writing the determined data of the sequential read-write type into a second storage area of the storage system in the form of a second data block through atomic write operation. The first data block comprises a pointer pointing to the second data block corresponding to the same atomic write operation.

Description

technical field [0001] The present disclosure relates to the field of data processing, in particular to the technical fields of streaming computing and data storage, and in particular to a data processing method, device, electronic equipment, computer-readable storage medium, and computer program product of a streaming computing system. Background technique [0002] In the traditional data processing process, the data is always collected first and then put into the database. When people need to query the data through the database, get answers or perform related processing. However, the traditional data processing flow cannot solve the problem well in some real-time search application environments. As a result, a new data computing structure—stream computing mode has emerged. It can analyze large-scale flow data in real time during the changing movement process, capture potentially useful information, and send the results to the next computing node. In the calculation proc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/23G06F16/27G06F16/28
CPCG06F16/2365G06F16/27G06F16/285
Inventor 朱良昌石然汪婷孙英富田勇龚宓
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD