Data processing method, device and equipment

A data processing and operator technology, applied in the Internet field, can solve problems such as no selection method

Pending Publication Date: 2020-10-27
ALIBABA GRP HLDG LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, when the data lake analysis system supports CPU resources, FPGA resources, and GPU resources at the same time, there is no reasonable way to choose which computing resource should be selected to process the data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, device and equipment
  • Data processing method, device and equipment
  • Data processing method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, rather than limiting the present application. As used in this application and the claims, the singular forms "a", "the" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

[0047] It should be understood that although the embodiments of the present application may use terms such as first, second, and third to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of the present application, first information may also be called second information, and similarly, second ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method, device and device. The method comprises the steps of obtaining a to-be-processed operator corresponding to a data processing request; obtaining cost values respectively corresponding to the to-be-processed operator under a plurality of resource types; selecting a target resource type from the plurality of resource types according to the cost value;and executing the operator to be processed through the computing resource corresponding to the target resource type. Through the technical scheme of the invention, higher processing performance can beobtained, and the user experience is better.

Description

technical field [0001] The present application relates to the technical field of the Internet, and in particular to a data processing method, device and equipment. Background technique [0002] Data Lake Analytics is used to provide users with serverless (Serverless) query and analysis services, which can analyze and query massive data in any dimension, and support high concurrency, low latency (millisecond response), Real-time online analysis, mass data query and other functions. The data lake analysis system may include a database and a computing node. The database is used to store a large amount of data, and the computing node is used to receive an execution plan and process the data in the database according to the execution plan. [0003] In order to accelerate data processing and computing performance, the data lake analysis system provides various types of computing resources. For example, CPU (Central Processing Unit, central processing unit) resources, FPGA (Field...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5027G06F9/50
Inventor 周祥王烨李鸣翔
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap