Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method, device, electronic device and storage medium

A technology for processing storage and data processing, applied in the field of data processing, can solve problems such as inflexible allocation of processing nodes, and achieve the effects of improving convenience and flexibility, avoiding resource waste, and improving resource utilization efficiency

Active Publication Date: 2021-12-07
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present disclosure provides a data processing method, device, electronic device, and storage medium to at least solve the problem of inflexible allocation of processing nodes in a cluster in the related art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, device, electronic device and storage medium
  • Data processing method, device, electronic device and storage medium
  • Data processing method, device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0136] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0137] It should be noted that the terms "first" and "second" in the specification and claims of the present disclosure and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present disclosure relates to a data processing method, device, electronic device, and storage medium. The method includes: responding to a task processing instruction, determining task resource consumption information of a task to be processed; acquiring preset task template configuration information, based on the The task resource consumption information configures the node resource parameters in the task template configuration information to obtain the initial task configuration information corresponding to the task to be processed; based on the task identifiers of multiple subtasks in the task to be processed, Configure the task parameters in the task configuration information to obtain the target task configuration information corresponding to the task to be processed; based on the target task configuration information, assign multiple subtasks in the task to be processed to the resource parameters of the first target node Corresponding multiple first target nodes. The present disclosure can solve the problem of inflexible allocation of processing nodes in the cluster in the related art.

Description

technical field [0001] The present disclosure relates to the technical field of data processing, and in particular, to a data processing method, device, electronic equipment, and storage medium. Background technique [0002] In the processing scenario of a large amount of data and high-order tasks, such as the tasks of real-time collection, real-time calculation and real-time feedback processing results of high-order data, which have the characteristics of large amount of data, fast processing and reliable results, etc., only relying on Standalone processing efficiency is low. [0003] In related technologies, in order to cope with the lack of single-computer computing performance, by introducing server clusters to participate in parallel computing, generally the processing nodes allocated for tasks to be processed and the processing nodes allocated for storing data resources are fixed, so that it is impossible to process Nodes are allocated flexibly. Contents of the inve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5027G06F9/5072
Inventor 岳景来
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD