Task processing method and device and computer readable storage medium

A task processing and computer technology, applied in computing, program control design, electrical digital data processing, etc., can solve problems such as unreasonable scheduling of packaging tasks, waste of resources, long packaging time, etc.

Inactive Publication Date: 2020-02-07
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in the solutions of the prior art, when the SQL is executed by computing engines such as Sp

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task processing method and device and computer readable storage medium
  • Task processing method and device and computer readable storage medium
  • Task processing method and device and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0024] In order to make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments It is a part of the embodiments of the present disclosure, but not all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present disclosure.

[0025] At present, in many application scenarios, data needs to be packaged. Specifically, it is necessary to filter out target data from the data and package it, for example, to classify people based on the data. For example, in application scenarios such as information promotion and product recommendation, it is necessary to cla...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a task processing method and device and a computer readable storage medium. The task processing method comprises: a computing engine receiving a task for generating a data packet sent by a task platform through an idle queue; wherein the idle queue is determined by the task platform in a queue list; the calculation engine acquiring operation information ofthe started calculation units and determining idle calculation units according to the operation information; and the computing engine allocating the task for generating the data packet to the idle computing unit, so that the idle computing unit processes the task for generating the data packet. According to the scheme, the task platform sends a task for generating a data packet to the computing engine through the idle queue, and the computing engine allocates the received task for generating the data packet to the idle computing unit for processing, so that the task processing method providedby the embodiment of the invention can deploy the task, thereby reasonably scheduling each task and fully utilizing the computing resources of the computing engine.

Description

technical field [0001] Embodiments of the present disclosure relate to packaging task processing technologies, and in particular, to a task processing method, device, and computer-readable storage medium. Background technique [0002] At present, in many application scenarios, it is necessary to divide groups of people, so as to provide personalized services to each group of people. For example, different information can be pushed for different groups of people, and then effective information that meets their needs can be recommended to users. [0003] In the prior art, when the crowd is divided, according to the original crowd data, the SQL (Structured Query Language, Structured Query Language) statement corresponding to the packaging task can be input on the crowd package platform, and through Spark (ApacheSpark is designed for large-scale data processing) The calculation engine such as the designed fast and general calculation engine) executes the SQL, and then completes...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5016G06F9/5038
Inventor 叶松
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products