Method and device for automatically configuring data warehouse parallel task queues

A task queue and configuration data technology, applied in the computer field, can solve problems such as random startup tasks, waste of resources, long system resources, etc., and achieve the effect of avoiding low resource usage and overcoming low execution efficiency

Pending Publication Date: 2017-11-03
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF2 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, after assigning task process resources to a user, when the user enters some tasks to be executed, the execution order of these tasks is random. The reason for the random execution here may be the order in which the user manually executes the tasks, or the user Set the task to execute automatically, but the server-side startup task is random
The disadvantage of the prior art method is that after inputting the N tasks executed by the user, they are randomly assigned to the task resource process for processing, without considering the different execution conditions of each task, such as the occupancy of resources, etc. Reasonable planning of all user tasks and the matching between user tasks and resource process queues assigned to them will cause users to occupy system resources for a long time and the resource utilization rate is low. When there are many users on the data warehouse, lead to overall waste of resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for automatically configuring data warehouse parallel task queues
  • Method and device for automatically configuring data warehouse parallel task queues
  • Method and device for automatically configuring data warehouse parallel task queues

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0033] figure 1 It is a schematic flowchart of data task assignment and execution on a data warehouse in the prior art.

[0034] Such as figure 1 As shown, the process of assigning and executing data tasks on the data warehouse in the prior art includes three parts, the first part is task input, the second part is task distribution, and the third part is task execution. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and device for automatically configuring data warehouse parallel task queues, electronic equipment and a computer readable medium. The method comprises the following steps of: acquiring history data about operation of tasks of a user in a data warehouse; processing the history data and carrying out statistic to obtain resource occupation time lengths of the tasks; sorting the tasks according to the resource occupation time lengths; and distributing the tasks in task queues according to the sorting result and resource process number of the user.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for automatically configuring parallel task queues in a data warehouse, electronic equipment and a computer-readable medium. Background technique [0002] At present, after an enterprise establishes an internal data warehouse system, when users in different departments obtain the required data, they will develop corresponding data tasks on the data warehouse. Each task includes a number of business data processing logics. Execute, and finally get the required data result. [0003] Due to the large number of people who use the data warehouse to obtain data, and the system resources are limited, in order to ensure the normal use of each user, a certain amount of concurrent task control is given to assigned users. For example, a user can be assigned to execute 3 tasks concurrently, that is, the user is assigned 3 exclusive task process resources, so that when ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5038
Inventor 李建星
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap