Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device of distributed task processing

A distributed processing and task technology, applied in the computer field, to achieve the effect of convenient data acquisition

Active Publication Date: 2018-03-16
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF7 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0018] In view of this, the embodiments of the present invention provide a method and device for distributed processing tasks to solve the bottleneck problem in the prior art when single task compilation and deployment nodes are faced with processing large-scale tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device of distributed task processing
  • Method and device of distributed task processing
  • Method and device of distributed task processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0078] The present invention will be specifically described below in conjunction with a specific embodiment, but it should be noted that this specific embodiment is only for better describing the present invention, and does not constitute an improper limitation of the present invention.

[0079] First, according to the processing requirements of the task, create a Jenkins Master collection (Jenkins Master Pool) containing a preset number of JenkinsMasters through the Kubernetes system, and save the information of each Jenkins Master in the Jenkins Master collection to the Server table of the Mysql database. Wherein, the information recorded in the Server table at least includes: one or more of: the IP address of the server of each Master, whether the status of the Master is idle, and the number of tasks that the Master has completed.

[0080] Then, after the application program interface (API) receives the task request, the request type of the task request is judged.

[0081]I...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a device of distributed task processing. The method includes: receiving a task request of a to-be-executed task; and selecting a task compilation and deployment node, which executes the to-be-executed task, according to the task request, and sending the to-be-executed task to the task compilation and deployment node for execution. According to the method and thedevice of distributed task processing provided by the embodiment of the invention, multiple task requests are processed through establishing a task compilation and deployment node set containing a maximum concurrent number of task compilation and deployment nodes, the task compilation and deployment nodes can be created in real time according to the number of processed tasks to satisfy processingrequirements for the large-scale task requests, and the bottleneck problem of a single task compilation and deployment node in facing processing of the large-scale tasks is effectively solved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for distributed processing tasks. Background technique [0002] Continuous integration tools can be used to monitor continuous and repetitive work, including: continuous software version release / test projects and monitoring work performed by external calls. Each task compilation and deployment node in the continuous integration tool can be used to realize the processing of large-scale deployment and compilation tasks. In the distributed task compilation and deployment system built by continuous integration tools, task compilation and deployment nodes are prone to performance bottlenecks or excessive task pressure on single task compilation and deployment nodes when processing large-scale deployment and compilation tasks. [0003] Take Jenkins as an example, Jenkins is a continuous integration tool developed based on Java. The entire environment of Jenkins'...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/41G06F8/60
CPCG06F8/41G06F8/60
Inventor 王峰刘海锋
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com