Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data distributed cooperative processing method based on prediction

A collaborative processing and distributed technology, applied in digital data processing, resource allocation, program startup/switching, etc., can solve problems such as memory explosion, and achieve the effect of improving system efficiency

Inactive Publication Date: 2019-02-19
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] There are two ways to have data on the requisition machine. The first is data localization, which saves the processed data on the requisition machine, but if there is no limit to saving the data on the requisition machine, it will cause a memory explosion; the second is to save the data in advance. The required data is sent to the expropriation machine, provided that it is possible to predict which data will be used

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data distributed cooperative processing method based on prediction
  • Data distributed cooperative processing method based on prediction
  • Data distributed cooperative processing method based on prediction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the purpose, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the implementation methods and accompanying drawings.

[0027] The Long Short-Term Memory (LSTM) solves the technical problem of the disappearance of the gradient of the cyclic neural network due to the addition of the forgetting and preservation mechanism, and can handle the long-term dependence problem well. In view of this, the present invention aims at the characteristics of the task scheduling data of the police system, and uses the LSTM in the neural network to establish a cascaded LSTM. The same prediction process is divided into two steps, and the prediction result of the first step is used as a part of the result and As the screening condition input in the first step, the results of the two-step prediction together constitute the final prediction result, which not only does not predi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of task scheduling, and the data distributed cooperative processing method based on predictionof the invention firstly preprocesses data, including cleaning and defining data vectors. Then the cascaded LSTM is used to predict step by step, and the parameters of the network are adjusted continuously through training, and the data prediction function is obtained. Finally, according to the prediction function obtained from the training, we can predict the data needed for the upcoming task. If the predicted data already exists on the resource node, localizing the data; Otherwise, the data is sent to the resource node in advance after the data processing is finished. When scheduling a task, the task is firstly distributed to the resource node which has the required data. If the upper limit of the execution time of the task has not been executed, the task is redistributed to the node which has lower load, and the required data is obtained from theresource node which has the required data of the task. The invention saves the data processing time and the data transmission time of the existing task in the total task time, thereby effectively improving the system efficiency.

Description

technical field [0001] The invention belongs to the technical field of task scheduling, and in particular relates to a police data processing technology capable of deciding data distribution and data localization through data prediction. Background technique [0002] In the police system, the expropriation machine and the data that perform the task are separated, such as figure 1 As shown, when the task is submitted, according to the resource situation of the requisitioning machine, the task is distributed to the appropriate requisitioning machine based on the task scheduling strategy, and the corresponding data is sent to the requisitioning machine at the same time, that is, the task needs to be transmitted to the requisitioning machine after the data is transmitted. It can be executed later, but because the amount of police data is large, and the data required for the task is only a part of it, so the data needs to be processed before it is sent, so it can be concluded tha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4806G06F9/5016
Inventor 王锐罗光春田玲张栗粽王晓雪
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com