Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Local computing and distributed computing based data computing method and system

A distributed computing and local computing technology, applied in the field of computer science, can solve the problems of high implementation cost, redundant processing power, large preparation time, etc., and achieve the effect of optimizing computing efficiency, avoiding data preparation time, and ensuring computing efficiency.

Active Publication Date: 2016-04-06
GUANGZHOU SHIYUAN ELECTRONICS CO LTD
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to optimize computing efficiency, on the one hand, it is to enhance the performance of local computing, or to optimize local algorithms; after optimization, for micro data projects, there is a surplus of processing capacity, which forms a waste of resources, and the implementation cost of optimization is high; on the other hand On the one hand, distributed computing is used; however, for small-scale data projects, if distributed computing is used due to the relatively large preparation time, there will be data loading delay problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Local computing and distributed computing based data computing method and system
  • Local computing and distributed computing based data computing method and system
  • Local computing and distributed computing based data computing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0042] The embodiments provided by the present invention include embodiments of data computing methods based on local computing and distributed computing, and also include corresponding embodiments of data computing systems based on local computing and distributed computing, which will be described in detail below.

[0043] figur...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a local computing and distributed computing based data computing method and system. The method comprises: calling preset local computing mode and distributed computing mode to compute a same data item, marking the computing mode with relatively short computing time as a preferred computing mode of the data item, and obtaining training samples each containing data volume, the preferred computing mode and computing time information; according to the training samples, generating a training model; and estimating the data volume of a to-be-processed data item, and according to the training model and the data volume of the to-be-processed data item, determining the computing mode adapting to the to-be-processed data item and calling the computing mode to compute the to-be-processed data item. Through the data computing method and system, computing policies adapting to the scales of data items can be selected for different data items, the realization cost is low, and the computing efficiency is optimized.

Description

technical field [0001] The present invention relates to the field of computer science and technology, in particular to a data calculation method and system based on local calculation and distributed calculation. Background technique [0002] With the rapid expansion of Internet data, distributed computing is also becoming more mature. Distributed computing is a computer science that mainly studies distributed systems, such as hadoop distributed systems. A distributed system includes several computers interconnected by a network, and these computers cooperate with each other to accomplish a common goal (this common goal is called a "project"). The specific process is: divide the data items that need to be calculated into small pieces, and calculate them separately by multiple computers, and then upload the calculation results and combine them to draw data conclusions. A computer program running on a distributed system is called a distributed computing program, and distribut...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/27G06F16/285
Inventor 陈振安
Owner GUANGZHOU SHIYUAN ELECTRONICS CO LTD
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More