Unlock instant, AI-driven research and patent intelligence for your innovation.

Large-scale data processing system and method

A large-scale data and processing system technology, applied in the direction of input/output to record carrier, etc., can solve the problem that the network bandwidth system memory cannot meet the needs of large-scale data processing, and achieve shortening of calculation time, load balancing, and optimization of data transmission process Effect

Active Publication Date: 2018-03-09
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the existing data processing systems and methods are limited by the performance of network bandwidth and system memory, and cannot meet the processing requirements of large-scale data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale data processing system and method
  • Large-scale data processing system and method
  • Large-scale data processing system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to make the purpose, technical solution and advantages of the present invention more clear, the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined arbitrarily with each other.

[0021] The steps shown in the flowcharts of the figures may be performed in a computer system, such as a set of computer-executable instructions. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0022] The large-scale data processing system involved in the embodiment of the present invention is applied to a mixed heterogeneous cluster of a central processing unit and a graphics processing unit, specifically, a computer cluster or a server cluster,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a large-scale data processing system and method, which are applied to a mixed heterogeneous cluster of a central processing unit and a graphics processing unit, including at least one shared storage node, a control node and multiple computing nodes, and the described The shared storage node, the control node and multiple computing nodes are connected, and the control node makes overall planning and distribution of the basic data blocks in the data packet to each computing node, so that the load of each computing node is balanced, and each computing node directly loads from the shared storage The node reads the corresponding basic data block for calculation, and returns the calculated result to the control node, which optimizes the data transmission process and shortens the calculation time, thereby maximizing the use of the performance of the existing system and greatly improving the efficiency of the entire system , without being limited by insufficient network bandwidth and small memory capacity, it meets the requirements of high-performance applications for large-scale data processing.

Description

technical field [0001] The invention relates to a large-scale data processing technology, in particular to a large-scale data processing system and method. Background technique [0002] At present, in the era of data explosion, there are more and more information data, and people's requirements for information data processing capabilities are also getting higher and higher. Not only oil exploration, weather forecast, aerospace defense, scientific research, etc. require high-performance computing, but also financial , Government informatization, education, enterprises, online games, artificial intelligence and other wider fields have rapidly increased demand for high-performance computing, and computing speed is particularly important for high-performance computing. [0003] In the prior art, high-performance computing is developing toward multi-core and many-core, and a heterogeneous collaborative computing mode of a central processing unit (Central Processing Unit, referred...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
Inventor 高永虎张清
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com