Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Big Data Processing System

A big data processing and big data technology, applied in the field of big data processing, can solve the problems of undisclosed big data processing systems, etc., achieve the effect of parallel processing of pipeline, realize online update, and reduce data transmission delay

Pending Publication Date: 2019-02-15
SHANDONG CHAOYUE DATA CONTROL ELECTRONICS CO LTD
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] A large data processing system based on a domestic CPU has not been disclosed in the prior art. This system can meet the real-time requirements of tasks with high computational complexity, realize the parallel processing of computational tasks, and reduce the data transmission delay between JVM and FPGA. Realize label online update function, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Big Data Processing System
  • A Big Data Processing System
  • A Big Data Processing System

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0027] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are to distinguish two entities with the same name but different parameters or parameters that are not the same, see "first" and "second" It is only for the convenience of expression, and should not be construed as a limitation on the embodiments of the present invention, which will not be described one by one in the subsequent embodiments.

[0028] Based on the above purpose, the first aspect of the embodiments of the present invention proposes an embodiment of a big data processing system. figure 1 What is shown is a schematic diagram of an embodiment of the hierarchical framework of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a big data processing system, comprising a plurality of data nodes. Each data node comprises: a bottom hardware layer, wherein the bottom hardware layer at least comprises a CPU and an FPGA heterogeneous acceleration card. The FPGA heterogeneous acceleration card communicates with the CPU through a bus. A system drive layer load at least an FPGA heterogeneous acceleration card driver; A JVM layer provided with a Java native interface; Big data frame layer, which invokes FPGA heterogeneous acceleration card through Java local interface through JVM layer; And a running support library layer which is used for FPGA heterogeneous computing. The large data processing system of the invention can meet the real-time requirement of the task with high computational complexity,realize the pipeline parallel processing of the computational task, reduce the data transmission delay of the JVM and the FPGA, and realize the online updating function of the label.

Description

technical field [0001] The present invention relates to the technical field of big data processing, and more specifically, refers to a big data processing system. Background technique [0002] The advent of the era of big data has put forward higher requirements for the performance of computing systems. Distributed computing methods such as Hadoop and Spark can divide huge problems into many small parts, and then distribute these small tasks to many computers for processing. Process the same task through multiple computing nodes to meet the requirements of big data processing. However, simply using the CPU for processing cannot meet the real-time requirements of tasks with high computational complexity. [0003] At present, the X86 processors and Windows operating systems used in mainstream computers in my country have potential safety hazards caused by the control of core technologies by others. The "Prism Gate" incident and the recent US sanctions against ZTE have taught ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/38
CPCG06F9/3877
Inventor 彭福来于治楼刘毅枫姚春强
Owner SHANDONG CHAOYUE DATA CONTROL ELECTRONICS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com