Method and device for creating real-time mass data sorting systems

A sorting system and mass data technology, applied in multi-channel program devices, electrical digital data processing, program startup/switching, etc., can solve problems such as data loss

Inactive Publication Date: 2018-04-03
深圳市华成峰科技有限公司
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

You only need to simply reference the ZeroMQ library, which can be installed using NuGet, and then you can happily send messages between applications, but ZeroMQ only provides non-persistent queues, which means that if the machine crashes, the data will be lost Lost; ActiveMQ is a sub-project under Apache, similar to ZeroMQ, it can implement queues with agent and point-to-point technology, and there are also queues that only provide non-persistent. If it crashes, the data will be lost

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for creating real-time mass data sorting systems
  • Method and device for creating real-time mass data sorting systems
  • Method and device for creating real-time mass data sorting systems

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] In order to fully understand the technical content of the present invention, the technical solutions of the present invention will be further introduced and illustrated below in conjunction with specific examples, but not limited thereto.

[0065] Such as Figure 1-9 In the specific embodiment shown, the method for creating a real-time sorting system for massive data provided by this embodiment can be used in the process of processing massive data to achieve fast, scalable, durable, and real-time processing A large amount of data to meet various demand scenarios.

[0066] Such as figure 1 As shown, the method for creating a massive data real-time sorting system provided in this embodiment includes:

[0067] S1. Standardize the design of real-time access data, and allocate and store the access data;

[0068] S2. Design programming model;

[0069] S3. Design real-time computing internal organization;

[0070] S4. Design a real-time calculation EPL model.

[0071] Fo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and device for creating real-time mass data sorting systems. The method comprises the following steps of: carrying out standard design on real-time access data and carrying out distribution and storage on the access data; designing a programming model; designing a real-time calculation internal organization; and designing a real-time calculation EPL model. According to the method and device, through design and distribution of the access data, design of the programming model, design of the real-time calculation internal organization and design of the real-timecalculation EPL model, a distributed push-subscribe-based message system which is used for sorting mass data in real time is established; and the system has the effects of being rapid, extensible andpersistent, and is capable of processing mass data in real time so as to satisfy various demand scenes.

Description

technical field [0001] The present invention relates to a massive data sorting method, more specifically to a method and device for creating a massive data real-time sorting system. Background technique [0002] Various application systems in today's society, such as business, social, search, browsing, etc., are constantly producing various information like information factories. In the era of big data, we are faced with the following three major challenges, how to collect these huge information, how to analyze it and How to achieve the above two points in a timely manner; the above three challenges form a business demand model, that is, producers produce various information, consumers consume information, and between producers and consumers, a bridge to communicate the two is needed. messaging system. From a micro level, this requirement can also be understood as how to transfer messages between different systems, that is, how to sort data in real time. [0003] At presen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/20G06F9/48
CPCG06F8/20G06F9/4806
Inventor 官辉顾正
Owner 深圳市华成峰科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap