Method and system for processing huge traffic data

A technology of traffic data and processing method, which is applied in the field of processing method and system of massive traffic data, can solve the problem of high maintenance cost of traffic data processing system, achieve the effect of reducing hardware performance requirements and maintenance cost

Active Publication Date: 2011-06-01
CENNAVI TECH
View PDF3 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For this reason, people will not have to upgrade the hardware frequently, making the maintenance cost of the traffic data processing system very high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for processing huge traffic data
  • Method and system for processing huge traffic data
  • Method and system for processing huge traffic data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] The mass traffic data processing system provided by Embodiment 1 of the present invention, such as figure 1 shown, including:

[0026] A cluster of management nodes 10 and worker nodes 11 connected through a network. in:

[0027] The management node 10 (computer responsible for managing tasks) is used to monitor the working status of each working node 11, monitor the resource usage and task execution of each working node 11, and send information to each working node 11 according to the resource usage of each working node 11. The worker nodes 11 allocate the storage of traffic data and the calculation tasks of the traffic analysis model.

[0028] The management node assigns tasks according to the resource usage of the working nodes, which can ensure that the resource occupancy rate of each working node is equal, so that the data to be stored and computing tasks are too concentrated on a certain working node, causing the working node and even the entire system performa...

Embodiment 2

[0033] Further in the processing system of massive traffic data provided by Embodiment 2 of the present invention, such as figure 2 shown.

[0034] Management nodes include 10:

[0035] The status monitoring unit 101 is configured to regularly collect the resource usage of each working node 11 , and send the resource usage information of each working node 11 to the storage allocation management unit 102 and the computing task allocation scheduling unit 103 .

[0036] The storage allocation management unit 102 is used for segmenting the traffic data to be stored, and assigning traffic data storage tasks to each working node 11 according to the resource usage information of each working node 11 sent by the state monitoring unit 101 .

[0037] The calculation task allocation scheduling unit 103 is configured to allocate the calculation task of the traffic analysis model to each work node 11 according to the resource usage information of each work node 11 sent by the state monit...

Embodiment 3

[0044] The massive traffic data processing method provided by Embodiment 3 of the present invention utilizes the system provided by Embodiment 1, such as image 3 shown, including steps:

[0045] S301. The management node acquires the resource usage of each working node connected to it through the network, and assigns the storage of traffic data and the calculation task of the traffic analysis model to each working node according to the resource usage of each working node.

[0046] S302. The working node receives the traffic data storage and traffic analysis model calculation tasks assigned by the management node, and performs the traffic data storage and traffic analysis model calculation processing.

[0047] In the method for processing massive traffic data provided by Embodiment 3 of the present invention, the management node obtains the resource usage of each working node connected to it through the network, and allocates the storage and storage of traffic data to each wor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a method and system for processing huge traffic data, relating to the field of traffic information processing and being capable of lowering the hardware requirement for processing the huge traffic data and further reducing the maintenance cost of the processing system. The system for processing the huge traffic data comprises a management node, a working node cluster and a network router, wherein the management node is connected with the working node cluster through a network; the management node is used for monitoring the working state of each workingnode, monitoring the resource use condition and the task executing condition of each working node, and distributing storage of traffic data and calculating tasks of a traffic analysis model to each working node; the working nodes are used for sending the use condition of the resources per se to the management node, receiving the tasks distributed by the management node, and storing the traffic data and calculating the traffic analysis model; and the network router is used for connecting the management node with the working nodes. The embodiment of the invention is used for processing the hugetraffic data.

Description

technical field [0001] The invention relates to the field of traffic information processing, in particular to a method and system for processing massive traffic data. Background technique [0002] In order to grasp the current traffic conditions and the changing trend of traffic conditions, the traffic data processing system needs to collect, process and analyze the constantly changing vehicle speed, flow rate, event and other data in real time, and at the same time continuously compare and analyze with the historical data, and then Perform data fusion processing. Due to the large amount of traffic data collection, fast data update speed, high computational complexity of the traffic analysis model, and large amount of calculation data, the traffic data processing system must have the ability to operate and process massive data. [0003] The current traffic data processing technology is still based on a stand-alone system. Some of them concentrate calculation and storage on ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G08G1/00H04L29/08G06F17/30
Inventor 邓春柏蒋晟李建军
Owner CENNAVI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap