Short-term traffic flow prediction method based on Spark platform

A technology of traffic flow and prediction method, applied in the direction of traffic flow detection, road vehicle traffic control system, traffic control system, etc., can solve problems such as difficult to meet practical application requirements, reduce data volume, and solve low computational efficiency Effect

Active Publication Date: 2016-11-16
SOUTH CHINA UNIV OF TECH
View PDF4 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For short-term traffic flow prediction, with the double increase of traffic data volume, the tradit

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Short-term traffic flow prediction method based on Spark platform
  • Short-term traffic flow prediction method based on Spark platform
  • Short-term traffic flow prediction method based on Spark platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The specific implementation of the present invention will be further described below in conjunction with the accompanying drawings, but the implementation and protection of the present invention are not limited thereto. or programmatically.

[0047] The present invention is a kind of short-term traffic flow prediction method based on Spark platform, such as figure 1 shown, including the following steps:

[0048] This embodiment selects the traffic flow data of an expressway from July 2012 to July 2015 as the experimental data, wherein the traffic flow data from July 2012 to June 2015 is selected as the historical database, and the data in July 2015 is used as the historical database. Test database.

[0049] Perform data preprocessing on historical data and test data respectively, such as figure 2 shown, including the following steps

[0050] Use textFile() to read the original data stored in the HDFS file system, use the map() function to read each row of data in the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a short-term traffic flow prediction method based on a Spark platform. A parallel KNN algorithm is applied to the field of short-term traffic flow prediction. Compared with the conventional KNN algorithm based on single-computer computing, the problems of small system storage capacity and slow computing speed in performing data computing on the single physical computer can be solved by the method, and the problem of low neighbor matching efficiency in the neighbor search process of the KNN algorithm can also be solved by the method. According to the method, the computing efficiency of the algorithm can be enhanced under the premise of guaranteeing prediction precision, the practicality of the KNN prediction algorithm can be effectively improved and the system has great extensibility and speed-up ratio. The method also has reference meaning for other applications requiring large-scale data processing.

Description

technical field [0001] The invention belongs to the field of cloud computing and data mining, and in particular relates to a short-term traffic flow prediction method based on a Spark platform. Background technique [0002] Short-term traffic flow prediction refers to the prediction of the traffic flow of a specific road segment in the next few minutes. Short-term traffic flow prediction is an important way to solve urban traffic congestion, and with the increase of the number of cars in the city, the amount of traffic flow data increases sharply. Single-machine short-term traffic flow prediction based on location data faces problems such as large data volume, difficulty in storage, and long calculation time. The cloud computing platform has strong technical advantages in massive data storage and large-scale parallel real-time processing, which can effectively improve the computational efficiency of short-term traffic flow forecasting under the premise of ensuring the forec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G08G1/01
CPCG08G1/0129
Inventor 胡斌杰王腾辉
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products