Data cleaning and recovering algorithm of floating car related to multi-threshold space

A floating car data and space-related technology, applied in the field of floating car data cleaning and repair algorithms, can solve problems such as high cost, low repair accuracy, and increased investment in large infrastructure, and achieve the effect of improving data repair accuracy

Active Publication Date: 2012-12-12
TSINGHUA UNIV
View PDF2 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the floating car data only contains vehicle speed information, so the above traffic flow mechanism cannot be used to detect wrong data
At present, the processing of floating car data mostly adopts linear interpolation method or historical average method to repair, and the repair accuracy is

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data cleaning and recovering algorithm of floating car related to multi-threshold space
  • Data cleaning and recovering algorithm of floating car related to multi-threshold space
  • Data cleaning and recovering algorithm of floating car related to multi-threshold space

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.

[0049] The floating car collects data in units of road sections, and collects a data point every time interval. The floating car data of several days along a road section can be synthesized into an original data matrix X:

[0050]

[0051] In the above formula, M is the number of days of data collection, N is the amount of data collection per day; the row vector X of the data matrix X i i,1 ,x i,2 ,...,x ij ,...,x i,N > Indicates the speed data of the same date and different time, referred to as date vector, column vector X j 1,j ,x 2,j ,...,x ij ,...,x M,j >Indicates the speed data of the same time and different dates, referred to as time vector, where i is the date number, j is the time number, x i,j is the vehicle speed data at time j on the i-th day.

[0052]The present invention needs to analyze each element in the data matrix: when th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data cleaning and recovering algorithm of a floating car related to a multi-threshold space. The algorithm comprises the processes of: merging data of a road section into a data matrix, wherein the data is collected by the floating car within a plurality of days; further removing abnormal data in the data matrix according to a three-sigma filter rule after taking a day as a unit to primarily screen missing data and abnormal data in the data matrix; then recovering the missing data by respectively combining space similar characteristics of the road section by a weighted average method and an exponential smoothing method according to the type of the missing data; and finally, recovering high-frequency noise disturbance in data of the floating car by a principal component rebuilding method, thereby fully excavating regularity speed information of the floating car under the condition of not increasing the quantity of the floating car and additional handling equipment, and further, effectively improving the data quality of the floating car. The data cleaning and recovering algorithm can be used for cleaning and recovering work of regularity data of the floating car, and can provide reliable data for subsequent transportation planning and traffic identification.

Description

technical field [0001] The invention relates to a floating car data processing method, in particular to a multi-threshold space-correlated floating car data cleaning and repair algorithm. Background technique [0002] Floating vehicles are widely used in the collection of dynamic traffic data because of their advantages such as wide coverage, high accuracy of data collection, and strong real-time performance. However, due to the high mobility of the floating car, it cannot cover all road sections during non-peak traffic hours, and due to the phenomenon of data packet loss in wireless communication data transmission, it is easy to cause errors or missing data collected by the floating car, thus affecting the accuracy of traffic state measurement. sex. Some literature points out that about 50% of the current traffic data collected by floating vehicles has the problem of data error or loss, and the direct application of these data with problematic quality will bring unstable s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F19/00
Inventor 杨殿阁连小珉张照生王钊李江涛张德鑫彭应亮
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products