GPS track cleaning method based on road network data

Abstract

The invention provides a method for cleaning veihcle GPS data based on road network data, and relates to the field of traffic big data processing. According to the method, HDFS is adopted to store data, and a MapReduce calculation framework is adopted to process the data, so that abnormal records in the GPS data are eliminated. The abnormal records comprise drift points with overlarge distance deviation under continuous timestamps, track points of multiple records under the same timestamp, namely repeated data, and jump points with overlarge time difference and distance between two adjacent records. For the duplicate data, the duplicate data is removed through a time stamp-based duplicate removal algorithm. The speed of two adjacent points in the GPS track is calculated according to the time and the distance, and if the speed is greater than a set threshold value, the speed is regarded as a drift point, and the data is rejected. For the jump points, a shortest weighted path is calculated between the jump points by using a Dijkstra algorithm in combination with road network data, the shortest weighted path is taken as a supplementary trajectory between the jump points, and road nodes passing through the path are sequentially inserted between the jump points.

Description

technical field [0001] The invention relates to the field of traffic big data processing, in particular to a GPS track cleaning method based on road network data. Background technique [0002] As the most important data for monitoring vehicle location information, the GPS positioning data of vehicles can intuitively reflect the overall and local traffic conditions of the road, and dynamically display the road capacity and congestion level. For floating vehicles such as taxis and online car-hailing vehicles, GPS data can also obtain passenger status and charging conditions, and use GPS data of floating vehicles to analyze passenger flow demand and adjust and optimize vehicle operating routes. Relevant research and analysis have a wide range of applications in the field of urban transportation planning, which can provide decision-making basis for the transportation department and promote the improvement of urban transportation travel experience. [0003] However, due to the r...

AI Technical Summary

Problems solved by technology

[0003] However, due to the reasons of the GPS device itself and the network communication, various abnormal situations will appear in the collected location information, including the abnormal situation that there is a large time difference and distance between two adjacent points caused by the disconnection of the device; As a result, the GPS position distance is too large in continuous time, that is, the abnormal situation of drift points occurs; and the abnormal situation of the device returning multiple location records at the same time due to abnormal communication

Images