A data processing method, device, terminal equipment and medium

By calculating the neighborhood trajectory vector and trajectory point sequence number of public transportation routes, a set of stations with the same name is constructed for clustering and deduplication, which solves the problem of low efficiency and accuracy of station data processing in traditional methods and achieves efficient and accurate station data processing.

CN118675356BActive Publication Date: 2024-11-29LAY-OUT PLANNING CONSULTANTS CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202411034547.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-29
Estimated Expiration
2044-07-31

AI Technical Summary

Technical Problem

Traditional data processing methods suffer from low accuracy, low efficiency, and inability to adapt to the flexibility of large-scale urban environments when processing public transportation station data. In particular, in large cities, the workload of manual correction is too large to meet actual needs.

Method used

By acquiring trajectory point data and station data of public transportation routes, neighborhood trajectory vectors are calculated. Based on the neighborhood trajectory vectors, station data is deduplicated, a set of stations with the same name is constructed and clustered for deduplication, and the similarity of stations is calculated using trajectory point indices and vector cosines.

Benefits of technology

It improves the efficiency and accuracy of deduplication of site data, adapts to the data processing needs in complex urban environments, simplifies computing resource requirements, and enhances computing speed and flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118675356B_ABST
    Figure CN118675356B_ABST
Patent Text Reader

Abstract

The present application is applicable to the field of data processing, and provides a data processing method, apparatus, terminal equipment and medium, the method comprising: obtaining line data of each public transportation line in a plurality of public transportation lines, the line data comprising trajectory point data of each trajectory point in the public transportation line and site data of the included sites; determining a first site to be processed based on the site data of each public transportation line; calculating a neighborhood trajectory vector corresponding to the first site to be processed based on the trajectory point data of each trajectory point in the public transportation line to which the first site to be processed belongs; performing deduplication processing on the site data of the first site to be processed based on the neighborhood trajectory vector corresponding to the first site to be processed, and obtaining the processed site data of each public transportation line. The method realizes deduplication processing of the site data of the first site to be processed based on the calculated neighborhood trajectory vector, improves the efficiency of deduplication processing, and ensures the accuracy of deduplication processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of data processing technology, and in particular, relates to a data processing method, apparatus, terminal equipment and medium. Background Art

[0002] With the rapid development of public transportation, the public transportation system has become an important part of urban transportation, and it is particularly important to improve the data management and service quality of the transportation system. Among them, the station data in the public transportation line is the core of the public transportation system. Its accuracy directly affects the planning, operation efficiency and passenger travel experience of public transportation, and also affects the accessibility, commuting conditions, store location, real estate quality and other commercial analysis areas based on station data.

[0003] For example, in actual operation, due to the deviation in GPS data collection of different bus routes, the same bus stop is often recorded at different longitudes and latitudes nearby. In addition, there are often up and down bus stops with the same name on both sides of urban roads. In addition, there may be multiple stations with the same name serving different routes near transportation hubs, stadiums, and convention centers. These factors make it difficult to obtain reliable bus stop location information through simple data merging or relative position-based methods. In particular, for large cities, there are many bus stops and the workload of manual correction is huge, making data cleaning and deduplication a complex and challenging task. Therefore, how to accurately and effectively process station data is an urgent problem that needs to be solved.

[0004] However, when analyzing site data, traditional data processing methods have disadvantages such as relying on too much data and large amount of calculation, which makes the processing efficiency and accuracy low and difficult to meet actual needs. Summary of the invention

[0005] The embodiments of the present application provide a data processing method, apparatus, terminal device and medium, which can improve the efficiency and accuracy of processing and meet actual processing needs.

[0006] In a first aspect, an embodiment of the present application provides a data processing method, including:

[0007] Acquire route data of each public transportation route among the plurality of public transportation routes, wherein the route data includes track point data of each track point in the public transportation route and station data of stations included in the public transportation route;

[0008] Determine a first site to be processed based on the site data of each public transportation line in the plurality of public transportation lines, wherein the first site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line;

[0009] According to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, a neighborhood trajectory vector corresponding to the first station to be processed is calculated, where the neighborhood trajectory vector is a vector formed by two adjacent trajectory points of the first station to be processed in the public transportation line to which it belongs;

[0010] Based on the neighborhood trajectory vector corresponding to the first station to be processed, the station data of the first station to be processed is deduplicated to obtain the processed station data of each public transportation line.

[0011] In a second aspect, an embodiment of the present application provides a data processing device, including:

[0012] An acquisition module, used for acquiring route data of each public transportation route among a plurality of public transportation routes, wherein the route data includes track point data of each track point in the public transportation route and station data of stations included in the public transportation route;

[0013] A first determination module is used to determine a first site to be processed based on the site data of each public transportation line in the plurality of public transportation lines, wherein the first site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line;

[0014] A calculation module, used to calculate a neighborhood trajectory vector corresponding to the first station to be processed according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, wherein the neighborhood trajectory vector is a vector formed by two adjacent trajectory points of the first station to be processed in the public transportation line to which it belongs;

[0015] The first deduplication processing module is used to perform deduplication processing on the station data of the first station to be processed based on the neighborhood trajectory vector corresponding to the first station to be processed, so as to obtain the processed station data of each public transportation line.

[0016] In a third aspect, an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any method of the first aspect when executing the computer program.

[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method of any one of the first aspects is implemented.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute any one of the methods in the first aspect.

[0019] The embodiments of the present application provide a data processing method, apparatus, terminal device and medium, the method comprising: obtaining line data of each public transportation line among a plurality of public transportation lines, wherein the line data comprises trajectory point data of each trajectory point in the public transportation line and site data of sites included in the public transportation line; determining a first site to be processed based on the site data of each public transportation line among the plurality of public transportation lines, wherein the first site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line; calculating a neighborhood trajectory vector corresponding to the first site to be processed according to the trajectory point data of each trajectory point in the public transportation line to which the first site to be processed belongs, the neighborhood trajectory vector being a vector formed by two adjacent trajectory points of the first site to be processed in the public transportation line to which it belongs; and deduplicating the site data of the first site to be processed based on the neighborhood trajectory vector corresponding to the first site to be processed to obtain the processed site data of each public transportation line. By utilizing the above technical solution, by calculating the neighborhood trajectory vector corresponding to the first station to be processed based on the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, the station data of the first station to be processed can be deduplicated based on the calculated neighborhood trajectory vector, thereby improving the efficiency of the deduplication processing while ensuring the accuracy of the deduplication processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0021] Figure 1 It is a flowchart of a data processing method provided by an embodiment of the present application;

[0022] Figure 2 is a flowchart of a data processing method provided by another embodiment of the present application;

[0023] Figure 3 This is a schematic diagram of an interface for performing deduplication processing on a first set of sites with the same name, provided by an embodiment of the present application;

[0024] Figure 4 is a structural block diagram of a data processing device provided by an embodiment of the present application;

[0025] Figure 5 It is a structural diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0026] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0027] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0028] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0029] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0030] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0031] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0032] The data processing method provided in the embodiments of the present application can be applied to terminal devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc. The embodiments of the present application do not impose any restrictions on the specific types of terminal devices.

[0033] It can be considered that when analyzing station data, traditional data processing methods have difficulty distinguishing bus stops with the same name and similar actual physical locations but different functions, or fail to effectively distinguish multiple stations in opposite directions or at close distances, resulting in omissions when merging data and insufficient accuracy of data processing results.

[0034] At the same time, faced with the massive data processing needs of bus stops in large-scale cities, traditional data processing methods have low computational efficiency and are difficult to meet actual needs; in complex scenarios, such as around large facilities, traditional data processing methods are also unable to adapt to the needs of stations in different directions or on different routes and lack flexibility.

[0035] On the other hand, traditional data processing methods rely on road network and road section data, and combine advanced algorithms to achieve data cleaning, such as using hidden Markov models to match bus route data to the road network, and then achieve station data cleaning and deduplication. However, although traditional data processing methods can solve the problem to a certain extent, they have disadvantages such as relying on too much data, complex algorithms, and large amounts of calculations. Especially when facing large-scale bus system data, the efficiency and accuracy of such data processing methods are often difficult to meet actual needs.

[0036] Based on this, an embodiment of the present application provides a data processing method that can effectively identify and integrate redundant station data, improve the accuracy and efficiency of data processing, and at the same time have good flexibility and adaptability to support the needs of accurate monitoring and analysis of bus stop data in complex urban environments.

[0037] Figure 1 FIG. 1 is a flow chart of a data processing method provided in an embodiment of the present application. As an example but not a limitation, the method can be applied to a terminal device. Figure 1 As shown, the method includes:

[0038] S101. Obtaining route data of each public transportation route among a plurality of public transportation routes, wherein the route data includes track point data of each track point in the public transportation route and station data of stations included in the public transportation route.

[0039] Route data can be understood as data related to public transportation routes, and the specific content can include track point data of each track point in the public transportation route and site data of the included stations. Among them, track points can refer to the track passed by the public transportation route, and each track point can be connected to the GPS track of this public transportation route; site data is the relevant data of the stations included in the public transportation route, and the specific content of the site data is not limited, such as the site data can include the site name, site coordinates, etc.

[0040] In this embodiment, the line data of each public transportation line among multiple public transportation lines can be first acquired to perform subsequent data processing on the station data therein. This embodiment does not limit the means for acquiring the line data. For example, it can be directly acquired from the transportation system, or the original data of multiple public transportation lines can be first collected, and then the specific line data can be obtained by performing certain preprocessing on the collected original data. The original data of multiple public transportation lines can be the original unassociated data of the public transportation lines. The track point data and the station data can be associated together through the line ID, and the up and down directions of the public transportation lines and each station can be marked to obtain the line data of each public transportation line among the multiple public transportation lines.

[0041] S102. Determine a first site to be processed based on the site data of each public transportation line among the plurality of public transportation lines, wherein the first site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line.

[0042] The first site to be processed can be considered as a site that requires site data processing. For example, the first site to be processed can be a site shared by at least two public transportation lines, that is, a multi-line public transportation line, or it can be a site configured in a single and multi-directional public transportation line, that is, a site configured in an up and down line.

[0043] After obtaining the line data of each of the multiple public transportation lines, the station to be processed can be determined based on the obtained data. For example, the first station to be processed and other stations except the first station to be processed can be distinguished by calculating the station data of each public transportation line, so as to obtain the first station to be processed. For example, the number of lines passed by each station name can be aggregated and counted to distinguish each station in the multiple public transportation lines into a one-way line and a multi-line, and then the multi-line can be determined as the first station to be processed. The first station to be processed can also be screened out according to a series of screening rules.

[0044] S103, calculating a neighborhood trajectory vector corresponding to the first station to be processed according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, where the neighborhood trajectory vector is a vector formed by two adjacent trajectory points of the first station to be processed in the public transportation line to which it belongs.

[0045] The neighborhood trajectory vector can be a vector formed by two adjacent trajectory points of the first station to be processed in the public transportation line to which it belongs. The adjacent trajectory point is a trajectory point adjacent to the first station to be processed in the line position, such as a trajectory point immediately adjacent to the first station to be processed, or a trajectory point separated from the first station to be processed by a preset distance. The specific size of the preset distance is not limited and can be determined according to actual conditions.

[0046] Specifically, the neighborhood trajectory vector corresponding to the first station to be processed can be calculated according to the determined first station to be processed and the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs. The specific calculation process is not limited. For example, the neighborhood trajectory vector corresponding to the first station to be processed can be directly obtained by inputting the trajectory point data of each trajectory point into a vector calculation model. Alternatively, the adjacent trajectory points corresponding to the first station to be processed can be first determined, and then the neighborhood trajectory vector corresponding to the first station to be processed can be calculated. This embodiment does not limit this.

[0047] In some embodiments, calculating the neighborhood trajectory vector corresponding to the first to-be-processed station according to the trajectory point data of each trajectory point in the public transportation line to which the first to-be-processed station belongs includes:

[0048] Determine a first adjacent trajectory point and a second adjacent trajectory point of the first station to be processed in the public transportation line to which the first station to be processed belongs according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs;

[0049] A neighborhood trajectory vector corresponding to the first site to be processed is calculated based on the trajectory point data of the first adjacent trajectory point and the second adjacent trajectory point.

[0050] The first adjacent trajectory point and the second adjacent trajectory point may be respectively considered as adjacent trajectory points of the first to-be-processed station in the public transportation line to which it belongs.

[0051] In a specific implementation, the first adjacent trajectory point and the second adjacent trajectory point of the first station to be processed in the public transportation line to which the first station to be processed belongs can be determined according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, and then the neighborhood trajectory vector corresponding to the first station to be processed is calculated, wherein the specific means for determining the first adjacent trajectory point and the second adjacent trajectory point are not limited, for example, the two closest trajectory points can be directly determined as the first adjacent trajectory point and the second adjacent trajectory point by calculating the distance between the first station to be processed and each trajectory point according to the position of the first station to be processed in the public transportation line to which it belongs, or other strategies can be used to determine the first adjacent trajectory point and the second adjacent trajectory point of the first station to be processed in the public transportation line to which it belongs, and so on.

[0052] In some embodiments, the trajectory point data includes trajectory point coordinates and trajectory point serial numbers, and determining the first adjacent trajectory point and the second adjacent trajectory point of the first station to be processed in the public transportation line to which it belongs according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs includes:

[0053] Calculate the trajectory distances between the first to-be-processed station and each trajectory point according to the trajectory point coordinates of each trajectory point in the public transportation line to which the first to-be-processed station belongs;

[0054] The trajectory point corresponding to the shortest trajectory distance among the trajectory distances is determined as the third adjacent trajectory point;

[0055] According to the trajectory point sequence number of the third adjacent trajectory point, a trajectory point spaced a preset distance from the trajectory point sequence number of the third adjacent trajectory point is determined as a first adjacent trajectory point and a second adjacent trajectory point.

[0056] The third adjacent trajectory point may refer to the trajectory point that is closest to the first to-be-processed station in the public transportation line to which the first to-be-processed station belongs; the trajectory point data may include trajectory point coordinates and trajectory point serial numbers, wherein the trajectory point coordinates are used to characterize the coordinates of the trajectory point, and the trajectory point serial number is used to characterize the serial number of the trajectory point in the public transportation line to which it belongs, and the direction in which the trajectory point serial number increases is the traveling direction of the public transportation line to which it belongs.

[0057] In this embodiment, the third adjacent trajectory point in the public transportation line to which the first to-be-processed station belongs can be first determined, and then according to the trajectory point sequence number of the determined third adjacent trajectory point, the trajectory point separated by a preset distance from the trajectory point sequence number of the third adjacent trajectory point can be determined as the first adjacent trajectory point and the second adjacent trajectory point. For example, when the trajectory point sequence number is 100 and the preset distance is 2, the trajectory points with trajectory point sequences of 98 and 102 can be determined as the first adjacent trajectory point and the second adjacent trajectory point, respectively. On this basis, the calculation of the neighborhood trajectory vector can be facilitated, providing a data basis for subsequent deduplication processing.

[0058] S104: Based on the neighborhood trajectory vector corresponding to the first station to be processed, deduplication processing is performed on the station data of the first station to be processed to obtain processed station data of each public transportation line.

[0059] It can be considered that since the first site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line, there will be site data of at least two first sites to be processed in the line data. Then, after obtaining the neighborhood trajectory vector corresponding to each first site to be processed through the above steps, the determined neighborhood trajectory vector can be used for deduplication processing of the site data of the first site to be processed. The specific deduplication process can be determined, for example, based on the relationship between the neighborhood trajectory vectors of different first sites to be processed, or can be specifically determined in combination with the position coordinates between different first sites to be processed. The specific deduplication process will not be described in detail here, as long as the deduplication processing of the site data can be achieved.

[0060] The present embodiment provides a data processing method, which obtains the line data of each public transportation line in a plurality of public transportation lines, wherein the line data includes the trajectory point data of each trajectory point in the public transportation line and the station data of the stations included in the public transportation line; based on the station data of each public transportation line in the plurality of public transportation lines, a first station to be processed is determined, wherein the first station to be processed is a station shared by at least two public transportation lines and / or a station configured in a single and multi-directional public transportation line; according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, a neighborhood trajectory vector corresponding to the first station to be processed is calculated, and the neighborhood trajectory vector is a vector formed by two adjacent trajectory points of the first station to be processed in the public transportation line to which it belongs; based on the neighborhood trajectory vector corresponding to the first station to be processed, the station data of the first station to be processed is deduplicated to obtain the processed station data of each public transportation line. By using this method, by calculating the neighborhood trajectory vector corresponding to the first station to be processed according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, deduplication processing of the station data of the first station to be processed can be achieved based on the calculated neighborhood trajectory vector, thereby improving the efficiency of deduplication processing and ensuring the accuracy of deduplication processing.

[0061] Figure 2 It is a flow chart of a data processing method provided by another embodiment of the present application. The station data in this embodiment includes station coordinates and station names, and the station data of the first station to be processed is deduplicated based on the neighborhood trajectory vector corresponding to the first station to be processed, and the station data after processing for each public transportation line is further optimized as follows: Construct a first set of stations with the same name, in which all first stations to be processed in the first set of stations with the same name have the same station name; calculate the vector cosine of the neighborhood trajectory vector between any two first stations to be processed in the first set of stations with the same name based on the neighborhood trajectory vector corresponding to the first station to be processed in the first set of stations with the same name; calculate the coordinate difference between any two first stations to be processed in the first set of stations with the same name based on the station coordinates of the first station to be processed in the first set of stations with the same name; deduplicate the station data of at least two first stations to be processed in the first set of stations with the same name whose vector cosine and coordinate difference meet the first clustering condition, and obtain the station data after processing for each public transportation line. As shown Figure 2 As shown, the method includes:

[0062] S201. Obtaining route data of each public transportation route among a plurality of public transportation routes, wherein the route data includes track point data of each track point in the public transportation route and station data of stations included in the public transportation route.

[0063] S202. Determine a first site to be processed based on the site data of each of the multiple public transportation lines, wherein the first site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line.

[0064] S203, calculating a neighborhood trajectory vector corresponding to the first station to be processed according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, where the neighborhood trajectory vector is a vector formed by two adjacent trajectory points of the first station to be processed in the public transportation line to which it belongs.

[0065] S204: construct a first set of sites with the same name, wherein all first sites to be processed in the first set of sites with the same name have the same site name.

[0066] In this embodiment, the station data may include station coordinates and station names, so that they can be grouped according to the station names of the above-mentioned first stations to be processed, such as constructing a first set of stations with the same name, wherein the station names of all first stations to be processed in the first set of stations with the same name are the same, and the number of the first set of stations with the same name is one or more, which can be determined based on the actual situation of multiple public transportation lines.

[0067] S205 . Calculate the vector cosine of the neighborhood trajectory vector between any two first to-be-processed sites in the first set of sites with the same name according to the neighborhood trajectory vector corresponding to the first to-be-processed sites in the first set of sites with the same name.

[0068] S206: Calculate the coordinate difference between any two first to-be-processed sites in the first set of sites with the same name according to the site coordinates of the first to-be-processed sites in the first set of sites with the same name.

[0069] The vector cosine can be used to characterize the cosine of the angle between the neighborhood trajectory vectors corresponding to the two first sites to be processed.

[0070] After constructing at least one first set of sites with the same name, the site data can be deduplicated using the first set of sites with the same name as a dimension. For example, the vector cosines of the neighborhood trajectory vectors corresponding to any two sites and the coordinate differences between any two sites can be calculated within the first set of sites with the same name. This allows subsequent deduplication processing to be performed based on the coordinate differences and vector cosines calculated above.

[0071] S207, deduplicating the site data of at least two first sites to be processed in the first set of sites with the same name whose vector cosine and coordinate difference satisfy the first clustering condition, to obtain processed site data of each public transportation line.

[0072] The first clustering condition may be used to cluster sites within the first set of sites with the same name, and the specific content may be configured by relevant personnel.

[0073] Specifically, this step can cluster at least two first sites to be processed that meet the first clustering condition according to the coordinate differences and vector cosines obtained by the above calculations, and deduplicate the site data of the first sites to be processed clustered into a group to obtain the processed site data of each public transportation line.

[0074] In some embodiments, deduplication processing is performed on the site data of at least two first to-be-processed sites in the first set of sites with the same name whose vector cosine and coordinate difference satisfy the first clustering condition to obtain the processed site data of each public transportation line, including:

[0075] Clustering at least two first to-be-processed sites in the first set of sites with the same name whose vector cosine and coordinate difference satisfy a first clustering condition;

[0076] The site data of at least two first to-be-processed sites configured with the same clustering label are deduplicated to obtain processed site data of each public transportation line.

[0077] In a specific implementation, the site data in the first set of sites with the same name can be deduplicated based on the clustering labels obtained by clustering. For example, at least two first sites to be processed that meet the first clustering condition can be configured with the same clustering label, and then the site data of at least two first sites to be processed configured with the same clustering label can be deduplicated. The specific deduplication steps are not limited here. For example, at least two first sites to be processed configured with the same clustering label can be merged into a new first site to be processed, and the site coordinates of at least two first sites to be processed configured with the same clustering label can be averaged, and the calculated average is used as the site data of the new first site to be processed, so as to obtain the processed site data of each public transportation line.

[0078] A data processing method provided in this embodiment can deduplicate the site data of at least two first sites to be processed in the first set of sites with the same name by constructing a first set of sites with the same name and calculating the vector cosine and coordinate difference of the neighborhood trajectory vectors of any two first sites to be processed in the first set of sites with the same name, thereby further ensuring the accuracy of the deduplication processing.

[0079] In some embodiments, the data processing method provided in this embodiment further includes:

[0080] Determine a second site to be processed based on the site data of each of the plurality of public transportation lines, wherein the second site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line, and the site type of the second site to be processed is different from the site type of the first site to be processed;

[0081] Based on the site coordinates of the second site to be processed, the site data of the second site to be processed is deduplicated to obtain the processed site data of each public transportation line.

[0082] Among them, the second site to be processed is a site to be processed whose site type is different from the site type of the first site to be processed. For example, in this embodiment, the site type of the first site to be processed can be a head and tail site, while the site type of the second site to be processed can be a non-head and tail site.

[0083] In a specific implementation, the same or different deduplication processing methods can be adopted to process the stations according to different station types. When different deduplication processing methods are adopted to process the stations, the first station to be processed can be determined based on the station data of each public transportation line in multiple public transportation lines, and the second station to be processed can be determined. The number of second stations to be processed can be at least two, then the station data of at least two second stations to be processed can be deduplicated based on the station coordinates of the second stations to be processed to obtain the processed station data of each public transportation line. Exemplarily, the process of deduplication processing of the station data of the second stations to be processed here can be directly determined based on the relative positions between the second stations to be processed, or the deduplication processing of the station data of the second stations to be processed can be achieved through a series of calculations.

[0084] In some embodiments, based on the site coordinates of the second site to be processed, the site data of the second site to be processed is deduplicated to obtain the processed site data of each public transportation line, including:

[0085] A second site set with the same name is constructed, wherein the site names of all second sites to be processed in the second site set with the same name are the same;

[0086] Calculate the coordinate difference between any two second to-be-processed sites in the second set of sites with the same name according to the site coordinates of the second to-be-processed sites in the second set of sites with the same name;

[0087] The site data of at least two second sites to be processed whose coordinate difference satisfies the second clustering condition in the second set of sites with the same name are deduplicated to obtain processed site data of each public transportation line.

[0088] The second clustering condition may be used to cluster sites in the second set of sites with the same name, and the specific content may be configured by relevant personnel.

[0089] In a specific implementation, the number of the second sites to be processed is at least two, so they can be grouped according to the station names of the above-mentioned second sites to be processed, such as constructing a second set of sites with the same name. The number of the second set of sites with the same name is one or more, which can be determined based on the actual situation of multiple public transportation lines.

[0090] Subsequently, the site data can be deduplicated using the second set of sites with the same name as a dimension. For example, the coordinate difference between any two sites in the second set of sites with the same name can be calculated, so that it can be determined whether the second clustering condition is met based on the coordinate differences obtained by the above calculations, and the site data can be deduplicated based on the judgment result. For example, the site data of at least two second sites to be processed whose coordinate difference meets the second clustering condition in the judgment result can be deduplicated, that is, at least two second sites to be processed that meet the second clustering condition can be merged into a new second site to be processed, the site coordinates of at least two second sites to be processed that meet the second clustering condition are averaged, and the average calculated is used as the site data of the new second site to be processed, so as to obtain the processed site data of each public transportation line. Accordingly, at least two second sites to be processed whose coordinate difference does not meet the second clustering condition in the second set of sites with the same name can be not processed.

[0091] The following is an exemplary description of the data processing method provided in this embodiment:

[0092] Step 1: You can import the three modules of Python language: pandas, geopandas, and numpy. Among them, pandas can be a Python library for data manipulation and analysis, providing efficient data structures (such as DataFrame) and data analysis tools; numpy can be a basic library for scientific computing, providing high-performance functions that support multidimensional arrays and matrix operations; geopandas can extend the pandas library to support geographic data manipulation and analysis, allowing easy processing and visualization of geographic information system (GIS) data.

[0093] Step 2: Use the pandas module to read the trajectory point data and station data of the bus route. The station data can be associated with the corresponding bus route through the line identification ID. At the same time, the geopandas module can be used to convert the longitude and latitude data of the station into a geometry object, using the wgs84 coordinate system. In addition, the LineString class is used to connect the trajectory points in sequence into lines. If there are up and down directions between the stations and bus routes, the stations and bus routes can be marked up and down. Among them, the LineString class is a geometric object in the shapely library, which can be used to represent a line segment formed by a series of ordered points.

[0094] Step 3: Aggregate and count the number of lines passing through the station name, and distinguish between one-station one-way lines and one-station multiple lines (such as uplink and downlink lines or multiple lines shared stations). One-station one-way lines do not need to be deduplicated, and the site data of one-station multiple lines is processed below.

[0095] Step 4: Eliminate "temporary stations" and "call stations" based on the station names.

[0096] Step 5: Filter out the starting station and the terminal station according to the order of the stations in the route (i.e., determine the second stations to be processed based on the station data of each public transportation line in the multiple public transportation lines). Calculate the distance between the starting stations and the terminal stations with the same name, and merge the stations with the absolute value of the difference in longitude and latitude less than 0.002 degrees into the same station (i.e., construct a second set of stations with the same name, in which all the second stations to be processed in the second set of stations with the same name have the same station name; calculate the coordinate difference between any two second stations to be processed in the second set of stations with the same name based on the station coordinates of the second stations to be processed in the second set of stations with the same name; deduplicate the station data of at least two second stations to be processed in the second set of stations with the same name whose coordinate difference meets the second clustering condition, and obtain the processed station data of each public transportation line).

[0097] Step 6: The following is the same processing for the stations that are not the first and last stations (i.e., based on the station data of each public transportation line in multiple public transportation lines, the first station to be processed is determined): the station and the public transportation line to which it belongs are matched according to the line ID, and the distance between the station and all the trajectory points on the public transportation line to which it belongs is calculated (i.e., according to the trajectory point coordinates of each trajectory point in the public transportation line to which the first station to be processed belongs, the trajectory distances between the first station to be processed and each trajectory point are calculated), and the distances are sorted to find the nearest trajectory point (i.e., the trajectory point corresponding to the shortest trajectory distance among all trajectory distances is determined as the third adjacent trajectory point); according to the sequence number i of the nearest trajectory point, the trajectory points with adjacent intervals before and after it are found, and the sequence numbers are i-2 and i+2, and the sequence numbers of the trajectory points are consistent with the driving direction of the bus from small to large (i.e., according to the trajectory point sequence number of the third adjacent trajectory point, the trajectory point separated by a preset distance from the trajectory point sequence number of the third adjacent trajectory point is determined as the first adjacent trajectory point and the second adjacent trajectory point. Thus, the vector from trajectory point i-2 to trajectory point i+2, that is, the tuple of the longitude difference and latitude difference of the two stations, can be calculated, so as to obtain the neighborhood trajectory vectors of all stations (that is, the neighborhood trajectory vector corresponding to the first station to be processed is calculated based on the trajectory point data of the first adjacent trajectory point and the second adjacent trajectory point).

[0098] For example, if the number of the nearest trajectory point of a station is 388, then the numbers of the adjacent trajectory points are 386 and 390, and the neighborhood trajectory vector corresponding to the station is the vector from trajectory point 386 to trajectory point 390. It should be noted that because trajectory points are prone to overlap near stations, taking directly adjacent trajectory points will make the subsequent calculation of the neighborhood trajectory vector too small, affecting the subsequent deduplication process.

[0099] Step 7: Group the non-first and last stations by name to obtain a station group with the same name (i.e., construct a first station set with the same name, in which all first stations to be processed in the first station set with the same name have the same station name). Calculate the longitude and latitude differences between any two stations in the group (i.e., calculate the coordinate difference between any two first stations to be processed in the first station set with the same name based on the station coordinates of the first station to be processed in the first station set with the same name).

[0100] Step 8: Calculate the cosine of the angle between the neighborhood trajectory vectors of any two sites (i.e., calculate the vector cosine of the neighborhood trajectory vector between any two first sites to be processed in the first site set with the same name based on the neighborhood trajectory vector corresponding to the first site to be processed in the first site set with the same name): Let the two vectors be vec1 and vec2, and use the numpy.linalg.norm function to get the modulus lengths vec1_norm and vec2_norm of the two vectors. Get the vector cosine of vec1 and vec2 by calculating numpy.dot(vec1, vec2) / (vec1_norm * vec2_norm).

[0101] Step 9: Cluster the sites in the group according to the longitude and latitude differences and the field trajectory vector cosines calculated above (i.e., cluster at least two first sites to be processed in the first set of sites with the same name whose vector cosines and coordinate differences meet the first clustering condition). The clustering basis may include: the vector cosine value of the two sites is less than 0.15, and the absolute value of the longitude and latitude difference is within 0.0005 degrees. In this way, sites with similar distances and the same direction can be clustered in each group of sites with the same name, and the results are labeled with categories.

[0102] Step 10: De-duplicate stations with the same name according to clustering labels, take the average of the longitude and latitude of stations with the same label, and obtain unique station locations that distinguish between the up and down directions, or stations (platforms) with the same name in the same up and down directions but slightly farther apart, or different stations that are not on the same road section (that is, deduplicate the station data of at least two first stations to be processed that are configured with the same clustering label to obtain the processed station data for each public transportation line).

[0103] Figure 3 is a schematic diagram of an interface for performing deduplication processing on a first set of sites with the same name provided by an embodiment of the present application, such as Figure 3As shown in the figure, multiple sites with similar distance and same direction can be clustered and assigned the same cluster label ( Figure 3 The stations with the same cluster label can then be merged into a new station, and the mean longitude and latitude of the stations with the same cluster label can be used as the station data of the new station.

[0104] From the above description, it can be found that the data processing method provided in this embodiment does not need to use road network and road section data, but directly uses the trajectory point serial number of the trajectory point data itself to obtain the up and down and driving direction of the public transportation line to which the station belongs. At the same time, the distance between stations and the vector cosine are constrained, so that stations with similar distances and passing through the same direction of the bus line can be calculated more accurately, thereby improving the reliability of station deduplication.

[0105] In addition, the data processing method provided in this embodiment has simple calculation logic, small demand for computing resources, fast calculation speed, the ability to utilize parallel computing, and large room for subsequent optimization.

[0106] Corresponding to the data processing method of the above embodiment, Figure 4 This is a structural block diagram of a data processing device provided in one embodiment of the present application. For the sake of convenience of explanation, only the parts related to the embodiment of the present application are shown.

[0107] Reference Figure 4 , the device comprises:

[0108] An acquisition module 301 is used to acquire the route data of each public transportation route among the plurality of public transportation routes, wherein the route data includes the track point data of each track point in the public transportation route and the station data of the stations included in the public transportation route;

[0109] A first determination module 302 is used to determine a first to-be-processed station based on station data of each of the plurality of public transportation lines, wherein the first to-be-processed station is a station shared by at least two public transportation lines and / or a station configured in a single and multi-directional public transportation line;

[0110] The calculation module 303 is used to calculate the neighborhood trajectory vector corresponding to the first station to be processed according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, where the neighborhood trajectory vector is a vector formed by two adjacent trajectory points of the first station to be processed in the public transportation line to which it belongs;

[0111] The first deduplication processing module 304 is used to perform deduplication processing on the station data of the first station to be processed based on the neighborhood trajectory vector corresponding to the first station to be processed, so as to obtain the processed station data of each public transportation line.

[0112] The present embodiment provides a data processing device, which obtains line data of each public transportation line among a plurality of public transportation lines through an acquisition module, wherein the line data includes trajectory point data of each trajectory point in the public transportation line and site data of sites included in the public transportation line; determines a first site to be processed based on the site data of each public transportation line among the plurality of public transportation lines through a first determination module, wherein the first site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line; calculates a neighborhood trajectory vector corresponding to the first site to be processed based on the trajectory point data of each trajectory point in the public transportation line to which the first site to be processed belongs through a calculation module, wherein the neighborhood trajectory vector is a vector formed by two adjacent trajectory points of the first site to be processed in the public transportation line to which it belongs; and performs deduplication processing on the site data of the first site to be processed based on the neighborhood trajectory vector corresponding to the first site to be processed through a first deduplication processing module, so as to obtain the processed site data of each public transportation line. By using this device, by calculating the neighborhood trajectory vector corresponding to the first station to be processed based on the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, the station data of the first station to be processed can be deduplicated based on the calculated neighborhood trajectory vector, thereby improving the efficiency of the deduplication processing and ensuring the accuracy of the deduplication processing.

[0113] Optionally, the computing module includes:

[0114] A determination unit, configured to determine a first adjacent trajectory point and a second adjacent trajectory point of the first station to be processed in the public transportation line to which the first station to be processed belongs according to trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs;

[0115] The vector calculation unit is used to calculate the neighborhood trajectory vector corresponding to the first to-be-processed station based on the trajectory point data of the first adjacent trajectory point and the second adjacent trajectory point.

[0116] Optionally, the trajectory point data includes trajectory point coordinates and trajectory point sequence numbers, and the determination unit is specifically used to:

[0117] Calculate the trajectory distances between the first to-be-processed station and each trajectory point according to the trajectory point coordinates of each trajectory point in the public transportation line to which the first to-be-processed station belongs;

[0118] The trajectory point corresponding to the shortest trajectory distance among the trajectory distances is determined as the third adjacent trajectory point;

[0119] According to the trajectory point sequence number of the third adjacent trajectory point, a trajectory point spaced a preset distance from the trajectory point sequence number of the third adjacent trajectory point is determined as a first adjacent trajectory point and a second adjacent trajectory point.

[0120] Optionally, the first deduplication processing module includes:

[0121] A construction unit, used for constructing a first set of sites with the same name, wherein all first sites to be processed in the first set of sites with the same name have the same site name;

[0122] A cosine calculation unit, configured to calculate the vector cosine of the neighborhood trajectory vector between any two first to-be-processed sites in the first set of sites with the same name, according to the neighborhood trajectory vector corresponding to the first to-be-processed site in the first set of sites with the same name;

[0123] A difference calculation unit, used for calculating the coordinate difference between any two first to-be-processed sites in the first set of sites with the same name according to the site coordinates of the first to-be-processed sites in the first set of sites with the same name;

[0124] The deduplication processing unit is used to deduplicate the site data of at least two first sites to be processed in the first set of sites with the same name whose vector cosine and coordinate difference meet the first clustering condition, so as to obtain the processed site data of each public transportation line.

[0125] Optionally, the deduplication processing unit is specifically used for:

[0126] Clustering at least two first to-be-processed sites in the first set of sites with the same name whose vector cosine and coordinate difference satisfy a first clustering condition;

[0127] The site data of at least two first to-be-processed sites configured with the same clustering label are deduplicated to obtain processed site data of each public transportation line.

[0128] Optionally, a data processing device provided by this embodiment further includes:

[0129] A second determination module is used to determine a second site to be processed based on the site data of each public transportation line in the plurality of public transportation lines, wherein the second site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line, and the site type of the second site to be processed is different from the site type of the first site to be processed;

[0130] The second deduplication processing module is used to perform deduplication processing on the site data of the second site to be processed based on the site coordinates of the second site to be processed, so as to obtain the processed site data of each public transportation line.

[0131] Optionally, the second deduplication processing module is specifically used for:

[0132] A second site set with the same name is constructed, wherein the site names of all second sites to be processed in the second site set with the same name are the same;

[0133] Calculate the coordinate difference between any two second to-be-processed sites in the second set of sites with the same name according to the site coordinates of the second to-be-processed sites in the second set of sites with the same name;

[0134] The site data of at least two second sites to be processed whose coordinate difference satisfies the second clustering condition in the second set of sites with the same name are deduplicated to obtain processed site data of each public transportation line.

[0135] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0136] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0137] The present application also provides a terminal device, Figure 5 is a schematic diagram of the structure of a terminal device provided by an embodiment of the present application, such as Figure 5 As shown, the terminal device includes: at least one processor 401, a memory 402, an input device 403, an output device 404, and a computer program stored in the memory 402 and executable on at least one processor 401. When the processor 401 executes the computer program, the steps in any of the above-mentioned method embodiments are implemented.

[0138] The input device 403 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the terminal device. The output device 404 may include a display device such as a display screen.

[0139] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by the processor 401, the steps in the above-mentioned method embodiments can be implemented.

[0140] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0141] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can be executed by the processor 401. The steps of the above-mentioned method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the device / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0142] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0143] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0144] In the embodiments provided in the present application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0145] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0146] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A data processing method, characterized in that: include: Acquire route data of each public transportation route among a plurality of public transportation routes, wherein the route data includes track point data of each track point in the public transportation route and station data of stations included in the public transportation route; Based on the station data of each of the plurality of public transportation lines, determining a first station to be processed, wherein the first station to be processed is a station shared by at least two public transportation lines and / or a station configured in a single and multi-directional public transportation line, and the first station to be processed refers to a station for which station data processing is required; Calculate, according to the trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, a neighborhood trajectory vector corresponding to the first station to be processed, wherein the neighborhood trajectory vector is a vector formed by two adjacent trajectory points of the first station to be processed in the public transportation line to which it belongs; Based on the neighborhood trajectory vector corresponding to the first to-be-processed station, deduplication processing is performed on the station data of the first to-be-processed station to obtain the processed station data of each public transportation line; The station data includes station coordinates and station names, and the station data of the first station to be processed is deduplicated based on the neighborhood trajectory vector corresponding to the first station to be processed to obtain the processed station data of each public transportation line, including: Constructing a first set of sites with the same name, wherein all first sites to be processed in the first set of sites with the same name have the same site name; Calculate the vector cosine of the neighborhood trajectory vector between any two first to-be-processed sites in the first set of sites with the same name according to the neighborhood trajectory vector corresponding to the first to-be-processed sites in the first set of sites with the same name; Calculate the coordinate difference between any two first to-be-processed sites in the first set of sites with the same name according to the site coordinates of the first to-be-processed sites in the first set of sites with the same name; Deduplication processing is performed on the site data of at least two first to-be-processed sites in the first set of sites with the same name whose vector cosine and coordinate difference satisfy the first clustering condition to obtain the processed site data of each public transportation line.

2. The data processing method according to claim 1, characterized in that: The calculating, according to the trajectory point data of each trajectory point in the public transportation line to which the first to-be-processed station belongs, a neighborhood trajectory vector corresponding to the first to-be-processed station comprises: Determine, according to the trajectory point data of each trajectory point in the public transportation line to which the first to-be-processed station belongs, a first adjacent trajectory point and a second adjacent trajectory point of the first to-be-processed station in the public transportation line to which it belongs; A neighborhood trajectory vector corresponding to the first to-be-processed site is calculated based on trajectory point data of the first adjacent trajectory point and the second adjacent trajectory point.

3. The data processing method according to claim 2, characterized in that: The track point data includes track point coordinates and track point serial numbers, and the step of determining the first adjacent track point and the second adjacent track point of the first station to be processed in the public transportation line to which the first station to be processed belongs according to the track point data of each track point in the public transportation line to which the first station to be processed belongs comprises: Calculating the trajectory distances between the first to-be-processed site and each of the trajectory points according to the trajectory point coordinates of each of the trajectory points in the public transportation line to which the first to-be-processed site belongs; Determine the trajectory point corresponding to the shortest trajectory distance among the trajectory distances as the third adjacent trajectory point; According to the trajectory point sequence number of the third adjacent trajectory point, a trajectory point separated from the trajectory point sequence number of the third adjacent trajectory point by a preset distance is determined as a first adjacent trajectory point and a second adjacent trajectory point.

4. The data processing method according to claim 1, characterized in that: The step of performing deduplication processing on the site data of at least two first to-be-processed sites whose vector cosine and coordinate difference values ​​satisfy the first clustering condition in the first set of sites with the same name to obtain the processed site data of each public transportation line includes: Clustering at least two first to-be-processed sites in the first set of sites with the same name whose vector cosine and coordinate difference satisfy a first clustering condition; The site data of at least two first to-be-processed sites configured with the same clustering label are deduplicated to obtain the processed site data of each public transportation line.

5. The data processing method according to claim 1, characterized in that: The method further comprises: Based on the station data of each of the plurality of public transportation lines, determining a second station to be processed, wherein the second station to be processed is a station shared by at least two public transportation lines and / or a station configured in a single and multi-directional public transportation line, and the station type of the second station to be processed is different from the station type of the first station to be processed; Based on the site coordinates of the second site to be processed, the site data of the second site to be processed is deduplicated to obtain the processed site data of each public transportation line.

6. The data processing method according to claim 5, characterized in that: The step of performing deduplication processing on the site data of the second site to be processed based on the site coordinates of the second site to be processed to obtain the processed site data of each public transportation line includes: Constructing a second set of sites with the same name, wherein all second sites to be processed in the second set of sites with the same name have the same site name; Calculate the coordinate difference between any two second to-be-processed sites in the second set of sites with the same name according to the site coordinates of the second to-be-processed sites in the second set of sites with the same name; The site data of at least two second sites to be processed in the second set of sites with the same name whose coordinate differences meet the second clustering condition are deduplicated to obtain the processed site data of each public transportation line.

7. A data processing device, characterized in that: include: An acquisition module, used for acquiring route data of each public transportation route among a plurality of public transportation routes, wherein the route data includes track point data of each track point in the public transportation route and station data of stations included in the public transportation route; A first determination module is used to determine a first site to be processed based on the site data of each of the plurality of public transportation lines, wherein the first site to be processed is a site shared by at least two public transportation lines and / or a site configured in a single and multi-directional public transportation line, and the first site to be processed refers to a site that needs to be processed for site data; A calculation module, configured to calculate a neighborhood trajectory vector corresponding to the first station to be processed according to trajectory point data of each trajectory point in the public transportation line to which the first station to be processed belongs, wherein the neighborhood trajectory vector is a vector formed by two adjacent trajectory points of the first station to be processed in the public transportation line to which it belongs; A first deduplication processing module is used to perform deduplication processing on the site data of the first site to be processed based on the neighborhood trajectory vector corresponding to the first site to be processed, so as to obtain the processed site data of each public transportation line; Wherein, the first deduplication processing module includes: A constructing unit, configured to construct a first set of sites with the same name, wherein all first sites to be processed in the first set of sites with the same name have the same site name; a cosine calculation unit, configured to calculate the vector cosine of the neighborhood trajectory vector between any two first to-be-processed sites in the first set of sites with the same name, according to the neighborhood trajectory vector corresponding to the first to-be-processed site in the first set of sites with the same name; A difference calculation unit, used for calculating the coordinate difference between any two first to-be-processed sites in the first set of sites with the same name according to the site coordinates of the first to-be-processed sites in the first set of sites with the same name; The deduplication processing unit is used to deduplicate the site data of at least two first sites to be processed in the first set of sites with the same name whose vector cosine and coordinate difference meet the first clustering condition, so as to obtain the processed site data of each public transportation line.

8. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Citation Information

Patent Citations

  • Method, system and device for automatically matching public transit network with road network, and storage medium

    CN113723715A