Information processing method and information processing device

Abstract

To provide a technique which can combine adjacent road graphs in high accuracy.SOLUTION: An information processing method for combining a first road graph corresponding to a first region, with a second road graph corresponding to a second region which partially overlaps with the first region, includes: a selection step of selecting any one edge from the plurality of edges which overlap with each other in the first road graph and the second road graph, maintaining the selected edge and deleting the edge which was not selected; and a merge step of determining whether or not to merge a first node, about the first node connected to the deleted edge, selecting a second node to be merged when merging it, and merging the first node to the second node.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing method and an information processing device. [Background technology]

[0002] The map tiling system disclosed in Patent Document 1 divides an area into sub-areas, uses names for roads or railway lines so as not to be affected by the boundaries of the divided sub-areas, and generates the final map. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-168961 Summary of the Invention [Problem to be solved by the invention]

[0004] One aspect of the present disclosure aims to provide a technology that can combine adjacent road graphs with high accuracy. [Means for solving the problem]

[0005] One aspect of the present disclosure is an information processing method for merging a first road graph corresponding to a first area with a second road graph corresponding to a second area that partially overlaps with the first area, characterized by including: a selection step for selecting one edge from a plurality of overlapping edges in the first road graph and the second road graph, maintaining the selected edge, and deleting the unselected edges; and a merging step for determining whether to merge a first node connected to the deleted edge, and if so, selecting a second node to merge with, and merging the first node with the second node. [Effects of the Invention]

[0006] According to aspects of the present disclosure, adjacent road graphs can be combined with high accuracy. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating a road graph creation device (information processing device). [Figure 2] 10A and 10B are diagrams illustrating a selection process for selecting edges to be maintained when combining road graphs. [Figure 3] FIG. 10 is a diagram for explaining a merge process when combining road graphs. [Figure 4] FIG. 10 is a diagram for explaining a specific example of merging processing. [Figure 5] FIG. 10 is a diagram for explaining a process for executing a road graph joining process in parallel. [Figure 6] FIG. 10 is a diagram illustrating an example of a process for executing road graph combining processes in parallel. DETAILED DESCRIPTION OF THE INVENTION

[0008] Road graphs are created based on images of roads, such as satellite images and aerial images. There is a demand for creating road graphs covering a wide area of ​​several hundred kilometers or more, but due to computational constraints, it is necessary to create road graphs from small images and then combine these multiple road graphs to create a road graph covering a wide area. Therefore, it is necessary to perform the road graph combining process accurately and efficiently.

[0009] (Overall composition) 1(A) is a diagram showing the configuration of a road graph creation device (information processing device) 100 in one embodiment. The road graph creation device 100 includes a processor 110 and a memory 120. The memory 120 non-temporarily stores computer programs that cause the processor 110 to function as an image input unit 111, an ROI input unit 112, an ROI division unit 113, an image extraction unit 114, a road graph extraction unit 115, and a combination unit 116. The combination unit 116 has a selection unit 117 and a merging unit 118 as sub-functional units.

[0010] Fig. 1(B) is a diagram for explaining the process of creating a road graph from road images such as satellite images, aerial images, etc. An overview of each functional unit of the road graph creation device 100 will be explained with reference to Fig. 1(B).

[0011] The image input unit 111 acquires a road image and stores it in the memory 120. The ROI input unit 112 accepts input of a region of interest (ROI) for creating a road graph and passes it to the ROI division unit 113. The ROI division unit 113 divides the region of interest into multiple sub-regions. The division is performed so that each sub-region partially overlaps with an adjacent sub-region. In one example, the sub-regions all have the same shape and size, and in another example, the sub-regions have different shapes or sizes. The image extraction unit 114 divides the road image acquired by the image input unit 111 into multiple divided road images (hereinafter simply referred to as divided images) according to the sub-regions obtained by the ROI division unit 113. Note that multiple road images may be input, and multiple road images may be used to generate one divided road image.

[0012] The road graph extraction unit 115 extracts a road graph from each segmented image. The road graph can be extracted using a known technique such as Sat2Graph (https: / / arxiv.org / abs / 2007.09547), which infers a road graph from an image using graph tensor encoding. The road graph extraction process can be executed in parallel for each segmented image, and is therefore scalable. A road graph consists of multiple road edges (hereinafter simply referred to as edges) and multiple road nodes (hereinafter simply referred to as nodes). An edge is a line segment corresponding to multiple points on a road. A node is the endpoint of an edge, and one or more edges are connected to one node.

[0013] The combining unit 116 combines multiple divided road graphs to create a road graph corresponding to the entire ROI. The combining process by the combining unit 116 can be considered as post-processing of the road graph extraction process. The combining process is performed using the selecting unit 117 and merging unit 118. When combining adjacent road graphs, the selecting unit 117 determines which of the overlapping edges between the road graphs to select as the edge to be maintained. The merging unit 118 merges the adjacent road graphs using the edges selected by the selecting unit. The combining unit 116 (the selecting unit 117 and the merging unit 118) will be explained in detail later.

[0014] The key points in the process of merging divided road maps are to accurately merge two adjacent divided road graphs and to ensure scalability of the merging process for the entire road graph. To improve merging accuracy, it is necessary to appropriately select and merge overlapping edges and nodes in adjacent divided road graphs. Furthermore, to ensure scalability of the entire merging process, it is necessary to make it possible to execute merging processes for multiple areas in parallel. This embodiment improves these two points.

[0015] (Combining adjacent road maps) First, the process of joining two adjacent divided road graphs will be described with reference to Figures 2 and 3. Figure 2(A) is a flowchart of the selection process performed by the selection unit 117. The selection unit 117 performs the selection process on two adjacent divided road graphs.

[0016] Here, as shown in Figure 2(B), an example will be explained in which processing is performed on the first divided road graph T1 and the second divided road graph T2. Hereinafter, the divided road graph T1 and the divided road graph T2 will also be simply referred to as graph T1 and graph T2. In the area where graph T1 and graph T2 overlap, graph T1 has edges E1-1 to E1-3, and graph T2 has edges E2-1 to E2-4.

[0017] In step S201, the selection unit 117 extracts multiple overlapping edges in the overlapping region of graph T1 and graph T2. In the example of FIG. 2B, edges E1-1 and E2-1 overlap, edges 1-2 and 2-2 overlap, and edges 1-3 and 2-3 overlap. The selection unit 117 adds a buffer of a predetermined size (e.g., 5 meters) to each edge, and determines that two buffered edges overlap in any of the following cases: -Multi line intersection If it is a multipoint intersection If the line crosses the line with a length equal to or greater than half the length of the shorter of the two edges

[0018] In step S202, the selection unit 117 assigns a score to edges determined to overlap (hereinafter also referred to as overlapping edges) and temporarily stores the scores in memory. At this time, the selection unit 117 assigns a score to each overlapping edge. The score is a function of the distance between the region center of the road graph and the edge and the edge length, and the closer the distance from the region center, the higher the score is calculated, and the longer the edge length, the higher the score is calculated. The reason for calculating the score in this way is that edges closer to the region center are less affected by image distortion and are more reliable, and longer edges are more reliable. Edges determined not to overlap are stored in memory as retained edges (edges that remain in the output connection graph).

[0019] In step 203, the selection unit 117 regroups the scored edges (in other words, the edges that are determined to overlap).

[0020] In step S204, the selection unit 117 keeps the edge with the highest score for each group and deletes the other edges.

[0021] FIG. 2(C) is a diagram showing an example of the results of the selection process for the edges shown in FIG. 2(B). Here, edge E1-1 is selected from overlapping edges E1-1 and E2-1. Similarly, edge E1-2 is selected from edges E1-2 and E2-2, and edge E2-3 is selected from edges E1-3 and E2-3. That is, through the selection process, edges E1-1, E1-2, and E2-3 are selected as overlapping edges to be retained, and edges E2-1, E2-2, and E1-3 are deleted. Edge E2-4 is also determined not to be an overlapping edge and is therefore an edge to be retained.

[0022] 3 is a flowchart showing the merging process by the merging unit 118. The merging process is executed on the results of the selection process.

[0023] First, let us explain the "degree of a node." The "degree of a node" is defined as the number of edges connected to that node. For example, in Figure 2(B), three nodes E1-1, E1-2, and E1-3 are connected to node N1, so the degree of node N1 is "3." Similarly, in Figure 2(B), the degree of node N2 is "4." In Figure 2(C), edge E1-3 has been deleted, so the degree of node N1 has changed to "2," and edges E2-1 and E2-2 have been deleted, so the degree of node N2 has changed to "2."

[0024] The merge process in Fig. 3 is roughly divided into a loop process L1 including steps S301 to S307, and a loop process L2 including steps S308 to S310. Loop process L1 is performed on all nodes, and is a process to determine whether or not each node is to be subject to merge process (edge ​​reconnection). Loop process L2 is a process to actually merge nodes.

[0025] The node selected as the processing target in the loop process L1 is referred to as node n. In step S301, the merging unit 118 determines whether node n was connected to an edge deleted in the selection process. If the determination is negative, node n is not a target for the merging process, and the loop process L1 moves on to processing the next node. If the determination is positive, the process proceeds to step S302.

[0026] In step S302, the merging unit 118 calculates the degree (referred to as k0) of node n before the selection process for node n.

[0027] In step S303, the merge unit 118 selects the node (referred to as node n') closest to node n.

[0028] In step S304, the merging unit 118 determines whether the distance between nodes n and n' is less than a threshold. If the distance is equal to or greater than the threshold, node n is not subject to the merging process, and loop processing L1 moves to processing the next node. If the distance is less than the threshold, processing proceeds to step S305.

[0029] In step S305, the merging unit 118 determines whether nodes n and n' are connected. If node n is connected to the nearest node n', node n is not subject to the merging process, and loop process L1 moves to processing the next node. If they are connected, the process proceeds to step S306.

[0030] In step S306, the merging unit 118 determines whether or not merging nodes n and n' brings the degree of node n closer to the node degree before the selection process. Specifically, the merging unit 118 determines whether or not the following conditional expression is satisfied: ABS(k0-k1) < ABS(k0-k2)

[0031] Here, ABS is a function that returns the absolute value, k0 is the degree of node n before the selection process, and k1 is The degree of node n after the selection process, k2 is the degree of node n when nodes n and n' are merged.

[0032] If the above conditional expression is not satisfied, node n is not subject to the merge process, and loop process L1 moves to processing the next node.If the above conditional expression is satisfied, the process proceeds to step S307.

[0033] In step S307, the merging unit 118 stores the node n as a merge candidate in memory, and stores the node n' as a merge destination of the node n in association with the node n.

[0034] The loop process L1 is executed for all nodes.

[0035] Here, a specific description will be given with reference to Figures 2(B) and 2(C). It is assumed that the distance between nodes N1 and N2 is less than the threshold value in step S304.

[0036] Node N2 is connected to edges E2-1 and E2-2 that were deleted in the selection process, and the distance to the nearest node N2 is less than the threshold, so the degree of node N2 changes from "2" to "4" due to the merger, approaching the degree of node N before the selection process, which was "4." Therefore, node N2 is determined to merge with node N1.

[0037] Node N1 is connected to edges E2-1 and E2-2, which were deleted in the selection process, and the distance to its nearest neighbor, node N2, is less than the threshold. However, merging with node N1 changes the degree of node N2 from "2" to "4," which does not approach the degree "3" before the selection process. Therefore, node N1 is not determined to be a node to be merged with other nodes.

[0038] Loop processing L2 is executed for each merge candidate node stored in step S307. Hereinafter, the candidate node to be processed in the loop processing is referred to as node m.

[0039] In step S308, it is determined whether another candidate node m' exists that is close to candidate node m. The distance threshold for this proximity determination may be the same as or different from the threshold used in step S304. There may be multiple candidate nodes m'. If candidate node m is close to another candidate node m', the process proceeds to step S309; ​​if not, the process proceeds to step S310.

[0040] In step S309, the merging unit 118 determines the position of the merge destination node based on the candidate node m and the candidate node m' in order to merge the candidate node m and the adjacent candidate node m' into the same node. Examples of the position of the merge destination node include the position of the candidate node m, the position of the candidate node m', the average position (center of gravity) of the candidate nodes m and m', and the weighted average position of the candidate nodes m and m'. Note that the weight in the weighted average can be determined based on the scores of the edges connected to the node, and can be, for example, a value corresponding to the sum or average of the scores of the edges connected to the node.

[0041] Even if there is no other candidate node adjacent to candidate node m, the position of the merge-destination node of candidate node m may be determined as described above based on candidate node m and its merge-destination node (nodes n and n' in step S307). Also, even if there is another candidate node adjacent to candidate node m, the position of the merge-destination node may be determined in the same manner as described above, taking into account the merge-destination node of the candidate node.

[0042] In step S310, the merging unit 118 merges the merge candidate node with its merge destination node. For example, the merging unit 118 connects the edge connected to the merge candidate node to the merge destination node and deletes the merge candidate node.

[0043] If the determination in step S308 is affirmative, the merging unit 118 merges the candidate nodes m and m' with the merge-destination node. The merging unit 118 may also create a new node having the merge-destination node position determined in step S309 and merge nodes m and m' into the new node. Alternatively, the merging unit 118 may change the position of the merge-destination node of either node m or m' and merge the other node into the node after the change in position.

[0044] The loop process L2 is repeated until there are no more unprocessed candidate nodes m.

[0045] Here, a specific explanation will be given using Fig. 4. Fig. 4(A) is the same as Fig. 2(B).

[0046] Figure 4(B) shows the state of Figure 4(A) after nodes N2 and N1 have been merged, with N2 as the destination node. Edges E2-3 and E2-4, which were connected to node N2 before the process, are changed to edges E2-3' and E2-4', which connect to node N1. Edges E1-1 and E1-2, which were connected to node N1 before the process, remain unchanged.

[0047] 4(C) shows the state of FIG. 4(A) after nodes N2 and N1 have been merged, with the destination node being new node N3. Here, node N3 is positioned at the average position of nodes N1 and N2, but may be positioned elsewhere. Edges E1-1 and E1-2 connected to node N1 before processing are changed to edges E1-1' and E1-1' connected to node N3. Similarly, edges E2-3 and E2-4 connected to node N2 before processing are changed to edges E2-3' and E2-4' connected to node N3.

[0048] (Parallel processing of road map merging) 5 and 6, a method for performing the above-mentioned adjacent road map combining process in parallel across the entire ROI region will be described. The adjacent road map combining process can also be called post-processing after road graph extraction.

[0049] FIG. 5A is a flowchart of the combining process (post-processing) performed by the combining unit 116.

[0050] In step S501, the combining unit 116 acquires the multiple divided road graphs extracted by the road graph extraction unit 115. In one embodiment, as shown in Fig. 5(B), the divided road graphs have a rectangular shape, and the rectangular divided road graphs are arranged in a horizontal and vertical direction. Note that the vertical and horizontal directions are used for convenience of explanation, and these two directions may be any directions and do not have to be perpendicular to each other.

[0051] In step S502, the combining unit 116 divides the divided road graphs into groups and assigns a label to each divided road graph in the group. In one embodiment, the combining unit 116 divides the divided road graphs into groups so that each group contains nine divided road graphs, each with a 3x3 arrangement, as shown in FIG. 5(B). The combining unit 116 also assigns labels to the divided road graphs belonging to each group based on their position within the group. In other words, labels are assigned to the divided road graphs according to their relative position within the group. In FIG. 5(B), the labels are numbers from "1" to "9," but they do not have to be numbers as long as they can be distinguished. Labels and label assignments can also be referred to as classes and class classification, respectively.

[0052] In step S503, the combining unit 116 selects one label from the multiple labels. In step S504, the combining unit 116 performs selection processing by the selection unit 117 and merging processing by the merging unit 118 on the divided road graph having the selected label and its neighboring divided road graphs, thereby combining the divided road graphs. The combining unit 116 performs the combining processing (selection processing and merging processing) in parallel for each group. Because the divided road graphs to be processed in the combining processing differ between groups, the combining processing (selection processing and merging processing) can be performed in parallel for each group.

[0053] In step S505, it is determined whether all divided road graphs have been joined, and if there are any unjoined divided road graphs remaining, the process proceeds to step S503, where another label is selected and the process is repeated. When all divided road graphs have been joined, the process ends.

[0054] The parallel execution of the joining process will be specifically described with reference to Fig. 6. Fig. 6(A) shows a specific example of the loop process of steps S503 to S505 in the flowchart of Fig. 5(A). .

[0055] In step S601, the combining unit 116 selects an arbitrary label from the nine labels in a 3 x 3 matrix. Here, it is assumed that the label "1" located in the corner of the nine labels is selected.

[0056] In step S602, the combining unit 116 performs combining processing (selection processing and merging processing) on ​​the nine divided road graphs: the selected divided road graph with label "1" and its eight neighboring road graphs. There are a total of 12 overlapping areas in the nine divided road graphs, so the combining processing is performed sequentially on these 12 overlapping areas (boundary areas). The combining unit 116 also performs combining processing in parallel for each group.

[0057] In Figure 6(B), the divided road graphs referenced in each of the join processes executed in parallel are indicated by bold rectangles. As shown in the figure, each join process processes a different divided road graph, so each join process can be executed simultaneously in parallel.

[0058] In Figure 6(C), the overlapping area (boundary area) that is merged by the merging process centered on label "1" is shown in bold. As described above, the overlapping areas inside the nine divided road graphs centered on label "1" are merged.

[0059] In step S603, the combining unit 116 selects a label different from the label "1" selected in step S601. The label selected here may be any label as long as it is located at a different position horizontally and vertically from the label selected in step S601. Here, it is assumed that the label "9" located diagonally opposite the label "1" is selected.

[0060] In step S604, the combining unit 116 executes combining processing (selection processing and merging processing) in parallel for the nine divided road graphs, namely the selected divided road graph with label "9" and its eight neighboring road graphs. Note that the combining processing may be omitted for the overlapping areas for which the combining processing was performed in step S602.

[0061] In Figure 6(D), the divided road graphs to be processed in each of the merging processes executed in parallel are shown in bold rectangles 620. In Figure 6(E), the overlapping area (boundary area) to be merged by the merging process centered on label "9" is shown in bold.

[0062] As can be seen from Figures 6(C) and 6(E), if a merging process is performed on the labels "1" and "9" (or on the two diagonally opposite corners of a 3x3 divided road graph), the entire divided road graph will be merged.

[0063] In the above explanation, the merging process is performed on the labels "1" and "9," but the entire merging process can be performed by merging two labels: label "1" and one of the labels "5," "6," "8," or "9." In other words, it is sufficient to perform the merging process on two labels: one of the nine 3x3 divided road graphs, and another label that is in a different position both vertically and horizontally from that label.

[0064] (Modification 1 of the joining process) In addition, although the entire interior of the nine divided road graphs is the target of the merging process, it is also possible to target only the overlapping area between the selected label and its four neighboring divided road graphs. In this case, selecting the labels "1", "3", "5", "7", and "9" and performing the merging process five times will merge the entire area.

[0065] (Modification 2 of the joining process) More generally, the size of a group may be any size, for example, 2x2, or 4x4 or more. The vertical and horizontal sizes of a group may also be different. That is, the size of a group may be pxq (p≧2, q≧2).

[0066] The combining unit 116 may combine multiple road graphs that are aligned in the first direction and the second direction and partially overlap with adjacent regions in parallel as follows: The combining unit 116 divides all of the multiple road graphs into a first group in a mutually exclusive and exhaustive (MECE) manner (see region 610 in FIG. 6(B)). Here, each group has the same shape containing p×q (p≧2, q≧2) road graphs. The combining unit 116 then performs a combining process to combine all of the multiple road graphs in the first group. Here, the combining process is performed in parallel on a group-by-group basis. Next, the combining unit 116 divides all of the multiple road graphs into a second group in a mutually exclusive and exhaustive (MECE) manner (see region 620 in FIG. 6(D)). Compared to the first grouping, the second grouping has different group boundary positions in the first direction and the second direction. The combining unit 116 then performs a combining process to combine all of the multiple road graphs in the second group. In general, by performing this combining process on two groups, it is possible to combine multiple road graphs as a whole. The process can be executed in parallel.

[0067] (Effects of the embodiment) According to the above embodiment, a road graph can be created from road images of a wide area by executing the road graph extraction process and the merging process in parallel. Because parallel processing is possible, it is possible to create a road graph of a wider area by investing computational resources without increasing the overall processing time. Furthermore, according to the selection process and merging process of the above embodiment, it is possible to quickly and accurately merge two road graphs.

[0068] (Other embodiments) The above-described embodiment is merely an example, and the present disclosure can be modified and implemented as appropriate within the scope that does not deviate from the gist of the disclosure.

[0069] The present disclosure can also be realized by providing a computer program implementing the functions described in the above embodiments to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer via a non-transitory computer-readable storage medium connectable to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk, such as a magnetic disk (e.g., a floppy disk, a hard disk drive (HDD), etc.), an optical disk (e.g., a CD-ROM, a DVD disk, a Blu-ray disk), a read-only memory (ROM), a random-access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, an optical card, or any type of medium suitable for storing electronic instructions. [Explanation of symbols]

[0070] 100: Road graph creation device (information processing device) 110: Processor 111: Image input unit 112: ROI input unit 113: ROI division unit 114: Image extraction unit 115: Road graph extraction unit 116: Combination unit 117: Selection section 118: Merge section

Claims

1. An information processing method executed by an information processing device, which combines a first road graph corresponding to a first area with a second road graph corresponding to a second area that partially overlaps with the first area, a selection step of selecting one edge from among a plurality of overlapping edges in the first road graph and the second road graph, keeping the selected edge, and deleting edges that were not selected; a merging step of determining whether or not to merge a first node connected to the deleted edge, and if so, selecting a second node to merge with the first node, and merging the first node with the second node; An information processing method comprising:

2. The merging step comprises: selecting a node closest to the first node as the second node; merging the first node and the second node if a predetermined condition is met; Including, The predetermined condition is: the distance between the first node and the second node is less than a threshold; the first node and the second node are not connected, and a difference between the number of edges connected to the first node after merging and the number of edges connected to the first node before the selection step is smaller than a difference between the number of edges connected to the first node before merging and the number of edges connected to the first node before the selection step; The condition is, 2. The information processing method according to claim 1,

3. In the merging step, the position of the node after merging the first node and the second node is determined by the position of the first node, the position of the second node, the average position of the positions of the first node and the second node, and the score of the edges connected to the node.

3. The information processing method according to claim 2, wherein the position of the first node is a weighted average position of the position of the second node using weights based on a weighting factor.

4. the selecting step includes a step of calculating scores of the plurality of edges; and a step of selecting an edge having the highest score from the plurality of edges; The score is calculated to be higher the closer the distance between the edge and the center of the road graph to which the edge belongs, and higher the longer the length of the edge.

2. The information processing method according to claim 1, wherein:

5. An information processing device including a processor and a storage device, The storage device, when executed by the processor, causes the processor to: a selection step of selecting one edge from among a plurality of overlapping edges in a first road graph corresponding to a first region and a second road graph corresponding to a second region partially overlapping the first region, keeping the selected edge and deleting the unselected edges; a merging step of determining whether or not to merge a first node connected to the deleted edge, and if so, selecting a second node to merge with the first node, and merging the first node with the second node; An information processing device characterized by storing a program for executing the above.

Images