Information processing system, information processing method, and program

Abstract

To make it possible to support the correction of the shape of an object appearing in an image.SOLUTION: An information processing system comprises an input unit which accepts specification of positions of vertices of a polygon delineating an object on an image capturing the object, and a correction unit which corrects the specified positions so as to align them with grid points obtained by dividing the image into a lattice.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] In recent years, aircraft such as drones or multicopters, which fly by rotating multiple propellers, have been used to observe objects from high altitudes, photograph the ground from above, or observe areas that are difficult to access. Images captured from high altitudes using such aircraft can be used for inspecting or surveying the objects.

[0003] For example, Patent Document 1 discloses a technique for measuring the shape and dimensions of a target object, that is, a roof, from an image of the target object captured by a camera mounted on an aircraft, and calculating the area of ​​the roof from the shape and dimensions. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-162552 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the technology disclosed in the above patent document, the image of the object captured from a high place is given perspective by central projection, so the shape of the object as seen by parallel projection often differs from the shape of the object in the image captured from a high place.

[0006] The present invention has been made in view of the above background, and aims to support correction of the shape of an object shown in an image. [Means for solving the problem]

[0007] The main invention of the present invention for solving the above problem is an information processing system characterized by comprising an input unit that accepts specification of the positions of vertices of a polygon that divides an object on an image of the object, and a correction unit that corrects the specified positions to align with lattice points that divide the image into a grid pattern.

[0008] Other problems and solutions disclosed in this application will be made clear in the section on preferred embodiments of the invention and the drawings. [Effects of the Invention]

[0009] According to the present invention, it is possible to assist in correcting the shape of an object shown in an image. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating an overview of an information processing system according to an embodiment of the present invention. [Figure 2] 1 is a block diagram showing a configuration of an information processing terminal 10 according to an embodiment of the present invention. [Figure 3] FIG. 2 is a diagram illustrating an example of a functional configuration of an information processing terminal 10. [Figure 4] An example of how image information 131 is generated is shown below. [Figure 5] FIG. 10 is a diagram showing a display example of image information 131. [Figure 6] 10 is a diagram showing an example of generating node information 132 and line segment information 133. FIG. [Figure 7] FIG. 10 is a diagram showing an example of attribute information 135 that defines five types of node attributes. [Figure 8] FIG. 10 is a diagram showing an example of attribute information 135 that defines a combination of node attributes. [Figure 9] FIG. 10 is a diagram showing an example in which image information 131 is divided into a grid pattern. [Figure 10] FIG. 10 is a diagram illustrating correction to match lattice points. [Figure 11] 13 is a diagram showing an example of displaying line segment information 133 and node information 132. FIG. [Figure 12]FIG. 10 is a diagram illustrating a correction process. [Figure 13] FIG. 10 is a diagram illustrating a correction process. [Figure 14] 13 is a diagram showing an example of displaying line segment information 133 and node information 132 using corrected nodes. FIG. [Figure 15] 3 is a diagram illustrating the operation of the information processing terminal 10. FIG. [Figure 16] FIG. 10 is a diagram showing an outline of an information processing system 1′ according to another embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0012] <System Overview> 1 is a diagram showing an outline of an information processing system according to an embodiment of the present invention. As shown in the diagram, the information processing system 1 includes an information processing terminal 10.

[0013] The information processing terminal 10 according to this embodiment is implemented as a so-called small tablet-shaped computer. In other embodiments, the information processing terminal 10 may be implemented as a portable information processing terminal such as a smartphone or a game console, or as a stationary information processing terminal such as a personal computer. The information processing terminal 10 may also be implemented as a plurality of pieces of hardware, with functions distributed among them.

[0014] <Hardware configuration example> 2 is a block diagram showing the configuration of an information processing terminal 10 according to one embodiment of the present invention. As shown in the figure, the information processing terminal 10 includes a control unit 11 and a touch panel unit 12 which is a display unit.

[0015] The control unit 11 includes, as its main components, a processor 11a, a memory 11b, a storage 11c, a transmitting / receiving unit 11d, and an input / output unit 11e, which are electrically connected to one another via a bus 11f.

[0016] The processor 11a is a computing device that controls the operation of the control unit 11, controls the transmission and reception of data between the elements, and performs processes required for executing programs.

[0017] In this embodiment, the processor 11a is, for example, a CPU (Central Processing Unit), and executes programs stored in a storage 11c (to be described later) and loaded into a memory 11b to perform various processes.

[0018] The memory 11b includes a main storage device configured as a volatile storage device such as a dynamic random access memory (DRAM), and an auxiliary storage device configured as a nonvolatile storage device such as a flash memory or a hard disk drive (HDD).

[0019] This memory 11b is used as a working area for the processor 11a, and also stores a BIOS (Basic Input / Output System) that is executed when the control unit 11 is started up, various setting information, and the like.

[0020] The storage 11c stores programs, information used for various processes, etc. For example, when a user operates an aircraft for capturing image information of the roof 101 via the information processing terminal 10, the storage 11c may store a program for controlling the flight of the aircraft.

[0021] The transmitter / receiver 11d connects the controller 11 to a network such as the Internet, and may include a short-range communication interface such as Bluetooth (registered trademark) or BLE (Bluetooth Low Energy).

[0022] In this embodiment, for example, a control signal for controlling the flight of the flying object 10 may be transmitted to the flying object 10 via this transceiver unit 11d.

[0023] The input / output unit 11e is an interface to which input / output devices are connected, and in this embodiment, the touch panel unit 12 is connected.

[0024] The bus 11f transmits, for example, address signals, data signals, and various control signals between the connected processor 11a, memory 11b, storage 11c, transmission / reception unit 11d, and input / output unit 11e.

[0025] The touch panel unit 12 is an example of a display unit, and includes a display surface 12a on which acquired videos and images are displayed. In this embodiment, the display surface 12a accepts information input by touching the display surface 12a, and is implemented using various technologies such as a resistive film system or a capacitive system.

[0026] For example, a user can input line segment information or node information to an image displayed on the display surface 12a via the touch panel unit 12. Also, display information output by the control unit 11 is displayed on the display surface 12a.

[0027] <Software configuration example> 3 is a diagram showing an example of the functional configuration of the information processing terminal 10. As shown in the figure, the processor 11a includes an acquisition unit 112, an estimation unit 113, a correction unit 114, and an output control unit 115. The storage 11c stores image information 131, node information 132, line segment information 133, part information 134, attribute information 135, and gradient information 136.

[0028] The image information 131 is, for example, information about an image obtained by capturing an image of the roof 101. Fig. 4 shows an example of how the image information 131 is generated. As shown in the figure, the image information 131 can be generated by a camera 31 attached to an aircraft 30 flying above the roof 101 capturing an image of the roof 101 as an object. The image information 131 obtained by the aircraft 30 is stored in the storage 11c of the information processing terminal 10. The acquired image information 131 can be displayed on the display surface 12a.

[0029] 5 is a diagram showing a display example of image information 131. As shown in the figure, an image including the roof 101 of the building 100 is displayed on the display surface 12a based on the acquired image information 131. In this embodiment, the user operating the information processing terminal 10 visually recognizes the structure of the roof 101 from the image displayed on the display surface 12a.

[0030] The node information 132 and the line segment information 133 are information relating to nodes and line segments for partitioning an area corresponding to, for example, the roof 101. The line segments are part of the outer and inner boundaries of the area that partitions the object, and correspond to constituent parts of the object. For example, if the object is the roof 101, the constituent parts corresponding to the line segments are the eaves, ridge, etc. A node refers to a vertex that connects such multiple line segments. Note that if the object is the roof 101, the constituent parts corresponding to the nodes are the ends (tops) of the eaves, ridge, etc.

[0031] The node information 132 and the line segment information 133 may be generated, for example, by an operation on the display surface 12a by a user operating the information processing terminal 10. Specifically, when an image of a roof 101 is displayed on the display surface 12a, the user may perform an operation on the touch panel unit 12 to set line segments and nodes corresponding to the components of the roof 101.

[0032] FIG. 6 is a diagram showing an example of generating node information 132 and line segment information 133. As shown in the figure, nodes 102a to 102l and line segments 103a to 103o can be set by, for example, a user operating the touch panel unit 12. The nodes 102a to 102l and line segments 103a to 103o may be set by the user inputting the nodes and line segments so that they are superimposed on the displayed image of the roof 101. In this case, the area that defines the object refers to the area surrounded by the line segments 103a to 103o. Furthermore, the periphery of the area refers to the portion formed by the line segments corresponding to the outermost edges of the defined area, as shown in FIG. 6. Furthermore, the inside of the area refers to the inner portion surrounded by the periphery of the area.

[0033] The set nodes 102a to 102l and line segments 103a to 103o are generated as node information 132 and line segment information 133, respectively, and stored in the storage 11c.

[0034] In the above example, the node information 132 and the line segment information 133 are generated by a user's operation on the touch panel unit 12, but this is not limiting. For example, the node information 132 and the line segment information 133 may be generated by extracting portions corresponding to nodes and line segments through image recognition processing of an image showing the roof 101. Such image recognition processing may use, for example, a well-known machine learning method such as deep learning. In this case, the image recognition processing may be realized by using, for example, a learning model related to the image showing the roof 101 and the components of the roof 101. The image recognition processing may be performed by the processor 11a of the information processing terminal 10.

[0035] The part information 134 is information relating to the constituent parts of the object. If the object is a roof 101, the part information 134 may be information indicating the eaves, ridge, etc. The part information 134 may be linked to the line segment information 133 described above. The linking process may be performed by a user operation, or may be performed based on a predetermined algorithm or machine learning. The part information 134 may be used to correct the position of a node.

[0036] The attribute information 135 defines node attributes and combinations of node attributes. A node attribute refers to an attribute of a node that is identified from its relationship with a connecting line segment. In this embodiment, a node can have five attributes ("Corner," "Outer Vertex," "Inner Vertex," "Top Vertex," and "Rake Top Vertex"). Note that the node attributes are not limited to these five, and there may be more or fewer than five types. The node attributes may be defined for one or a combination of two or more of the following: the number of line segments connecting to the node; the type of line segments connecting to the node (type of part); the node attribute of the node on the opposite side of the line segments connecting to the node; the position of the node relative to the area (inside, on the periphery, outside); and the angle between the line segments connecting to the node.

[0037] FIG. 7 is a diagram showing an example of the attribute information 135 that defines five types of node attributes.

[0038] The attribute "Corner" is given when the number of line segments connecting to the node is 2 and the node is located on the periphery of the area.

[0039] The attribute "Outer Vertex" is given when the number of line segments connecting to the node is three, the node's position in the area is on the periphery of the area, and the angle formed by two of the three line segments that make up the periphery of the area inside the area is 180 degrees or less.

[0040] The attribute "Inner Vertex" is given when the number of line segments connecting to the node is three, the node's position in the area is on the periphery of the area, and the angle formed by two of the three line segments that make up the periphery of the area inside the area is 180 degrees or less.

[0041] The attribute "Top Vertex" is given when the node's position in the area is inside the area.

[0042] The attribute "Rake Top Vertex" is given when the number of line segments connecting to the node is three, the node's position in the area is on the periphery of the area, and two of the three line segments connect to the attribute "Corner."

[0043] In this way, the node attribute may be determined based on the number of line segments connected to the node. By using information on the number of line segments, it becomes easier to distinguish between different types of nodes.

[0044] Furthermore, node attributes may be determined based on the angle between one line segment connecting the node and another line segment. For example, as described above, this is because, depending on the angle between the line segments forming the perimeter, the constituent parts of the object corresponding to the line segments existing between the line segments differ, as will be described later. In the example shown in Table 1, the threshold value based on the angle is set to 180 degrees, but the present invention is not limited to this example and can be changed as appropriate depending on the shape of the object, etc.

[0045] FIG. 8 is a diagram showing an example of attribute information 135 that defines a combination of node attributes.

[0046] As shown in FIG. 8, for example, if the attribute (hereinafter referred to as attribute 1) of one of the nodes at both ends of a line segment is either "Corner," "Outer Vertex," or "Inner Vertex," and the attribute (hereinafter referred to as attribute 2) of the other node is "Corner," "Outer Vertex," or "Inner Vertex," then the line segment is estimated to be an "eaves (AA)." The eaves are parallel to the ground on the roof 101 and form the perimeter of the roof 101. Therefore, in the case of the above-mentioned combination of node attributes, the line segment between them is parallel to the ground and is therefore estimated to be an eaves.

[0047] Furthermore, if attribute 1 is "Outer Vertex" and attribute 2 is "Top Vertex," the line segment is estimated to be a "corner ridge (BB)." This is because the line segment is determined to be a ridge portion that is geometrically convex upward on the roof 101. Furthermore, if attribute 1 is "Inner Vertex" and attribute 2 is "Top Vertex," the line segment is estimated to be a "valley (CC)." This is because the line segment is determined to be a ridge portion that is geometrically convex downward on the roof 101.

[0048] Also, if attribute 1 is "Top Vertex" or "Rake Top Vertex" and attribute 2 is "Top Vertex" or "Rake Top Vertex", the line segment is estimated to be "ridge (DD)". This is because the attributes of both nodes are the tops of the parts that protrude upward on the roof 101, and the line segment corresponds to the ridge line connecting these tops.

[0049] Also, if attribute 1 is "Corner" and attribute 2 is "Rake Top Vertex", the line segment is estimated to be a "Rake Top (EE)". This is because a rake is the tip of a gable, and the combination of each node has a shape that protrudes above the roof 101 on the perimeter of the area.

[0050] The gradient information 136 is information about the gradient of the part of the object corresponding to the region. For example, if the object is a roof 101, the gradient information 136 is information that indicates the gradient of the roof surface. The gradient information 136 can be used to correct the position of the node and to calculate the area of ​​the roof 101.

[0051] The input unit 111 accepts input of image information 131, node information 132, and line segment information 133. The input unit 111 can receive the image information 131 from the flying object 30. The input unit 111 may be configured to accept input of the image information 131 from a user of the flying object 30. The input unit 111 accepts designation of the node information 132. The input unit 111 can accept input of the node information 132 by displaying an image of an object such as a roof 101 based on the image information 131 and accepting designation of a position on the image from the touch panel unit 12 or the like. The input unit 111 can accept input of the line segment information 133. The input unit 111 can accept input of the line segment information 133 by, for example, displaying nodes on an image on the display surface 12a and accepting designation of two nodes from among them.

[0052] The acquiring unit 112 has a function of acquiring various information from the storage 11c. For example, the acquiring unit 112 can acquire input information (image information 131, node information 132, line segment information 133) and object information (region information 134, attribute information 135, gradient information 136) from the storage 11c.

[0053] The estimation unit 113 has a function of estimating a constituent part of an object corresponding to a set line segment, based on the various input information (image information 131, node information 132, line segment information 133) and object information (part information 134, attribute information 135, gradient information 136) acquired by the acquisition unit 112. For example, the estimation unit 113 acquires the part information 134 and the attribute information 135 from the storage 11c, and identifies node attributes defined in the attribute information 135 for various nodes included in the node information 132. Then, for various line segments included in the line segment information 133, the estimation unit 113 can estimate the constituent parts of the object based on the correspondence between the combination of the node attributes of the nodes at both ends of the line segment and the constituent parts of the object included in the part information 134.

[0054] The estimation unit 113 estimates node attributes for various nodes included in the node information 132. The node attributes can be estimated based on the angle formed by two line segments connecting to the node. The node attributes can be estimated based on where in the area the node is located. For example, the node attributes may differ depending on whether the node is on the periphery of the area or inside the area. This is because constituent parts of an object are distinguished by whether they are on the outer periphery or inside the object. The estimation unit 113 can estimate the node attributes based on, for example, the attribute information 135 shown in FIG. 7. The estimation unit 113 can identify attributes corresponding to, for example, the number of line segments connected to the node (number of line segment connections), the position in the area (area surrounded by line segments), and the angle formed by the two line segments connecting to the node.

[0055] The estimation unit 113 can estimate the constituent parts of the object corresponding to a line segment based on the attributes of the nodes at both ends of the line segment. Specifically, the estimation unit 113 can estimate the constituent parts of the object corresponding to the line segment based on the combination of the attributes of the nodes at both ends of the line segment. The estimation unit 113 acquires a combination of node attributes of the nodes at both ends of each line segment, matches the constituent parts of the object corresponding to that combination with the attribute information 135, and can estimate the constituent parts of the roof 101 corresponding to the line segment. For example, in the case of the roof 101, the constituent parts of the object correspond to the constituent parts corresponding to each ridge of the roof, such as the "eaves," "ridge," "corner ridge," "ridge edge," "valley," etc.

[0056] The correcting unit 114 can correct the node information 132. The correcting unit 114 can correct the position of the node.

[0057] The correction unit 114 can correct the position of a node to align it with a grid point obtained by dividing the image represented by the image information 131 into a grid. The correction unit 114 can set a number of grid points obtained by dividing the number of vertical or horizontal pixels of the image represented by the image information 131 by a predetermined number (e.g., 163). The number of vertical and horizontal divisions may be different. FIG. 9 is a diagram illustrating an example in which the image information 131 is divided into a grid. This example illustrates an example in which the image information 131 is divided by providing a plurality of grid lines 181 at equal intervals. Note that the grid lines 181 and the grid points 182 may or may not be displayed. The spacing between the horizontal grid lines 181 may differ from the spacing between the vertical grid lines 181. The correction unit 114 can correct the position of a node to align it with the grid point closest to the node position, for example. FIG. 10 is a diagram illustrating the correction to align with a grid point. The example of FIG. 10 shows that the correction unit 114 corrects the position of the node 102i to a node 102i' that is aligned with the nearest lattice point 182(1). Note that the correction unit 114 may correct the position of the node, for example, so that the node is aligned with the nearest lattice point from the node position toward the center of the image. FIG. 10 shows the center 183 of the image, where the X coordinate of the center is greater than the X coordinate and the Y coordinate of the center is smaller than the Y coordinate of the node 102i. In such a case, the correction unit 114 may correct the position of the node 102i to the position of the nearest lattice point 182(2) among the lattice points 182 whose X coordinate is greater than the X coordinate of the node 102i and whose Y coordinate is smaller than the Y coordinate of the node 102i.

[0058] == Input Correction == When the input unit 111 receives a specification of a node position, the correction unit 114 corrects the position specified by the user to match the position of a lattice point 182 (e.g., the nearest lattice point), and then the input unit 111 receives node information 132 including the corrected position.

[0059] ==Perspective correction after correction== The correction unit 114 can also correct the position of the node according to the distance from the camera 31 to the node and the angle of view, since perspective is applied according to this, and can further correct the position to align with the position of the grid point 182. For example, the correction unit 114 can correct the position of the node according to the distance from the center of the captured image to the node and the angle of view of the camera 31. The angle of view of the camera 31 may be known, or angle of view information may be acquired from the flying object 30. The correction unit 114 can further correct the position of the node after correction to align it with the grid point.

[0060] ==Adjustment after adjustment according to part type== The correction unit 114 can also correct the node information 132 based on the part information 134 (part type) linked to the line segment information 133, and can further correct the position to match the position of the lattice point 182.

[0061] FIG. 11 is a diagram showing an example of displaying line segment information 133 and node information 132. Nodes 102a to 102l and line segments 103a to 103o are set, and an area 105 is displayed for roof 101. Attributes are set for these nodes 102a to 102l and line segments 103a to 103o, respectively. The meanings of each attribute are as shown in FIGS. 7 and 8. Legend 104 is a legend for indicating the constituent parts of the object linked to the line segments in association with the display mode of the line segments. These line segments set partitioned areas 161 to 164 corresponding to the roof portion of roof 201.

[0062] In the target areas 151, 152, and 153, line segments 103c, 103f, 103j, 103l, 103m, and 103o correspond to the gable ridges of the roof 101. In this case, in an image captured from a high place, the tops of the ridges (corresponding to nodes 102d, 102i, and 102j) may appear to protrude outward due to central projection. Therefore, by correcting these nodes, it is possible to obtain more accurate shape and dimensions of the roof 101.

[0063] Fig. 12 is a diagram illustrating the correction process. Fig. 13 is also a diagram illustrating the correction process. An example of the correction process for the node 102i in the correction target area 151 shown in Fig. 11 will be described. Similar correction processes can also be performed on the correction target areas 152 and 153.

[0064] In the correction target area 151, line segments 103j and 103m corresponding to the ridge and line segment 103k corresponding to the ridge are connected to node 102i (Rake Top Vertex). Furthermore, line segment 103j is connected to node 102a (Corner). Line segment 103m is connected to node 102k (Corner). In other words, line segments 103j and 103m are the same component parts of the object, and the number of line segments connecting to node 102a and node 102k (the other node than node 102i connected to line segments 103j and 103m) is two for both.

[0065] Generally, when projected from above in a parallel projection, the eaves that make up the gable of a roof appear to connect the corners of the roof (corresponding to corners) in a straight line. Therefore, the correction unit 114 can define a line segment 106 connecting node 102a and node 102k, and perform correction processing by using a point on line segment 106 as the corrected position of node 102i. The slopes of the roof portions corresponding to the divided areas 161 and 162, separated by a line segment 103k' corresponding to the eaves, are equal. In this case, the corrected position of node 102i corresponds to the midpoint 107 of line segment 106. Therefore, the correction unit 114 can correct the position of node 102i to node 102i' so that the position of node 102i becomes the position of midpoint 107.

[0066] Note that if the slopes of the roof portions corresponding to the aforementioned partitioned areas are not equal, even if the roofs appear to be the same size on the image, the actual positions of the ridge peaks may differ, resulting in significantly different roof sizes. In this case, the correction unit 114 may correct the node position using information about the slope. For example, the correction unit 114 may use the slope value or the like as a weight and process the position of the line segment connecting the nodes corresponding to the roof corners according to the weight as the corrected position of the node. The correction unit 114 may further correct line segments 103j, 103k, and 103m according to the corrected node 102i' to become line segments 103j', 103k', and 103m'.

[0067] Here too, the correction unit 114 can further correct the position of the node 102i' to the position of the lattice point 182 that is closest to the position of the midpoint 107 (or closest towards the center position), and also correct the line segments 103j', 103k', and 103m' according to the corrected node 102i''.

[0068] The correction unit 114 can further accept modifications from the user regarding the corrected node. In this case, the correction unit 114 can move the node 102 in response to a drag operation from the user. At that time, the correction unit 114 can attach the node 102 to the lattice point 182.

[0069] In the above description, the correction unit 114 aligns the position of the node 102 with the position of the lattice point 182, but instead of or in addition to this, the correction unit 114 may align the position of the node 102 with the position of the midpoint between the two lattice points 182. The midpoint between the two lattice points 182 may be, for example, the midpoint, or a position equally dividing the distance between the two lattice points 182.

[0070] 14 is a diagram showing an example of displaying line segment information 133 and node information 132 using the corrected nodes. An area 108 drawn using the corrected nodes is displayed on the display surface 12a. In this way, even when the structure of the object is different, the information processing system 1 according to this embodiment can obtain the shape and dimensions of the object structure with higher accuracy.

[0071] The output control unit 115 performs processing to output the line segment information 133 and the node information 132. The output control unit 115 can perform processing to display the screens shown in Fig. 11 and Fig. 14 on the display surface 12a based on the line segment information 133 and the node information 132.

[0072] <Operation> 15 is a diagram illustrating the operation of information processing terminal 10. Information processing terminal 10 acquires image information (S301), divides the number of vertical and horizontal pixels of the image information by a predetermined number, and determines grid points of the acquired image (S302). Information processing terminal 10 accepts node designation from the user (S303), and corrects the positions of the accepted nodes so as to align them with the grid points (S304). Information processing terminal 10 corrects the positions of the nodes in accordance with the part types of the line segments between the nodes (S305), and further corrects the corrected positions so as to align them with the grid points (S306).

[0073] As described above, the information processing system of this embodiment can correct the node positions to match the positions of the grid points into which the image is divided. This makes it possible to prevent position fluctuations. Furthermore, by matching the node positions to the grid points, it is expected that the positions of parts will be set correctly, since, for example, eaves will be more likely to be parallel to each other by matching the node positions to the grid points.

[0074] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and equivalents thereof are also included in the present invention.

[0075] For example, in the above embodiment, the information processing system 1 is realized only by the information processing terminal 10, but is not limited to such an example. Fig. 16 is a diagram showing an outline of an information processing system 1' according to another embodiment. In the other embodiment, the information processing system 1' includes the information processing terminal 10 and a server 20. In this case, for example, some or all of the functions possessed by the processor 11a and storage 11c of the information processing terminal 10 according to the above embodiment may be realized by the processor and storage included in the server 20.

[0076] In the above embodiment, the target object is the roof 101 of the building 100, but the target object may be a tree or any ground surface, or may be an object such as a temporarily stopped automobile or animal. The constituent parts of the target object are set appropriately depending on the type of the target object and the specific structure of the target object.

[0077] Furthermore, the steps in the above embodiments do not necessarily have to be processed in chronological order according to the order described in the flowcharts. For example, the steps in the processes of the above embodiments may be processed in an order different from that described in the flowcharts, or may be processed in parallel.

[0078] <Disclosures> The present disclosure also includes the following configurations. [Item 1] an input unit that receives designation of vertex positions of a polygon that partitions an object on an image of the object; a correction unit that corrects the specified position so that it aligns with a lattice point obtained by dividing the image into a lattice pattern; An information processing system comprising: [Item 2] Item 1, an information processing system according to item 1, The grid points are determined by dividing the number of vertical or horizontal pixels of the image into a predetermined number; An information processing system characterized by: [Item 3] Item 1, an information processing system according to item 1, an acquisition unit for acquiring a part type of a line segment between the two vertices; the correction unit corrects the position of the vertex corresponding to the end of the line segment in accordance with the part type, and corrects the position after correction so as to be aligned with the grid point; An information processing system characterized by: [Item 4] Item 1, an information processing system according to item 1, an estimation unit that estimates a region type of a line segment between the two vertices based on attributes of the two vertices; the correction unit corrects the position of the vertex corresponding to the end of the line segment in accordance with the part type, and corrects the position after correction so as to be aligned with the grid point; An information processing system characterized by: [Item 5] Item 4. The information processing system according to item 4, the attribute is defined for each of one or a combination of two or more of the number of the line segments connecting to the vertex, the part type of the line segments connecting to the vertex, the attribute of the vertex on the opposite side of the line segments connecting to the vertex, the position of the vertex relative to an area, or the angle between the line segments connecting to the vertex; An information processing system characterized by: [Item 6] Item 1, an information processing system according to item 1, the correction unit corrects the positions of the vertices in accordance with the distances from the center of the image, and corrects the corrected positions so as to align with the grid points; An information processing system characterized by: [Item 7] a step of receiving designation of vertex positions of a polygon that partitions the object on an image of the object; correcting the specified position so as to align it with a grid point obtained by dividing the image into a grid; An information processing method characterized by being executed by a computer. [Item 8] a step of receiving designation of vertex positions of a polygon that partitions the object on an image of the object; correcting the specified position so as to align it with a grid point obtained by dividing the image into a grid; A program that causes a computer to execute the following. [Explanation of symbols]

[0079] 1. Information Processing Systems 10 Information processing terminal

Claims

1. an input unit that receives designation of vertex positions of a polygon that partitions an object on an image of the object; a correction unit that corrects the specified position so that it aligns with a lattice point obtained by dividing the image into a lattice pattern; An information processing system comprising:

2. 2. The information processing system according to claim 1, The grid points are determined by dividing the number of vertical or horizontal pixels of the image into a predetermined number; An information processing system characterized by:

3. 2. The information processing system according to claim 1, an acquisition unit that acquires a part type of a line segment between the two vertices; the correction unit corrects the position of the vertex corresponding to the end of the line segment in accordance with the part type, and corrects the position after correction so as to be aligned with the grid point; An information processing system characterized by:

4. 2. The information processing system according to claim 1, an estimation unit that estimates a region type of a line segment between the two vertices based on attributes of the two vertices; the correction unit corrects the position of the vertex corresponding to the end of the line segment in accordance with the part type, and corrects the position after correction so as to be aligned with the grid point; An information processing system characterized by:

5. 5. The information processing system according to claim 4, the attribute is defined for each of one or a combination of two or more of the number of the line segments connecting to the vertex, the part type of the line segments connecting to the vertex, the attribute of the vertex on the opposite side of the line segments connecting to the vertex, the position of the vertex relative to an area, or the angle between the line segments connecting to the vertex; An information processing system characterized by:

6. 2. The information processing system according to claim 1, the correction unit corrects the positions of the vertices in accordance with the distances from the center of the image, and corrects the corrected positions so as to align with the grid points; An information processing system characterized by:

7. a step of receiving designation of vertex positions of a polygon that partitions the object on an image of the object; correcting the specified position so as to align it with a grid point obtained by dividing the image into a grid; An information processing method characterized by being executed by a computer.

8. a step of receiving designation of vertex positions of a polygon that partitions the object on an image of the object; correcting the specified position so as to align it with a grid point obtained by dividing the image into a grid; A program that causes a computer to execute the following.

Images