Information processing device, information processing method, and program

Abstract

To more accurately determine the dimensions of an object. An information processing system for acquiring an image of a surface portion of a building. an acquisition unit, an image correction unit that generates a corrected image by correcting the image using keystone correction, and a line segment acquisition unit that acquires a plurality of line segments that constitute the parts of the building in the and an attribute calculation unit that calculates the attribute of the part.

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] In Patent Document 1, the indoor object of the object is detected from an image captured by a camera mounted on an aircraft. A technique is disclosed for measuring the shape and dimensions of roots and calculating the area of ​​the roof from those shape and dimensions. . [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-162552 Summary of the Invention [Problem to be solved by the invention]

[0004] However, Patent Document 1 does not specifically disclose how to calculate the area. It is difficult to calculate the exact area when photographing the surface at an angle. .

[0005] The present invention has been made in view of the above background, and provides a method for determining the dimensions of an object more accurately. The purpose of this invention is to provide a technology that can [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is an information processing system for a building, an image acquisition unit that acquires an image of the surface portion of the image; and an image correction unit that corrects the image by trapezoid correction. an image correction unit for generating a normal image, and a complex image for correcting the normal image, the complex image being a part of the building; a line segment acquisition unit for acquiring a number of line segments; and an attribute calculation unit for calculating attributes of the surface portion based on the line segments. and a calculation unit.

[0007] Other problems and solutions disclosed in this application are described in the embodiments and drawings. will be more clearly revealed. [Effects of the Invention]

[0008] According to the present invention, the dimensions of an object can be determined more accurately. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of an image of a building 100. [Figure 2] 1 is a diagram illustrating an example of a hardware configuration of an information processing device 10. FIG. [Figure 3] FIG. 2 is a diagram illustrating an example of the software configuration of the information processing device 10. [Figure 4] FIG. 2 is a diagram illustrating the operation of the information processing device 10. [Figure 5] FIG. 10 is a diagram showing how the designation of a rectangular portion 120 is accepted. [Figure 6] FIG. 10 is a diagram showing an example of a captured image after keystone correction. [Figure 7] FIG. 10 is a diagram illustrating a calculated area. [Figure 8] FIG. 10 is a diagram illustrating a processing flow when performing correction according to a gradient. [Figure 9] FIG. 10 is a diagram showing an example in which the surface portion 110 is a roof surface. [Figure 10] FIG. 10 is a diagram showing an example of a gradient input screen. [Figure 11] FIG. 10 is a diagram showing an example in which designation of a surface portion 110 is accepted before keystone correction. [Figure 12] FIG. 10 is a diagram showing an example of calculating the length of a straight portion 150. DETAILED DESCRIPTION OF THE INVENTION

[0010] An information processing device 10 according to an embodiment of the present invention will be described below. The information processing device 10 captures an image of a surface portion 110 (for example, a wall or a roof) of a building 100. The area of ​​the surface portion 110 is calculated from the above. It is also possible to calculate the length of the region corresponding to the sides of a rectangle.

[0011] FIG. 1 is a diagram showing an example of an image of a building 100. In the example of FIG. 1, The surface portion 110 of the object 00 (a wall in the example of FIG. 1) is photographed from an angled direction. In the information processing device 10 of this embodiment, the wall 110 is The area is calculated after performing trapezoidal correction. The surface portion 110 or the rectangular portion 120 included in the surface portion 110 (in the example of FIG. 1, the window frame) ) and converts the rectangle into one with right angles at each corner. Perform keystone correction.

[0012] <Information processing terminal 10> The information processing device 10 according to this embodiment is a small tablet-type computer. In another embodiment, the information processing device 10 is implemented by a smartphone or The system may be implemented by a portable computer such as a game console, or by a personal computer. The information processing device 10 may be realized by a desktop computer such as a personal computer. The configuration may be realized by a plurality of pieces of hardware, with the functions distributed among them.

[0013] FIG. 2 is a diagram illustrating an example of the hardware configuration of the information processing device 10. As illustrated in the figure, The processing device 10 includes a control unit 11 and a touch panel unit 12 which is a display unit.

[0014] The control unit 11 includes a processor 11a, a memory 11b, a storage 11c, and a transmission / reception unit 11d. and an input / output unit 11e as main components, which are electrically connected to each other via a bus 11f. is connected to.

[0015] The processor 11a controls the operation of the control unit 11 and controls the transmission and reception of data between the elements. It is a computing device that performs control and processes necessary for executing programs.

[0016] In this embodiment, the processor 11a is, for example, a CPU (Central Processor). The data is stored in the storage 11c (described later) and stored in the memory 11b. The program expanded in is executed and each process is performed.

[0017] The memory 11b is a DRAM (Dynamic Random Access Memory) The main memory consists of volatile memory devices such as flash memory and HDD (H It is equipped with an auxiliary storage device consisting of a nonvolatile storage device such as a hard disk drive. do.

[0018] This memory 11b is used as a work area for the processor 11a, and is also used as a memory for the control unit 11 BIOS (Basic Input / Output System) that runs at boot time ), and various setting information, etc. are stored.

[0019] The storage 11c stores programs and information used in various processes. For example, the flying object for capturing image information of the surface portion 110 is When operated by a user, the storage 11c stores a program for controlling the flight of the flying object. The program may be stored.

[0020] The transmitting / receiving unit 11d connects the control unit 11 to a network such as the Internet. There are Bluetooth (registered trademark) and BLE (Bluetooth Low Energy The device may be equipped with a short-range communication interface such as a Bluetooth® wireless technology (BLE).

[0021] The input / output unit 11e is an interface to which input / output devices are connected. The touch panel unit 12 is connected to the

[0022] The bus 11f is connected to the processor 11a, the memory 11b, the storage 11c, the transmission and reception For example, address signals, data signals, and various signals are transmitted between the input / output unit 11d and the input / output unit 11e. Transmits control signals.

[0023] The touch panel unit 12 is an example of a display unit, and is a display surface on which acquired videos and images are displayed. In this embodiment, the display surface 12a is configured to display a It accepts information input and uses various technologies such as resistive and capacitive touchscreens. So it is implemented.

[0024] For example, the user may input an image displayed on the display surface 12a via the touch panel unit 12. In addition, the control unit 11 displays information on the display surface 12a. The display information to be output is displayed.

[0025] FIG. 3 is a diagram illustrating an example of the software configuration of the information processing device 10. an image acquisition unit 111, an image correction unit 112, a line segment acquisition unit 113, and an attribute calculation unit 114; , an image storage unit 131, and a ratio storage unit 132.

[0026] The image storage unit 131 stores an image of the surface of the building 100 (hereinafter referred to as a captured image). ) to remember.

[0027] The ratio storage unit 132 stores the aspect ratio of the rectangular portion 120. If a rectangular portion 120 is included, the aspect ratio is associated with information specifying the rectangular portion 120. can be stored.

[0028] The image acquisition unit 111 acquires a captured image. The image acquisition unit 111 is, for example, a The image storage unit 1 acquires the photographed image taken by the camera of the aircraft from the aircraft. Alternatively, a captured image that has been registered in advance in the image storage unit 131 may be registered in the image storage unit 131. It may be arranged to read it out.

[0029] The image correction unit 112 generates a corrected image by correcting the image using keystone correction.

[0030] The line segment acquisition unit 113 acquires the multiple lines constituting the rectangular portion 120 of the building 100 on the corrected image. The line segment acquisition unit 113 acquires a number of line segments. The vertices of a rectangle representing the rectangular region 120 are specified on the image, and the line segments between the vertices are extracted. Furthermore, the line segment acquisition unit 113 can acquire the line segment from the captured image by, for example, image analysis. It is possible to detect a rectangle and automatically identify the rectangular portion 120, or to use the detected rectangle It is also possible to accept the designation of which of the above to be used as the rectangular portion 120.

[0031] The attribute calculation unit 114 calculates the attributes of the surface portion 110 based on the line segments acquired by the line segment acquisition unit 113. The attribute can be, for example, the area of ​​the surface portion 110. It may be the area of ​​a polygon that divides 110, or the area of ​​the polygon excluding parts such as window frames. The attribute may be, for example, the area of ​​a part of the building 100. It may also be the length of a part (ridge, eaves, etc.).

[0032] The line segment acquisition unit 113 acquires a rectangular structure, which is a line segment that divides the rectangular portion 120 on the captured image. The component line can be obtained.

[0033] The image correction unit 112 corrects a rectangle formed by the rectangle-forming line segments acquired by the line segment acquisition unit 113. The aspect ratio (of the rectangular portion 120) is stored in the ratio storage unit 132. It is possible to perform keystone correction on the captured image so that the resulting image is keystone-corrected.

[0034] The surface portion 110 may be a roof surface, and the attribute may be the slope of the roof surface. In this case, the image acquisition unit 111 acquires a roof surface image, which is a photographed image of the roof surface, and The vertex acquisition unit 113 acquires the vertices of the polygons that make up the roof surface on the roof surface image, and The calculation unit 114 can calculate the area of ​​the roof surface based on the vertices. 4 can also calculate the area of ​​the roof surface by correcting the area of ​​the roof surface according to the slope.

[0035] <Operation> FIG. 4 is a diagram illustrating the operation of the information processing device 10. As shown in FIG.

[0036] The information processing device 10 acquires a photographed image (S101), and defines a rectangular region 1 on the photographed image. The line segments that make up the rectangular region 20 (the sides of the rectangle that represents the rectangular region 120) are acquired (S102). 5 is a diagram showing how the designation of the rectangular area 120 is accepted. The processing device 10 displays a rectangle representing the rectangular area 120 on the captured image output to the touch panel unit 12. The information processing device 10 can accept the designation of the vertices 130 of the rectangular portion 12. The aspect ratio corresponding to 0 is obtained (S103), and the shape and length of the rectangle representing the rectangular portion 120 are calculated. The captured image is subjected to keystone correction in accordance with the horizontal and vertical ratio (S104). As shown in FIG. 6, the rectangular portion 120 is corrected to become a rectangle. There are.

[0037] The information processing device 10 calculates the line segments that make up the surface portion 110 on the captured image (the surface portion 110 The information processing device 10 acquires the sides of the polygon representing the polygon (S105). In this way, the vertices 140 of the polygon representing the surface portion 110 on the captured image after the keystone correction are specified. The information processing device 10 can receive the surface portion 110 based on the acquired line segments. Here, the information processing device 10 calculates the area of ​​the vertex 130. The area of ​​the rectangular region 120 defined by the formula (120) can be subtracted from the calculated area of ​​the surface portion 110. In addition to the rectangular portion 120, the information processing device 10 can also calculate the area of ​​the surface portion 110. It is also possible to accept the designation of an area to be excluded and subtract the area of ​​that area. 7 is a diagram illustrating the calculated area. As shown in FIG. 7, the information processing device 10 The area of ​​the shaded portion of the portion 110 excluding the rectangular portion 120 can be calculated.

[0038] When the surface portion 110 has a slope, such as when the surface portion 110 is a roof surface, The area of ​​the surface portion 110 can be corrected by taking into account the gradient of 0. 9 is a diagram illustrating a process flow when performing correction. FIG.

[0039] The information processing device 10 performs trapezoidal correction on the surface portion 110 and calculates the area by the process shown in FIG. When the surface portion 110 itself is rectangular, such as a roof surface, the surface portion 110 can be designated as a rectangular portion 120 and subjected to keystone correction as shown in FIG.

[0040] Next, the information processing device 10 photographs the side surface of the surface portion 110 from a direction in which the gradient of the surface portion 110 can be visually recognized. The second captured image is subjected to the processing shown in FIG. 8. Steps S101 to S105 are 4, but if there is a rectangular portion 120' such as a window on the side, a new rectangular portion The process of steps S101 to S105 in FIG. 8 can be performed by specifying the position 120'. In step S105, the information processing device 10 calculates the distance between the side surface of the surface portion 110 and the straight line portion. We can accept specifications for (eaves, etc.).

[0041] Next, the information processing device 10 supports the user in determining the gradient of the surface portion 110 from the image. A ruler 200 for assisting the user is displayed on the second captured image (S121). 10 is a diagram showing an example of an input screen. As shown in FIG. 10, the attribute calculation unit 114 calculates a predetermined value of the gradient. A ruler 200 showing the gradient in units ("0.5 sun" in the example of FIG. 10) can be displayed. The attribute calculation unit 114 allows the ruler 200 to be freely moved (translated, rotated, enlarged, The ruler 200 shown in FIG. 10 can be displayed in a simple manner using integers. A straight line 201 showing the gradient at each unit (1 inch, 2 inches, ...) is displayed. is a unit (0.5 sun, 1.5 sun, ...) that indicates the gradient between two adjacent lines 201. A dotted line 202 indicating the slope of the keystone correction is also displayed. (For example, in the example of FIG. 10, the slope of the ridge) and the straight line 201 and dotted line shown on the ruler 200 202, and the closest one (5 sun in the example of FIG. 10) is used as the gradient of the surface portion 110. It can be understood as follows.

[0042] The information processing device 10 receives input of the gradient of the surface portion 110 (S122). The attribute calculation unit 114 may be configured to accept input of the gradient from a keyboard, mouse, etc. Alternatively, the label 203 indicating the gradient on the ruler 200 may be selected (e.g., by pressing on the screen). may be accepted.

[0043] The information processing device 10 can correct the area of ​​the surface portion 110 according to the received gradient. Cut (S123).

[0044] As described above, according to the information processing device 10 of this embodiment, when the aspect ratio of a window frame or the like is given, The captured image can be corrected for trapezoidal distortion according to the shape of the rectangular portion 120 on the captured image. Therefore, the area of ​​the surface portion 110 shown on the captured image after the keystone correction can be calculated more accurately. It can be calculated.

[0045] The present embodiment has been described above, but the above embodiment is for the purpose of facilitating understanding of the present invention. The present invention is not intended to be interpreted as limiting the scope of the present invention. The present invention may be modified or improved without departing from the spirit or scope of the present invention, and the present invention also includes equivalents thereof.

[0046] For example, in the above embodiment, the information processing device 10 alone has been described. The information processing system may also include the device 10. The system may include an information processing device 10 and a server. In this case, for example, The processor 11a and the storage 11c of the information processing device 10 according to the above embodiment are effective. Some or all of the functions previously performed by the server are now realized by the processors and storage provided by the server. It can be made possible.

[0047] In the above embodiment, the surface portion 110 is a portion that constitutes the building 100. However, it may be a tree or any ground surface, or even a temporarily stopped vehicle. It may also be a surface portion of an object such as a human or an animal.

[0048] Furthermore, each step in the above embodiment is not necessarily described as a flowchart. For example, the processing in the above embodiment does not have to be performed in chronological order. The steps may be performed in a different order than that shown in the flowchart, but may be performed in parallel. may be processed as follows.

[0049] In this embodiment, the sides (line segments) of the polygon that represents the surface portion 110 after the keystone correction are specified. However, it is also possible to accept the designation before the keystone correction. 11 is a diagram showing an example in which the designation of the surface portion 110 is accepted before the keystone correction. On the captured image before keystone correction, the designation of the vertices 140 constituting the surface portion 110 is accepted. In this way, the coordinates of the vertex 140 on the photographed image are corrected by keystone correction, and the corrected coordinates are can be used to calculate the area of ​​the surface portion 110.

[0050] In this embodiment, the area of ​​the surface portion 110 is calculated. 12 shows an example of calculating the length of the straight portion 150. As shown in FIG. 12, the information processing device 10 detects a straight line portion 1 on the captured image. The vertex 160, which is the both ends of 50 (the ridge in the example in Figure 12), is accepted. The length between the vertices 160 can be calculated.

[0051] In this embodiment, the area and / or length on the captured image is calculated. For example, the length of a part in real space (for example, the length of the straight line portion 150 or the length of the surface portion 110) The specification of the length of one side of the rectangular portion 120, the length of one side of the rectangular portion 120, etc. is accepted, and the accepted real space The area and / in real space are calculated according to the ratio of the length in the image and the length on the captured image after keystone correction. You can also calculate the length.

[0052] In this embodiment, the slope of the surface portion 110 of the roof or the like is input after performing trapezoidal correction. However, for example, if the building 100 is photographed horizontally from the side, In some cases, the input of the gradient may be accepted without performing keystone correction. For example, the attribute calculation unit 114 may add a ruler 2 shown in FIG. 8 to a captured image that has not been subjected to trapezoid correction. 00 is displayed so that it can be moved freely on the captured image, and the user can input the gradient using the ruler 200 as a reference. In addition, the attribute can be adjusted according to the position of the ruler 200 and the input gradient. The characteristic calculation unit 114 can also accept the position specification of the vertices of the straight line portion. For example, in the example of FIG. 8, the position where the straight line 201 or the dotted line 202 forms an angle is The input can be received as the position of the vertex of a straight line portion (such as a ridge) of the surface portion 110 of the object 100. This can be done.

[0053] Furthermore, the effects described in this specification are merely illustrative or exemplary and are not limiting. In other words, the technology according to the present invention has the following advantages in addition to or instead of the above-mentioned advantages: In addition, other effects that will be apparent to those skilled in the art from the description of this specification may be achieved.

[0054] <Disclosures> The present disclosure also includes the following configurations. [Item 1] an image acquisition unit that acquires an image of a surface portion of a building; an image correction unit that generates a corrected image by correcting the image using keystone correction; a line segment acquisition unit that acquires a plurality of line segments that constitute the portion of the building on the corrected image; and, an attribute calculation unit that calculates attributes of the surface portion based on the line segment; An information processing system comprising: [Item 2] Item 1, an information processing system according to item 1, a ratio storage unit that stores the aspect ratio of the rectangular portion; The line segment acquisition unit acquires line segments that divide the rectangular portion of the building on the image. Obtain the line segments that make up the rectangle, The image correction unit corrects the image so that the rectangle formed by the rectangle-forming line segments has the aspect ratio. performing keystone correction on the image; An information processing system characterized by: [Item 3] Item 1 or 2, an information processing system according to The surface portion is a roof surface, the attribute is the slope of the roof surface; An information processing system characterized by: [Item 4] Item 3. The information processing system according to item 3, the image acquisition unit acquires a roof surface image, which is an image obtained by capturing the roof surface; The line segment acquisition unit acquires vertices of polygons that form the roof surface on the roof surface image. Benefit, The attribute calculation unit further calculates an area based on the vertices, and Calculating the area of ​​the roof surface by correcting it according to the slope; An information processing system characterized by: [Item 5] acquiring an image of a surface portion of a building; generating a corrected image by correcting the image using keystone correction; acquiring a plurality of line segments that constitute the portion of the building on the corrected image; , calculating attributes of the surface portion based on the line segments; An information processing method characterized by being executed by a computer. [Item 6] acquiring an image of a surface portion of a building; generating a corrected image by correcting the image using keystone correction; acquiring a plurality of line segments that constitute the portion of the building on the corrected image; , calculating attributes of the surface portion based on the line segments; A program that causes a computer to execute the following. [Explanation of symbols]

[0055] 10. Information processing equipment 100 buildings 110 surface area 120 Rectangular part

Claims

1. an image acquisition unit that acquires an image of a surface portion of a building; an image correction unit that generates a corrected image by correcting the image using keystone correction; a line segment acquisition unit that acquires a plurality of line segments that constitute the portion of the building on the corrected image; and, an attribute calculation unit that calculates attributes of the surface portion based on the line segment; An information processing system comprising:

2. 2. The information processing system according to claim 1, a ratio storage unit that stores the aspect ratio of the rectangular portion; The line segment acquisition unit acquires line segments that divide the rectangular portion of the building on the image. Obtain the line segments that make up the rectangle, The image correction unit corrects the image so that the rectangle formed by the rectangle-forming line segments has the aspect ratio. performing keystone correction on the image; An information processing system characterized by:

3. 3. The information processing system according to claim 1, The surface portion is a roof surface, the attribute is the slope of the roof surface; An information processing system characterized by:

4. 4. The information processing system according to claim 3, the image acquisition unit acquires a roof surface image, which is an image obtained by capturing the roof surface; The line segment acquisition unit acquires vertices of polygons that form the roof surface on the roof surface image. Benefit, The attribute calculation unit further calculates an area based on the vertices, and Calculating the area of ​​the roof surface by correcting it according to the slope; An information processing system characterized by:

5. acquiring an image of a surface portion of a building; generating a corrected image by correcting the image using keystone correction; acquiring a plurality of line segments that constitute the portion of the building on the corrected image; 、 calculating attributes of the surface portion based on the line segments; An information processing method characterized by being executed by a computer.

6. acquiring an image of a surface portion of a building; generating a corrected image by correcting the image using keystone correction; acquiring a plurality of line segments that constitute the portion of the building on the corrected image; 、 calculating attributes of the surface portion based on the line segments; A program that causes a computer to execute the following.

Images