Area arithmetic processing device and area arithmetic processing method for side wall surface of building

Abstract

To provide an area arithmetic processing device for a side wall surface of a building that can easily compute the area of the side wall surface of the building.SOLUTION: An arithmetic unit 10 of an area arithmetic processing device 1 comprises: a virtual plane specification part 11 which photographs a part of a side wall surface F of a building B by an imaging device 23 to specify a virtual plane VG along the side wall surface F in the real space where the building B is present; a virtual plane setting part 12 which sets a virtual plane VG to be superposed on an image of the real space including the at least the part of the side wall surface F imaged by the imaging device 23; a corner point setting part 13 which sets corner points PG1 to PG4 at positions corresponding to all corner points P1 to P4 of the side wall surface F on the virtual plane VG set in images G (G1 to G4); and an area calculation part 14 which calculates the area of a region S encircled by connecting the set corner points PG1 to PG4 with straight lines LA to LD as the area of the side wall surface F of the building B.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an area calculation processing device and an area calculation processing method for the side wall surface of a building.

Background Art

[0002] Conventionally, when repairing a building, the outer wall thereof has been repaired (see, for example, Patent Document 1). At this time, the area of the side wall surface of the building, which is the outer wall of the building, may be calculated from drawings such as design drawings, and the construction cost for repair may be calculated.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, at the repair stage, if there are no design drawings of the building, etc., it is necessary to measure the dimensions of the building and then calculate the area of the side wall surface, and it is not easy to measure the dimensions of the building.

[0005] The present invention has been made in view of such points, and an object thereof is to provide an area calculation processing device and an area calculation processing method for the side wall surface of a building that can easily calculate the area of the side wall surface of the building.

Means for Solving the Problems

[0006] In view of the above problems, an area calculation processing device for a side wall surface of a building according to the present invention includes an imaging device that images the side wall surface of the building, and an arithmetic device that calculates the area of the side wall surface from at least a part of the wall surface image of the imaged side wall surface. The area calculation processing device for the side wall surface of the building is characterized in that the arithmetic device includes a virtual plane specifying unit that specifies a virtual plane along the side wall surface in the real space where the building exists by photographing a part of the side wall surface with the imaging device, a virtual plane setting unit that sets the virtual plane so as to be superimposed and displayed on a video of the real space including at least a part of the side wall surface imaged by the imaging device, a corner point setting unit that sets corner points at positions corresponding to all corner portions of the side wall surface on the virtual plane set on the video, and an area calculation unit that calculates the area of the region surrounded by connecting the set corner points with straight lines as the area of the side wall surface.

[0007] According to the present invention, the virtual plane specifying unit can specify a virtual plane along the side wall surface in the real space where the building exists by photographing a part of the side wall surface with the imaging device. Thereby, the virtual plane setting unit can set the virtual plane so as to be superimposed and displayed on a video of the real space including at least a part of the side wall surface imaged by the imaging device. Here, the corner point setting unit can specify the coordinates of each corner point on the virtual plane by setting corner points at positions corresponding to all corner portions of the side wall surface of the building on the virtual plane set on the video of the imaging device. Thereby, since the area calculation unit calculates the area of the region surrounded by connecting the set corner points with straight lines as the area of the side wall surface, the area of the side wall surface of the building can be easily calculated without imaging the entire side surface of the building with the imaging device.

[0008] More preferably, the virtual plane specifying unit specifies the virtual plane in the real space where the building exists by measuring the distances between a plurality of points of a part of the side wall surface and the imaging device.

[0009] According to this aspect, the virtual plane specifying unit can specify a virtual plane in the real space where the building exists by measuring the distances between a plurality of points on a part of the side wall surface of the building and the imaging device. Therefore, the virtual plane along the side wall surface of the building can be accurately specified.

[0010] As a more preferable aspect, the virtual plane specifying unit specifies the virtual plane by reading an AR marker attached to a part of the side wall surface with the imaging device.

[0011] According to this aspect, by reading the AR marker, the virtual plane along the side wall surface to which the AR marker is attached can be easily specified.

[0012] As a more preferable aspect, the corner point setting unit sets the corner points by touching the screen of a touch panel type display device with respect to the video projected on the screen. Among the corner points to be set, the corner point setting unit sets an auxiliary line along the vertical direction from the lower corner point at the lower part of the building, and restricts the arrangement of the upper corner point at the upper part of the building among the corner points to be set so that they are arranged at positions on the auxiliary line along the vertical direction from the lower corner point.

[0013] According to this aspect, the corner point setting unit sets an auxiliary line on the virtual plane and restricts the arrangement of the upper corner point at the upper part of the building among the corner points to be set so that they are arranged at positions on the auxiliary line along the vertical direction from the lower corner point. Therefore, the upper corner point can be set at a more accurate position.

[0014] The method for calculating the area of the side wall surface of a building according to the present invention is an area calculation processing method for calculating the area of the side wall surface based on at least a part of the wall surface image of the side wall surface of the building captured by an imaging device. The method includes: a virtual plane specifying step of specifying a virtual plane along the side wall surface in the real space where the building exists by photographing a part of the side wall surface with the imaging device; a virtual plane setting step of setting the virtual plane so as to be superimposed and displayed on a video of the real space including at least a part of the side wall surface imaged by the imaging device; a corner point setting step of setting corner points at positions corresponding to all corner portions of the side wall surface on the virtual plane set on the video; and an area calculation step of calculating the area of the region surrounded by connecting the set corner points with straight lines as the area of the side wall surface.

[0015] According to the present invention, in the virtual plane specifying step, by photographing a part of the side wall surface with the imaging device, a virtual plane along the side wall surface can be specified in the real space where the building exists. Thereby, in the virtual plane setting step, the virtual plane can be set so as to be superimposed and displayed on a video of the real space including at least a part of the side wall surface imaged by the imaging device. Here, in the corner point setting step, by setting corner points at positions corresponding to all corner portions of the side wall surface of the building on the virtual plane set on the video of the imaging device, the coordinates of each corner point on the virtual plane can be specified. Thereby, in the area calculation step, since the area of the region surrounded by connecting the set corner points with straight lines is calculated as the area of the side wall surface, the area of the side wall surface of the building can be easily calculated without imaging the entire side surface of the building with the imaging device.

Effects of the Invention

[0016] According to the present invention, the area of the side wall surface of a building can be easily calculated.

Brief Description of the Drawings

[0017]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0018] Hereinafter, with reference to FIGS. 1 to 8, the area calculation processing device 1 and the area calculation processing method for the side wall surface of a building will be described.

[0019] 1. Regarding the area calculation processing device 1 As shown in FIG. 1, the area calculation processing device 1 according to the present embodiment is a device that calculates the area of the side wall surface F of the building B. In the present embodiment, an AR marker M is attached to the side wall surface F of the building B. Note that in the present embodiment, accessories such as windows and doors may be provided on the side wall surface F of the building B.

[0020] As shown in FIG. 2, the area calculation processing device 1 is a mobile terminal including an imaging device 23 that acquires moving images (videos) and still images (images), a touch panel type display device (display) 21 having an input unit 21A and an output unit 21B, and a calculation device 10 including a storage unit 10A and a calculation unit 10B. The mobile terminal is a smartphone, a tablet, or the like. In the present embodiment, a touch panel type display device (display) 21 having an input unit 21A and an output unit 21B is exemplified, but these may be configured as individual input and output devices. Further, although the imaging device 23 is built in the area calculation processing device 1 as a mobile terminal, the imaging device may be connected to the calculation device 10 in a communicable state as an individual device. The imaging device 23 images the side wall surface F of the building B, and the video or the like imaged by the imaging device 23 is displayed on the output unit 21B which is the screen of the display device 21.

[0021] 2. Regarding the calculation device 10 The calculation device 10 includes, as hardware, a storage unit 10A in which a program for calculating the area of the side wall surface F of the building B and the like are recorded, and a calculation unit 10B that executes the program, and is configured by a ROM, a RAM, etc. As shown in FIG. 3, the calculation device 10 includes, as software, a virtual plane specifying unit 11, a virtual plane setting unit 12, a corner point setting unit 13, and an area calculation unit 14.

[0022] 2-1. Regarding the virtual plane specifying unit 11 The virtual plane specifying unit 11 specifies a virtual plane VG along the side wall surface F of the building B in the real space R where the building B exists by photographing a part of the side wall surface F of the building B with the imaging device 23 of the area calculation processing device (mobile terminal) 1 by a command signal from the input unit 21A by the photographer (see FIG. 4). For example, in the present embodiment, the virtual plane specifying unit 11 specifies the virtual plane VG by reading an AR marker M attached to a part of the side wall surface F with the imaging device 23.

[0023] AR (augmented reality) refers to adding some information to the real space. In this embodiment, the AR marker M has information on the virtual plane VG along the surface of the AR marker M. Therefore, by attaching the AR marker M to the side wall surface F of the building B existing in the real space, the virtual plane VG along the side wall surface F of the building B can be specified.

[0024] Here, AR is classified into a location-based type and a vision-based type according to the calculation method of the position for superimposing additional information. In this embodiment, the vision-based type is adopted, and technologies such as image recognition and space recognition are applied to recognize and analyze the environment right in front of the eyes to perform information presentation. In this embodiment, as the vision-based type, a marker type is adopted in which the information of the virtual plane VG is presented on the side wall surface F of the building B by recognizing a virtual plane VG (plane figure) with a determined shape by the AR marker M, but a markerless type may also be adopted.

[0025] Generally, the markerless type is to recognize and identify an object or space itself existing in the real environment instead of a figure with a determined shape, and based on this, specify the presentation position as the real space and make the information appear. In this case, the virtual plane specifying unit 11 specifies the virtual plane VG in the real space R where the building B exists by measuring the distances between a plurality of points on a part of the side wall surface F of the building B and the imaging device 23.

[0026] In the case of the markerless type, for example, laser light may be irradiated from the imaging device 23 to a part of the side wall surface F of the building B, and the distances between a plurality (at least three or more) of points on a part of the side wall surface F of the building B and the imaging device 23 may be measured. In this way, by measuring the distances of three or more points, a plane along the side wall surface F of the building B can be calculated, and the virtual plane VG can be specified.

[0027] Here, if it is possible to measure the distances between a plurality (at least three or more) of points on a part of the side wall surface F of the building B and the imaging device 23, the method is not limited. For example, as a generally known technique, a LiDAR sensor is used to measure the time until the laser light emitted from the LiDAR sensor hits the side wall surface F of the building B and bounces back, and the shape of the side wall surface F in the real space (three-dimensional space) is acquired as point cloud data. Specifically, among SLAM (Simultaneous Localization and Mapping), a technique called "LiDAR-SLAM" is utilized to scan the side wall surface F with the LiDAR sensor and perform position estimation of the imaging device 23 and mapping of the side wall surface F. In SLAM, position estimation of the imaging device 23 and mapping of the side wall surface F may be performed by using an image and, optionally, an acceleration sensor mounted on the mobile terminal in combination.

[0028] In addition to this, with V-SLAM (Visual SLAM), a plurality of feature points of the image (wall surface image) FG of the side wall surface F are acquired from images of a plurality of different side wall surfaces F captured. The feature points are calculated, for example, by triangulation and record the positional relationship between the imaging device 23 and the side wall surface F. By repeating this continuously, self-position estimation of the imaging device 23 and mapping of the side wall surface F (surrounding environment mapping) can be performed. From the point cloud data thus obtained, a virtual plane VG along the side wall surface F can be specified.

[0029] 2-2. Regarding the virtual plane setting unit 12 The virtual plane setting unit 12 sets the virtual plane VG so as to be superimposed on the video G of the real space R including at least a part of the side wall surface F of the building B imaged by the imaging device 23. Specifically, as shown in FIG. 4, the set virtual plane VG is superimposed on the video G of the real space R in a state where the image FG of the side wall surface F among the images BG of the building B is projected.

[0030] For example, the virtual plane setting unit 12 sets the virtual plane VG from the obtained information by performing ambient environment mapping (creation of an environmental map) and self-position estimation of the imaging device 23, which are performed by the virtual plane specifying unit 11. Since these technologies are general AR technologies, detailed descriptions thereof are omitted.

[0031] 2-3. Regarding the corner point setting unit 13 The corner point setting unit 13 sets corner points PG1 to PG4 at positions corresponding to all the corner portions P1 to P4 of the side wall surface F of the building B on the virtual plane VG set in the video G. In the present embodiment, since the side wall surface F is rectangular, there are four corner portions P1 to P4. The operator changes the optical axis direction of the imaging device 23 and the position of the imaging device 23, and acquires partial images of the side wall surface F including these corner portions P1 to P4 for each of the four corner portions P1 to P4.

[0032] Specifically, as shown in FIGS. 5(a) and 5(b), from the videos G1 and G2 including the lower corner portions P1 and P2 of the lower part of the building B among these corner portions P1 to P4, for example, by using an AI model that has learned the detection of the corner portions of the side wall portion of the building, images of the lower corner portions P1 and P2 are detected and set as the lower corner points PG1 and PG2 on the virtual plane VG. Similarly, as shown in FIGS. 5(c) and 5(d), from the videos G3 and G4 including the upper corner portions P3 and P4 of the upper part of the building B among these corner portions P1 to P4, for example, by using the above-described AI model that has learned the detection of the corner portions, images of the upper corner portions P3 and P4 are detected and set as the upper corner points PG3 and PG4 on the virtual plane VG.

[0033] In addition, the corner point setting unit 13 may set the corner points PG1 to PG4 when the operator touches the screen of the display device 21 with respect to the videos G1 to G4 projected on the screen of the touch panel type display device 21. In this case, the operator clicks on the image portions of the corners in the image FG of the side wall surface F projected on the display device 21 to set the corner points PG1 to PG4.

[0034] In such a case, as shown in FIG. 6, the corner point setting unit 13 sets a vertical auxiliary line L1 along the vertical direction V from the lower corner point PG1 at the lower part of the building B among the corner points PG1 to PG4 to be set, and restricts the arrangement of the upper corner point PG3 at the upper part of the building B among the corner points to be arranged at a position on the vertical auxiliary line L1 along the vertical direction V from the lower corner point PG1.

[0035] Specifically, the area calculation device 1 is equipped with a sensor (inertial measurement unit: IMU) for detecting the gravity direction, and the vertical auxiliary line L1 may be set using this sensor. When arranging the upper corner point PG3, the arrangement of the upper corner point PG3 is restricted so that the upper corner point PG3 within a range of a predetermined distance d from the vertical auxiliary line L1 is arranged on the vertical auxiliary line L1.

[0036] Thereby, when arranging the upper corner point PG3, it is possible to prevent the deviation of the touch of the operator's finger on the screen, and the operator's finger can be slid while touching the screen of the display device 21, and the upper corner point PG3 can be set at an accurate position on the vertical auxiliary line L1. In particular, when imaging the upper corner P3, the posture of the imaging device 23 is changed so that the optical axis of the imaging device 23 faces upward, and the deviation of the touch of the operator's finger on the screen is likely to occur. By performing such an arrangement restriction, the deviation of the touch of the operator's finger on the screen can be prevented. The setting of the lower corner point PG2 and the upper corner point PG4 may also be performed in the same manner. When setting the lower corner point PG2, an auxiliary line L2 orthogonal to the vertical auxiliary line L1 may be set from the lower corner point PG1, and the lower corner point PG2 may be set by performing the same arrangement restriction.

[0037] 2-4. Regarding the area calculation unit 14 As shown in FIG. 7, the area calculation unit 14 calculates the area of the region S surrounded by connecting the set corner points PG1 to PG4 with straight lines LA to LD as the area of the side wall surface F of the building B. Specifically, as described above, the corner point setting unit 13 sets the corner points PG1 to PG4 at positions corresponding to all the corner portions P1 to P4 of the side wall surface F of the building B on the virtual plane VG set on the images G1 to G4 of the imaging device 23, whereby the coordinates of each of the corner points PG1 to PG4 on the virtual plane VG can be specified. Thereby, the area calculation unit 14 can easily calculate the area of the region S surrounded by connecting the set corner points PG1 to PG4 with straight lines LA to LD as the area of the side wall surface F. The area may be calculated by a generally known geometric area calculation method, or the area may be calculated from the number of pixels included in the region S.

[0038] In this way, according to the present embodiment, if a part of the side wall surface F of the building B is photographed, the area of the side wall surface F of the building B can be easily calculated without imaging the entire side wall surface F with an imaging device.

[0039] 3. Regarding the area calculation processing method Hereinafter, with reference to FIG. 8, a method for area calculation processing using the area calculation processing device 1 will be described. First, in the virtual plane identification step S1, the virtual plane identification unit 11 identifies the virtual plane VG along the side wall surface F of the building B in the real space R where the building B exists by photographing a part of the side wall surface F with the imaging device 23.

[0040] Next, in the virtual plane setting step S2, as shown in FIG. 4, the virtual plane setting unit 12 sets the virtual plane VG so as to be superimposed on the image G of the real space R including at least a part of the side wall surface F of the building B imaged by the imaging device 23.

[0041] Next, in the corner point setting step S3, as shown in FIGS. 5 and 6, the corner point setting unit 13 sets corner points PG1 to PG4 at positions corresponding to all the corner portions P1 to P4 of the side wall surface F on the virtual plane VG set in the images G1 to G4. Finally, in the area calculation step S4, the area calculation unit 14 calculates the area of the region S surrounded by connecting the set corner points PG1 to PG4 with straight lines LA to LD as the area of the side wall surface F of the building B.

[0042] As described above, according to the present embodiment, the measurement work is greatly labor-saving, and the measured values can be recorded as digital data. Further, since it can be measured only with a mobile terminal, the area of the side wall surface F of the building B can be easily calculated.

[0043] As described above, the embodiments of the present invention have been described in detail. However, the present invention is not limited to the above-described embodiments, and various design changes can be made without departing from the spirit of the present invention described in the claims.

Explanation of Reference Numerals

[0044] 1: Area calculation processing device, 10: Calculation device, 11: Virtual plane specifying unit, 12: Virtual plane setting unit, 13: Corner point setting unit, 14: Area calculation unit, 23: Imaging device, B: Building, F: Side wall surface, G, G1 to G4: Images, P1 to P4: Corner portions, PG1 to PG4: Corner points, S: Region, VG: Virtual plane

Claims

1. An imaging device for imaging a side wall surface of a building, and an arithmetic unit for calculating the area of the side wall surface from at least a part of the wall surface image of the imaged side wall surface, A side wall surface area calculation processing device for a building, comprising: The arithmetic unit includes: a virtual plane specifying unit that specifies a virtual plane along the side wall surface in the real space where the building exists by photographing a part of the side wall surface with the imaging device; a virtual plane setting unit that sets the virtual plane so as to be superimposed on an image of a real space including at least a part of the side wall surface imaged by the imaging device; a corner point setting unit that sets corner points at positions corresponding to all corner portions of the side wall surface on the virtual plane set on the image; An area calculation unit that calculates the area of a region surrounded by connecting the set corner points with straight lines as the area of the side wall surface. The side wall surface area calculation processing device for a building is characterized by comprising the above.

2. The virtual plane specifying unit measures distances between a plurality of points of a part of the side wall surface and the imaging device, and specifies the virtual plane in the real space where the building exists. The side wall surface area calculation processing device for a building according to Claim 1.

3. The virtual plane specifying unit reads an AR marker attached to a part of the side wall surface with the imaging device, and specifies the virtual plane. The side wall surface area calculation processing device for a building according to Claim 1.

4. The corner point setting unit sets the corner points by touching the screen of a display device using a touch panel method with respect to the image projected on the screen. Among the corner points to be set, the corner point setting unit sets auxiliary lines on the virtual plane from the lower corner points at the lower part of the building, and arranges the upper corner points at the upper part of the building among the corner points to be set so as to be located on the auxiliary lines along the vertical direction from the lower corner points. The side wall surface area calculation processing device for a building according to Claim 1 is characterized by restricting the arrangement.

5. An area calculation processing method for calculating the area of a side wall surface of a building based on at least a part of the wall surface image of the side wall surface imaged, comprising: a virtual plane specifying step of specifying a virtual plane along the side wall surface in the real space where the building exists by photographing a part of the side wall surface with an imaging device; A virtual plane setting step of setting the virtual plane so as to be superimposed on an image of a real space including at least a part of the side wall surface imaged by the imaging device; A corner point setting step of setting corner points at positions corresponding to all corner portions of the side wall surface on the virtual plane set on the image; An area calculation step of calculating the area of a region surrounded by connecting the set corner points with straight lines as the area of the side wall surface, wherein the method for calculating the area of a side wall surface of a building is characterized by including the steps.

Images