Information processing device
The information processing device uses three-dimensional imaging to automatically detect and display floating tiles and ceramic shards by analyzing temperature and reflection intensity, improving detection efficiency and reducing manual labor.
Patent Information
- Application Number
- JP2021022828
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-02-16
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2041-02-16
AI Technical Summary
Existing technologies require manual effort and human labor to detect floating tiles in building exteriors, and existing imaging techniques fail to automatically distinguish and display tiles with lifted or ceramic shard issues.
An information processing device that uses three-dimensional imaging to obtain temperature, reflection intensity, and color information to automatically detect and distinguish between floating tiles and ceramic shards, displaying the results as drawings.
Facilitates easy and automated detection and display of floating tiles and their types, reducing manual effort and enhancing accuracy in identifying tile conditions.
Smart Images

Figure 0007594933000001 
Figure 0007594933000002 
Figure 0007594933000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device. [Background technology]
[0002] Conventionally, the following technologies have been used to utilize point cloud data obtained by 3D photography using a three-dimensional scanner (hereinafter also referred to as "3D scanner").
[0003] Patent Document 1 discloses a concrete structure management device that aims to make it easier for managers to understand the inspection results of concrete structures. This concrete structure management device includes a display processing unit that displays a two-dimensional or three-dimensional image showing the concrete structure on a screen. This concrete structure management device also includes an acquisition unit that acquires at least a first measurement result at a first timing and a second measurement result at a second timing of the concrete structure. In this concrete structure management device, the display processing unit generates display data using at least the first measurement result and the second measurement result and displays the display data on the screen.
[0004] Patent Document 2 discloses a display data generating device for generating display data capable of accurately displaying the state of internal deformation of equipment. This display data generating device includes an equipment data generating unit for generating three-dimensional point cloud data of the surface of equipment, a thermal image data acquiring unit for acquiring thermal image data of the equipment, and a three-dimensional point cloud converting unit for generating three-dimensional point cloud data of a thermal image based on the thermal image data. This display data generating device also includes a deformation data generating unit for generating three-dimensional point cloud data of the internal deformation of the equipment based on the thermal image data. Furthermore, this display data generating device includes a display data generating unit for generating display data for displaying an image in which the three-dimensional point cloud of the internal deformation and the three-dimensional point cloud of the thermal image are superimposed on the three-dimensional point cloud of the surface based on the three-dimensional point cloud data of the surface, the three-dimensional point cloud data of the internal deformation, and the three-dimensional point cloud data of the thermal image on a display device.
[0005] Incidentally, in order to detect tiles that have loosened due to loose base or loose ceramic fragments from among tiles used on the exterior walls of buildings, tapping inspections were previously conducted by humans. However, this method requires manual labor, and it takes a lot of time to inspect loose tiles installed in areas that are difficult for humans to reach, so there has been a demand for technology that can automatically detect loose tiles without tapping inspections.
[0006] In the past, there was a technique for automatically detecting loose tiles that used an infrared thermography device. With this technique, loose tiles were judged based on differences in color indicated by color information in a thermal image obtained by infrared rays, as shown in Figure 13 as an example. For convenience, in Figure 13, each color in the color information is represented by a grayscale in which the gradation value of the color is the density. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] JP 2020-154467 A [Patent Document 2] Patent No. 6506886 Summary of the Invention [Problem to be solved by the invention]
[0008] Incidentally, there is a demand to display tiles for which looseness has been detected by the above-mentioned tapping survey or infrared thermography device, etc., on various drawings, such as drawings of the wall surface on which the tiles are installed created by a CAD (Computer Aided Design) system, or drawings including images of the wall surface taken by a digital camera.
[0009] However, in the past, complex manual work was required to synthesize and display tiles in which floating was detected in various drawings as described above.
[0010] In contrast, the technologies described in Patent Documents 1 and 2 above are technologies related to displaying images represented by three-dimensional point cloud data, but neither technology takes into consideration the detection of floating tiles. For this reason, these technologies cannot display tiles where floating has been detected as drawings without requiring complex operations.
[0011] The present disclosure has been made in consideration of the above circumstances, and aims to provide an information processing device that can more easily display the state of loose tiles as a drawing. [Means for solving the problem]
[0012] The information processing device according to the present invention as recited in claim 1 includes an acquisition unit that acquires point cloud data including temperature information at each point and at least one of reflection intensity information and color information by 3D imaging of a tile area where tiles are affixed, a discrimination unit that uses at least one of the reflection intensity information and the color information included in the point cloud data acquired by the acquisition unit to distinguish tiles and joints in the tile area and uses the temperature information included in the point cloud data to distinguish whether the tiles are floating, and a control unit that performs control to display tiles that have been determined to be floating by the discrimination unit as a drawing, distinguishing them from other tiles. The discrimination unit further discriminates whether the state of the floating is a base floating or a ceramic fragment floating for the tile determined to be floating by the discrimination unit using the temperature information, and the control unit further performs control to display the tile determined to be floating by the discrimination unit as the drawing, distinguishing between a base floating and a ceramic fragment floating. .
[0013] According to the information processing device of the present invention as described in claim 1, by performing 3D photography of the tile area, which is the area where tiles are attached, point cloud data including temperature information at each point and at least one of reflection intensity information and color information is obtained, and at least one of the reflection intensity information and color information contained in the obtained point cloud data is used to identify the tiles and joints in the tile area, and the temperature information contained in the point cloud data is used to determine the floating status of the tiles. Tiles determined to be floating are distinguished from other tiles and controlled to be displayed as a drawing, by using information indicating the three-dimensional position of each point, it is possible to more easily display the floating status of the tiles as a drawing.
[0015] Claim 1 According to the information processing device of the present invention described above, temperature information is used to further determine whether a tile determined to be floating is in the form of loose base or loose ceramic fragments, and control is further performed to display, as a drawing, a drawing that distinguishes between loose base and loose ceramic fragments for tiles determined to be floating, thereby making it possible to display the type of loose tile as a drawing.
[0016] Claim 2 The information processing device according to the present invention is 1 to The information processing device described in the present invention further includes a calculation unit that calculates the number of tiles that have been determined to be floating by the discrimination unit, and the control unit further controls the display of result information indicating the calculation result by the calculation unit as the drawing.
[0017] Claim 2 According to the information processing device of the present invention described above, the number of tiles determined to be floating is calculated, and further control is performed to display result information showing the calculation result as a drawing, thereby making it possible to grasp the number of tiles that are floating.
[0018] Claim 3 The information processing device according to the present invention is 2wherein the calculation section further calculates a ratio of the number of tiles determined to be floating by the determination section to the total number of tiles in the tile region.
[0019] Claim 3 According to the information processing device of the present invention described above, the ratio of the number of tiles determined to be floating to the total number of tiles in the tile area can be further calculated and displayed, making it possible to grasp the ratio. Effect of the Invention
[0020] As described above, according to the present invention, the state of loose tiles can be more easily displayed as a diagram. [Brief description of the drawings]
[0021] [Figure 1] 1 is a block diagram showing an example of a hardware configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 1 is a perspective view showing an example of the configuration of a 3D scanner according to an embodiment. [Diagram 3] FIG. 2 is a block diagram showing an example of a functional configuration of the information processing device according to the embodiment. [Figure 4] FIG. 4 is a schematic diagram illustrating an example of a configuration of a scan information database according to the embodiment. [Diagram 5] FIG. 4 is a schematic diagram showing an example of a configuration of a temperature information database according to the embodiment. [Figure 6] FIG. 2 is a schematic diagram illustrating an example of a configuration of a tile information database according to the embodiment. [Figure 7] FIG. 2 is a schematic diagram illustrating an example of a configuration of a summary information database according to the embodiment. [Figure 8] 10 is a flowchart illustrating an example of information processing according to the embodiment. [Figure 9] 11 is a front view illustrating an example of a method for determining the type of loose tile in information processing according to an embodiment. FIG. [Figure 10]FIG. 2 is a front view showing an example of a CAD drawing display screen according to the embodiment. [Figure 11] FIG. 13 is a front view showing an example of a summary table drawing display screen according to the embodiment. [Figure 12] FIG. 13 is a front view showing an example of a report drawing display screen according to the embodiment. [Figure 13] FIG. 1 is a perspective view for explaining a method for detecting loose tiles using an infrared thermography device in accordance with the prior art. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0022] Hereinafter, with reference to the drawings, an embodiment for carrying out the present invention will be described in detail. In this embodiment, the present invention will be described as being applied to an information processing system for detecting loose tiles installed on the exterior wall of a building, but the present invention is not limited thereto. For example, the present invention may be applied to an information processing system for detecting loose tiles installed on the interior wall of a building or on a fence surrounding a building. In addition, in this embodiment, the present invention will be described as being applied to a tile having a rectangular shape when viewed from the front, but the present invention is not limited thereto. For example, the present invention may be applied to tiles having other shapes, such as a circular shape when viewed from the front or an elliptical shape, as the tile.
[0023] First, the configuration of an information processing system 90 according to the present embodiment will be described with reference to Figs. 1 to 3. Fig. 1 is a block diagram showing an example of a hardware configuration of the information processing system 90 according to the present embodiment. Fig. 2 is a perspective view showing an example of a configuration of a 3D scanner 50 according to the present embodiment. Fig. 3 is a block diagram showing an example of a functional configuration of an information processing device 10 according to the present embodiment.
[0024] 1, an information processing system 90 according to the present embodiment includes an information processing device 10 and a 3D scanner 50. Examples of the information processing device 10 include general-purpose or dedicated information processing devices such as personal computers and server computers.
[0025] The information processing device 10 according to this embodiment includes a CPU (Central Processing Unit) 11, a memory 12 as a temporary storage area, a non-volatile storage unit 13, an input unit 14 such as a keyboard and a mouse, a display unit 15 such as a liquid crystal display, a medium reading and writing device (R / W) 16, and a communication interface (I / F) unit 18. The CPU 11, the memory 12, the storage unit 13, the input unit 14, the display unit 15, the medium reading and writing device 16, and the communication interface (I / F) unit 18 are connected to each other via a bus B. The medium reading and writing device 16 reads information written in a recording medium 17 and writes information to the recording medium 17.
[0026] The storage unit 13 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like. An information processing program 13A is stored in the storage unit 13 as a storage medium. The information processing program 13A is stored in the storage unit 13 by setting a recording medium 17, on which the information processing program 13A is written, in the medium reading and writing device 16, and the medium reading and writing device 16 reading the information processing program 13A from the recording medium 17. The CPU 11 reads the information processing program 13A from the storage unit 13, expands it in the memory 12, and sequentially executes the processes of the information processing program 13A.
[0027] Further, a scan information database 13B, a temperature information database 13C, a tile information database 13D, and an aggregate information database 13E are stored in the storage unit 13. The scan information database 13B, the temperature information database 13C, the tile information database 13D, and the aggregate information database 13E will be described in detail later.
[0028] 1, the 3D scanner 50 according to this embodiment includes a scanner body 52, an infrared camera 56, and a storage unit 58. Although not shown, the 3D scanner 50 according to this embodiment also includes a motor for changing the shooting direction of the scanner body 52 when performing 3D shooting with the scanner body 52, a control unit for controlling the operation of each part of the motor, the scanner body 52, etc.
[0029] 2, the 3D scanner 50 according to this embodiment has a scanner body 52 provided on the top of a tripod leg 60, and the scanner body 52 is capable of changing the shooting direction by driving the above-mentioned motor at the top of the leg 60. It goes without saying that the leg 60 is not limited to a tripod.
[0030] The 3D scanner 50 according to the present embodiment is a so-called time-of-flight type in which a laser is emitted from the scanner body 52, a distance is calculated from the time it takes for the laser to be reflected by the object and returned, and a laser emission angle is calculated from the moving direction of the scanner body 52, and a three-dimensional position is specified using these calculated values. However, the method of specifying a three-dimensional position by the 3D scanner 50 is not limited to this. For example, a so-called phase-shift type in which a laser modulated in a plurality of ways is emitted from the scanner body 52, a distance to the object is calculated based on the phase difference of the diffuse reflection component that hits the object and returns, and a three-dimensional position is specified based on the distance and the laser emission angle may be applied as the 3D scanner 50.
[0031] Furthermore, the 3D scanner 50 according to this embodiment is configured to perform infrared photography by the infrared camera 56 in parallel with 3D photography by the scanner body 52. The 3D scanner 50 according to this embodiment is configured to store in the storage unit 58, in addition to the point cloud data obtained by 3D photography by the scanner body 52, temperature information indicating the temperature for each point of the point cloud data.
[0032] Furthermore, in the 3D scanner 50 according to the present embodiment, in addition to coordinate information indicating the coordinates of the three-dimensional position of each point, reflection intensity information indicating the reflection intensity of the laser of the corresponding point and color information indicating the color of the corresponding point are acquired as the point cloud data. Then, in the 3D scanner 50 according to the present embodiment, the acquired coordinate information, reflection intensity information, and color information are stored in association with each point in the point cloud data.
[0033] In the information processing system 90 according to the present embodiment, the various information stored in the storage unit 58 of the 3D scanner 50 is transmitted to the information processing device 10 by wired communication, but the present invention is not limited thereto. For example, the various information stored in the storage unit 58 of the 3D scanner 50 may be transmitted to the information processing device 10 by wireless communication. In addition, the storage unit 58 may be a portable storage medium that is detachable from the 3D scanner 50, and the various information stored in the storage unit 58 of the 3D scanner 50 may be transferred to the information processing device 10 via the storage medium.
[0034] As described above, in this embodiment, a 3D scanner having an infrared camera 56 as a separate configuration from the scanner body 52 is applied as the 3D scanner 50, but the present invention is not limited to this. For example, the wavelength band of the laser emitted from the scanner body 52 may include the infrared band, and a 3D scanner that acquires the temperature of a target point using the laser may be applied as the 3D scanner 50. In this case, the infrared camera 56 is not necessary, so that the 3D scanner 50 can be made smaller and less expensive.
[0035] Next, a functional configuration of the information processing device 10 according to this embodiment will be described with reference to Fig. 3. As shown in Fig. 3, the information processing device 10 according to this embodiment includes an acquisition unit 11A, a discrimination unit 11B, a control unit 11C, and a calculation unit 11D. The CPU 11 of the information processing device 10 executes an information processing program 13A to function as the acquisition unit 11A, the discrimination unit 11B, the control unit 11C, and the calculation unit 11D.
[0036] The acquisition unit 11A according to this embodiment acquires point cloud data including temperature information, reflection intensity information, and color information at each point by three-dimensionally photographing the tiled area, which is an area where tiles are attached, using the 3D scanner 50. As described above, in this embodiment, the temperature information is obtained using the infrared camera 56, and is stored in the storage unit 13 as a database separate from the reflection intensity information and color information, but this is not limited to this. For example, the temperature information may also be stored in the same database as the reflection intensity information and color information in association with the corresponding coordinate information. For this reason, in the following, in addition to the coordinate information, reflection intensity information, and color information, the temperature information is also treated as being included in the point cloud data.
[0037] On the other hand, the discrimination unit 11B according to the present embodiment discriminates tiles and joints in a tile area using reflection intensity information and color information included in the point cloud data acquired by the acquisition unit 11 A. The discrimination unit 11B according to the present embodiment also discriminates the state of tile lifting using temperature information included in the point cloud data.
[0038] Then, the control unit 11C according to the present embodiment performs control to display the tile determined to be floating by the determination unit 11B as a drawing on the display unit 15, distinguishing it from the other tiles.
[0039] In addition, the discrimination unit 11B according to this embodiment further discriminates whether the state of the floating is base floating or ceramic fragment floating for tiles that have been determined to be floating using temperature information. Then, the control unit 11C according to this embodiment further performs control to display the above-mentioned drawing, distinguishing between base floating and ceramic fragment floating for tiles that have been determined to be floating by the discrimination unit 11B.
[0040] Furthermore, the calculation unit 11D according to the present embodiment calculates the number of tiles determined to be floating by the determination unit 11B. The control unit 11C according to the present embodiment further performs control to display result information indicating the calculation result by the calculation unit 11D as the above-mentioned drawing.
[0041] Furthermore, the calculation unit 11D according to this embodiment further calculates the ratio of the number of tiles determined to be floating by the discrimination unit 11B to the total number of tiles in the tile area. Therefore, the control unit 11C performs control to also display the ratio calculated by the calculation unit 11D.
[0042] Next, the scan information database 13B according to the present embodiment will be described with reference to Fig. 4. Fig. 4 is a schematic diagram showing an example of the configuration of the scan information database 13B according to the present embodiment.
[0043] As shown in FIG. 4, the scan information database 13B according to this embodiment stores information on coordinates, reflection intensity, and color in association with each other.
[0044] The coordinates are the above-mentioned coordinate information indicating the coordinates of the positions of the points obtained by three-dimensional imaging using the 3D scanner 50, the reflection intensity is the above-mentioned reflection intensity information at the corresponding points, and the color is the above-mentioned color information at the corresponding points. That is, the scan information database 13B according to this embodiment registers point cloud data of the coordinate information, reflection intensity information, and color information obtained by three-dimensional imaging using the 3D scanner 50.
[0045] Next, the temperature information database 13C according to this embodiment will be described with reference to Fig. 5. Fig. 5 is a schematic diagram showing an example of the configuration of the temperature information database 13C according to this embodiment.
[0046] As shown in FIG. 5, the temperature information database 13C according to this embodiment stores information on coordinates and temperature in association with each other.
[0047] The above coordinates are the same as those in the scan information database 13B, and the above temperatures are the above-mentioned temperature information at the corresponding points. That is, the temperature information database 13C according to the present embodiment registers temperature information obtained by three-dimensional imaging using the 3D scanner 50 together with the coordinate information of the corresponding points.
[0048] Next, the tile information database 13D according to this embodiment will be described with reference to Fig. 6. Fig. 6 is a schematic diagram showing an example of the configuration of the tile information database 13D according to this embodiment.
[0049] As shown in FIG. 6, the tile information database 13D according to this embodiment stores information such as tile individual numbers, coordinates, and tile group numbers in association with each other.
[0050] The tile individual number is a number that is assigned in advance as a different number for each tile in order to individually identify tiles attached to the exterior wall of an existing building (hereinafter referred to as the "target building") that is the target of 3D imaging by the 3D scanner 50. As shown in FIG. 6, in this embodiment, the tile individual number is configured to be preceded by a letter indicating the orientation of the wall surface of the target building to which the corresponding tile is attached (in the example shown in FIG. 6, "s" indicating the south side), but this is not limited to this. For example, the tile individual number may be configured only with numbers, or may be configured to include characters other than numbers and excluding the character indicating the wall surface orientation.
[0051] The coordinates are information indicating the position of the corresponding tile. As shown in FIG. 6, in this embodiment, information indicating the three-dimensional positions of a pair of diagonal corners in the rectangular shape of the corresponding tile is applied as the coordinates, but the present invention is not limited to this. For example, information indicating the two-dimensional positions of the pair of diagonal corners excluding the coordinates in the depth direction may be applied as the coordinates. In addition, when the tile is not rectangular but circular or elliptical, information indicating the positions of four points, the upper end, lower end, left end, and right end when viewed from the front, may be applied as the coordinates.
[0052] Furthermore, the tile group number is a number that is assigned in advance as a different number for each tile group in order to individually identify a group of adjacent tiles (hereinafter referred to as "tile group") in which a floating has been detected by information processing described later. As shown in FIG. 6, in this embodiment, the tile group number is configured to be assigned at the beginning of the tile group number in the same manner as the individual tile number, which indicates the direction of the wall of the target building to which the tiles included in the corresponding tile group are attached, but this is not limited to this. For example, the tile group number may be configured only with numbers, or may be configured to include characters other than numbers and excluding characters indicating the direction of the wall, in the same manner as the individual tile number. Note that there may be only one tile in which a floating has been detected, rather than multiple adjacent tiles, and in this case, one tile group number is assigned to that one tile.
[0053] Next, the tally information database 13E according to this embodiment will be described with reference to Fig. 7. Fig. 7 is a schematic diagram showing an example of the configuration of the tally information database 13E according to this embodiment.
[0054] As shown in Figure 7, the aggregated information database 13E of this embodiment stores information such as tile group number, temperature change areas, base loosening, and loose ceramic fragments in association with each face of the target building on which the corresponding tile group is attached.
[0055] The tile group number is the same information as the tile group number in the tile information database 13D.
[0056] The temperature change location is information indicating the overall tile floating status of tiles included in the tile group in which the corresponding floating was detected. The base floating is information indicating the floating status of tiles included in the corresponding tile group in which the base floating was detected. Furthermore, the ceramic fragment floating is information indicating the floating status of tiles included in the corresponding tile group in which the ceramic fragment floating was detected.
[0057] In this embodiment, the information indicating the state of the floating in each of the information on temperature change points, base floating, and ceramic fragment floating is the total area of tiles where the corresponding floating was detected, the number of tiles, and the floating rate, which is the ratio of the number of tiles to the total number of tiles. However, this is not limited to this, and one or a combination of two of these three types of information may be applied as the information indicating the state of the floating, and information indicating the state of the floating other than these three types of information may also be applied as the information indicating the state of the floating.
[0058] Next, the operation of the information processing system 90 according to this embodiment will be described with reference to Fig. 8 to Fig. 11. Fig. 8 is a flowchart showing an example of information processing according to this embodiment.
[0059] The photographer who performs the 3D photography uses the 3D scanner 50 to take a 3D image of the exterior wall of the target building from outside the target building. Through this 3D photography, the above-mentioned coordinate information, reflection intensity information, color information, and temperature information for each exterior wall of the target building are obtained and temporarily stored in the storage unit 58. After that, the photographer performs an operation to transmit each piece of information about the coordinate information, reflection intensity information, color information, and temperature information stored in the 3D scanner 50 to the information processing device 10.
[0060] When each of the above information is received from the 3D scanner 50, in the information processing device 10, each of the pieces of information, namely, coordinate information, reflection intensity information, and color information, is synthesized into one piece of information as point cloud data indicating each wall surface, and registered in the scan information database 13B. At this time, the temperature information in each piece of received information is temporarily stored in a predetermined area of the storage unit 13 of the information processing device 10, separately from the scan information database 13B.
[0061] In this state, the user of the information processing device 10 inputs an instruction to start execution of the information processing program 13A via the input unit 14. In response to this instruction, the CPU 11 of the information processing device 10 executes the information processing program 13A, thereby executing the information processing shown in Fig. 8. In order to avoid confusion, the following description will be given of a case in which information showing a drawing of the exterior wall of the target building created by a CAD system (not shown) (hereinafter referred to as "CAD drawing information") is stored in advance in the storage unit 13.
[0062] 8, the CPU 11 reads out the CAD drawing information from the storage unit 13, and in step 102, the CPU 11 reads out all information (hereinafter, referred to as "scan information") from the scan information database 13B. In step 104, the CPU 11 reads out the temperature information from the above-mentioned predetermined area of the storage unit 13.
[0063] In step 106, CPU 11 associates the coordinate information and temperature information in the read scan information with corresponding points and stores them in temperature information database 13C, thereby adding temperature information to each point indicated by the coordinate information. By the processing of step 106, the temperature information database 13C shown in FIG. 5 is constructed as an example.
[0064] In step 108, CPU 11 uses the color information and reflection intensity information in the read scan information to distinguish between tile areas and other areas, as shown below as an example.
[0065] First, the CPU 11 clusters the color information, and determines that an area of the point cloud in which the ratio of the area to the area of the corresponding wall in the target building is equal to or greater than a first threshold and that is rectangular in shape is a candidate for a tile area (hereinafter, referred to as a "tile candidate area"). Note that in this embodiment, the first threshold is specified in advance by the user of the information processing device 10, but this is not limiting. For example, a fixed value determined in advance according to the area of a general tile area may be stored in the information processing device 10 as the first threshold.
[0066] Next, the CPU 11 uses the reflection intensity information of the area corresponding to the tile candidate area to consider the area of the point cloud in which the reflection intensity indicated by the reflection intensity information is equal to or greater than the second threshold as a window area, and excludes the area from the tile candidate area. In the present embodiment, the second threshold is also specified in advance by the user of the information processing device 10, but the present invention is not limited to this. For example, a fixed value determined in advance according to the reflection intensity indicated by the reflection intensity information obtained by photographing general glass with the 3D scanner 50 may be stored in the information processing device 10 as the second threshold. In the present embodiment, the average value of the reflection intensity indicated by the reflection intensity information corresponding to the corresponding tile candidate area is applied as the reflection intensity of the tile candidate area, but the present invention is not limited to this. For example, the intermediate value of the reflection intensity indicated by the reflection intensity information corresponding to the corresponding tile candidate area may be applied as the reflection intensity of the tile candidate area, or the minimum or maximum value of the reflection intensity indicated by the reflection intensity information corresponding to the corresponding tile candidate area may be applied as the reflection intensity of the tile candidate area.
[0067] Then, the CPU 11 extracts points indicating straight lines from the point cloud corresponding to the tile candidate area that has undergone the above processing as points indicating the edges of the outer periphery of the tile, and determines that the area surrounded by the edges is the tile area and the other areas are areas indicating the joints between the tiles. Note that the above straight lines may be missing because the tile is in the shadow of some object, or the tile is dirty, etc. In this case, the missing points can be interpolated from the point cloud data of nearby points.
[0068] In step 110, CPU 11 assigns the above-mentioned tile individual number to each tile area determined by the processing in step 108, and stores the tile individual number and coordinates indicating the position of the tile area in tile information database 13D. By the processing in step 110, as an example, the part of tile information database 13D shown in Fig. 6 excluding the tile group numbers is constructed.
[0069] In step 112, the CPU 11 uses the read temperature information to determine whether or not a lift has occurred for each tile registered in the tile information database 13D, and if a lift has occurred, to determine the type of lift, as shown below as an example.
[0070] That is, CPU 11 determines that tiles whose temperature indicated by the temperature information corresponding to each tile's area (hereinafter referred to as "tile temperature") is less than the third threshold are tiles that have not become loose (hereinafter referred to as "non-loose tiles"). CPU 11 also determines that tiles whose tile temperature is equal to or greater than the third threshold and less than the fourth threshold are tiles that have become loose (hereinafter referred to as "loose base tiles"). CPU 11 further determines that tiles whose tile temperature is equal to or greater than the fourth threshold are tiles that have become loose with ceramic fragments (hereinafter referred to as "loose ceramic fragment tiles").
[0071] In this embodiment, the average value of the temperature indicated by the temperature information corresponding to the corresponding tile area is applied as the tile temperature, but the present invention is not limited thereto. For example, the intermediate value of the temperature indicated by the temperature information corresponding to the corresponding tile area may be applied as the tile temperature, or the minimum or maximum value of the temperature indicated by the temperature information corresponding to the corresponding tile area may be applied as the tile temperature. In addition, in this embodiment, the values obtained by experiments or computer simulations are applied as values that can be used to determine whether the target tile is an unraveled tile, a base-raised tile, or a ceramic fragment-raised tile by applying the third threshold, fourth threshold, and fifth threshold, respectively, but the present invention is not limited thereto. For example, the thresholds may be specified in advance by the user of the information processing device 10.
[0072] Through the above process, the base floating tiles and the ceramic fragment floating tiles in the tile installation area are identified, as shown in Fig. 9 as an example. Note that in Fig. 9, the base floating tiles are shown with a higher density than the non-floating tiles, and the ceramic fragment floating tiles are shown with a lower density than the non-floating tiles.
[0073] In step 114, the CPU 11 uses the loosening status of each tile obtained by the above processing to assign a tile group number to each of the above-mentioned tile groups, and derives information on temperature change areas, loose base, and loose ceramic fragments as aggregate information.
[0074] In step 116, CPU 11 stores the derived tally information in tally information database 13E, and stores the tile group number in the tally information in tile information database 13D. Through this process, tile information database 13D shown in Fig. 6 as an example is finally constructed, and tally information database 13E shown in Fig. 7 as an example is also constructed.
[0075] In step 118, the CPU 11 controls the display unit 15 to display a CAD drawing display screen having a predetermined configuration using the read CAD drawing information and scan information and various information obtained by the above processes. In step 120, the CPU 11 waits until predetermined information is input.
[0076] FIG. 10 shows an example of a CAD drawing display screen according to this embodiment. As shown in FIG. 10, the CAD drawing display screen according to this embodiment displays a drawing showing one side (in this embodiment, the south side) of the target building shown by the CAD drawing information. In addition, in the CAD drawing display screen according to this embodiment, the area where the tile is detected is displayed with a different density between the area where the base is floating and the area where the ceramic fragments are floating, and with a different density from other areas, and is synthesized with the tile group number assigned to the area. Although it is difficult to distinguish in FIG. 10 due to the scale, in reality, the inside of the frame indicating the tile group to which the tile group number is assigned is made to have a higher density than the outside of the frame, and even within the frame, the area where the base is floating and the area where the ceramic fragments are floating are made to have a different density. Therefore, by referring to the CAD drawing display screen, the user can grasp the area of the tile where the floating occurs, the type of the floating, and the tile group number assigned to the area.
[0077] 10 is displayed on the display unit 15, the user checks the displayed CAD drawing display screen and then designates the end button 15E via the input unit 14. When the end button 15E is designated by the user, the determination in step 120 is affirmative, and the process proceeds to step 122.
[0078] In step 122, the CPU 11 uses the above-mentioned summary information to control the display unit 15 to display a summary table drawing display screen having a predetermined configuration, and in step 124, the CPU 11 waits until the specified information is input.
[0079] An example of a summary table drawing display screen according to this embodiment is shown in Fig. 11. As shown in Fig. 11, the summary table drawing display screen according to this embodiment displays information in the summary information described above, excluding temperature change locations, in a list format. Therefore, the user can understand information in the summary information, excluding temperature change locations, by referring to the summary table drawing display screen.
[0080] 11 is displayed on the display unit 15, the user checks the displayed schedule drawing display screen, and then designates the end button 15E via the input unit 14. When the end button 15E is designated by the user, the result of the judgment in step 124 is affirmative, and the information processing ends.
[0081] As described above, the information processing device 10 according to the present embodiment includes an acquisition unit 11A that acquires point cloud data including temperature information at each point and at least one of reflection intensity information and color information by 3D imaging of the tile area where tiles are attached, a discrimination unit 11B that uses at least one of the reflection intensity information and color information included in the point cloud data acquired by the acquisition unit 11A to distinguish tiles and joints in the tile area and uses the temperature information included in the point cloud data to distinguish the state of the loose tiles, and a control unit 11C that performs control to display tiles that are determined to be loose by the discrimination unit 11B as a drawing, distinguishing them from other tiles. Therefore, the state of the loose tiles can be displayed as a drawing more easily.
[0082] Furthermore, the information processing device 10 according to the present embodiment uses temperature information to further determine whether the state of the floating is base floating or ceramic fragment floating for tiles that have been determined to be floating, and further performs control to display the tiles determined to be floating as drawings that distinguish between base floating and ceramic fragment floating. Therefore, the type of tile floating can also be displayed as a drawing.
[0083] Moreover, the information processing device 10 according to the present embodiment calculates the number of tiles determined to be floating, and further performs control to display result information showing the calculation result as a drawing. Therefore, the number of tiles that are floating can be grasped.
[0084] Furthermore, the information processing device 10 according to the present embodiment further calculates and displays the ratio of the number of tiles determined to be floating to the total number of tiles in the tile region, so that the ratio can also be grasped.
[0085] In the above embodiment, the case where tiles and areas other than tiles are distinguished from each other using both the reflection intensity information and the color information has been described, but the present invention is not limited to this. For example, tiles and areas other than tiles may be distinguished from each other using only either the reflection intensity information or the color information.
[0086] In the present embodiment, the summary table drawing display screen displays information excluding temperature change locations in the summary information, but is not limited to this. For example, a screen including information indicating temperature change locations in the summary information may be displayed as the summary table drawing display screen.
[0087] In the present embodiment, the color information is clustered, and a region of the point cloud whose area relative to the area of the corresponding wall in the target building is equal to or greater than a first threshold and whose shape is rectangular is determined to be a tile candidate region, but the present invention is not limited to this. For example, information indicating a color range of the tile may be input in advance, and a set of point clouds whose color information obtained by the 3D scanner 50 falls within the range may be determined to be a tile candidate region.
[0088] In addition, in the present embodiment, a case where a CAD drawing display screen and a schedule drawing display screen are displayed by information processing has been described, but the present invention is not limited to this. For example, instead of these screens, or in addition to these drawings, a report drawing display screen shown in FIG. 12 may be displayed by information processing. In the example shown in FIG. 12, a matching image in which a visible image, an infrared image, and an area in which a lift is detected of the target building are synthesized at a predetermined density are displayed. In addition, in the example shown in FIG. 12, various information related to these images (in the example shown in FIG. 12, the image number, drawing number, drawing name, survey item (lifted tiles), part, and special notes) are displayed. Therefore, by referring to the report drawing display screen, the user can check the visible image, infrared image, and matching image of the target building, and can grasp the above various information.
[0089] In the above embodiment, the scan information database 13B, the temperature information database 13C, the tile information database 13D, and the summary information database 13E are configured as separate entities, but the present invention is not limited to this. For example, two of these databases may be combined, or all of them may be configured as a single database.
[0090] In the above embodiment, the area where the floating tile is detected is displayed in a different density from the other areas, but the present invention is not limited to this. For example, the area where the floating tile is detected may be displayed in a different color from the other areas, or may be displayed in a different filled state from the other areas.
[0091] In the above embodiment, the information processing device 10 is a general-purpose or dedicated information processing device such as a personal computer or a server computer, but is not limited thereto. For example, the information processing device 10 may be a mobile computer such as a smartphone or a mobile information terminal.
[0092] In the above embodiment, the information processing device 10 is configured separately from the 3D scanner 50, but the present invention is not limited to this. For example, the information processing device 10 may be built into the 3D scanner 50.
[0093] In the above embodiment, for example, the hardware structure of the processing unit that executes each process of the acquisition unit 11A, the discrimination unit 11B, the control unit 11C, and the calculation unit 11D may be any of the following various processors: As described above, the above various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as a processing unit, as well as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture such as an FPGA (Field-Programmable Gate Array), a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing a specific process such as an ASIC (Application Specific Integrated Circuit), etc.
[0094] The processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA).The processing unit may also be configured with a single processor.
[0095] As an example of configuring the processing unit with one processor, first, there is a form in which one processor is configured with a combination of one or more CPUs and software, as represented by computers such as client and server, and this processor functions as the processing unit. Second, there is a form in which a processor is used that realizes the functions of the entire system including the processing unit with one IC (Integrated Circuit) chip, as represented by System On Chip (SoC), etc. In this way, the processing unit is configured using one or more of the above various processors as a hardware structure.
[0096] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements. [Explanation of symbols]
[0097] 10. Information processing device 11 CPU 11A Acquisition Department 11B Discrimination part 11C Control section 11D Calculation section 12. Memory 13 Storage section 13A Information Processing Program 13B Scan Information Database 13C Temperature Information Database 13D Tile Information Database 13E Aggregated Information Database 14 Input section 15 Display 15E Exit button 16 Media Read / Write Device 17 Recording media 18 Communication I / F section 50 3D Scanner 52 Scanner body 56 Infrared Camera 58 Memory section 60 Legs 90 Information Processing Systems
Claims
1. an acquisition unit that acquires point cloud data including temperature information and at least one of reflection intensity information and color information at each point by three-dimensionally capturing a tile area where tiles are attached; a discrimination unit that discriminates tiles and joints in the tile region using at least one of the reflection intensity information and the color information included in the point cloud data acquired by the acquisition unit, and discriminates a state of the loosening of the tiles using the temperature information included in the point cloud data; a control unit that controls displaying the tile determined to be floating by the determination unit as a drawing, distinguishing it from other tiles; Equipped with The determination unit further determines, using the temperature information, whether the state of the floating of the tile determined to be floating is either base floating or ceramic fragment floating, The control unit further controls to display the tiles determined to be floating by the determination unit as the drawing, distinguishing between floating base and floating ceramic pieces. Information processing device.
2. A calculation unit that calculates the number of tiles that are determined to be floating by the determination unit, The control unit further controls to display result information indicating a calculation result by the calculation unit as the drawing. The information processing device according to claim 1 .
3. the calculation unit further calculates a ratio of the number of tiles determined to be floating by the determination unit to the total number of tiles in the tile region. The information processing device according to claim 2 .
Citation Information
Patent Citations
Image processing device and building image diagnosis apparatus
JP2012221486A
Device and method for diagnosing deterioration of tile
JP2017058165A
Concrete structure management device, information processing system, concrete structure management method, and program
JP2020154467A
Display data generating device and display data generating method
JP6506886B1
Display data generation device, display data generation method, and display processing method
WO2019111391A1
