Smartphone-linked IoT crack gauge and crack measurement system for facility

WO2025048467A1PCT designated stage expired Publication Date: 2025-03-06DL E&C CO LTD +1
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/012806
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-22
Filing Date
2024-08-27
Publication Date
2025-03-06

Smart Images

  • Figure KR2024012806_06032025_PF_FP_ABST
    Figure KR2024012806_06032025_PF_FP_ABST
Patent Text Reader

Abstract

The present invention relates to a crack gauge that is attached to a position where a crack in a structure is to be measured, and operates in conjunction with a smartphone. The crack gauge comprises: a case-shaped housing (100) that has an open lower portion and provides an inner space; a lower cover (200) that is coupled to the open lower portion of the housing (100) and functions as a cover of the housing (100); a PCB assembly (300) installed in the inner space formed by the housing (100) and the lower cover (200); and a battery (400) that is installed in the inner space formed by the housing (100) and the lower cover (200) and supplies power required for the operation of the PCB assembly (300), wherein the PCB assembly (300) includes a camera (310) installed in a direction facing the lower cover (200), and the lower cover (200) includes a light-transmissive window (210) for camera photography, in which a portion of an area corresponding to the camera (310) is cut out. Moreover, the present invention relates to a crack measurement system for photographing and analyzing a crack in a facility. The crack measurement system comprises: a crack photographing device (600) installed in the facility to take a photo of a crack portion; a user terminal (700) that is connected to the crack photographing device (600) via short-range wireless communication, can control the operation of the crack photographing device (600) via short-range wireless communication, and receives the photo taken by the crack photographing device (600); and a web server (800) that receives a photo or a work request from the user terminal (700) via a web application installed on the user terminal (700), stores or analyzes the photo received from the user terminal (700) to derive a crack width, generates a report from analyzing the photo, and transmits the generated report to the user terminal (700) according to the work request from the user terminal (700).
Need to check novelty before this filing date? Find Prior Art

Description

Smartphone-linked IoT crack gauge and facility crack measurement system

[0001] The present invention relates to a crack gauge that operates in conjunction with a smartphone, and is characterized in that it is attached (mounted) to the surface of a structure that is the target of crack measurement, continuously photographs the crack area at a preset time (cycle), stores the captured images, and then transmits the stored image file to a smartphone when a smartphone operating a web application approaches within a preset distance.

[0002] In addition, the present invention is characterized in that it uses a photographing device to measure changes in cracks during safety management of a facility, photographs cracked areas by degree, analyzes the photographs taken through a web server, generates a report, and allows multiple users to access the web server and check the contents as needed.

[0003] In general, building structures develop cracks over time when they are affected by earthquakes, vibrations, or ground subsidence. If these cracks worsen, the building structure may collapse. Therefore, regular safety inspections must be conducted to measure changes in crack width.

[0004] In order to measure the change in crack width, a measuring device (or measuring card) that can directly measure the crack width with the naked eye was used in the past. The measuring device for measuring the crack width is made of a thin, square, transparent plate material, and has scales and numbers marked on its surface.

[0005] Therefore, the crack width can be measured directly with the naked eye by placing the measuring device close to the crack area. However, the accuracy of the conventional measuring device varies depending on the person measuring, making it difficult to accurately measure fine cracks, and a separate lighting device is required in dark places.

[0006] Meanwhile, when performing precise inspection work such as measuring concrete cracks, a crack scope equipped with a magnifying lens is sometimes used. However, after inspecting the crack area using the magnifying lens, the degree of the crack is measured again with a straightedge or tape measure and recorded. This work not only takes an excessive amount of time to measure and is inconvenient, but the accuracy of the measured value also varies greatly depending on the skill level of the worker, which significantly reduces the efficiency of the inspection work.

[0007] In order to solve these problems, a method has been proposed to measure the crack area using a digital camera and then analyze the image to obtain information on whether the crack has progressed or the crack width, etc. The present invention relates to a new concept of a measuring gauge that can be used in this measuring method.

[0008] In addition, the present invention was developed for the purpose of inspecting the safety of structures in accordance with the “Special Act on Safety and Maintenance of Facilities and the Construction Technology Promotion Act.”

[0009] As times change and various construction technologies develop, the speed and number of construction of various facilities such as buildings, bridges, and roads are gradually increasing, and the number of safety accidents is also increasing accordingly, and safety diagnosis is also being strengthened every year.

[0010] The "Special Act on Safety and Maintenance of Facilities" aims to ensure public safety by preventing disasters and calamities through safety inspections and proper maintenance of facilities and by increasing the utility of facilities. However, in reality, the following problems exist that do not conform to the purpose of this law and are not continuously resolved.

[0011] First, there is a shortage of dedicated safety management personnel. While regulations stipulate that facilities undergo regular inspections, sometimes as often as once or twice a month, depending on their management level, the sheer number of over 180,000 facilities makes it difficult for local governments to conduct effective inspections.

[0012] Second, safety assessments are subjective. While most safety assessments are conducted visually using safety rating assessment manuals, their highly subjective nature limits their ability to thoroughly identify risks. In other words, the current method of inspecting cracks in facilities involves installing a graduated plastic ruler on the cracked area to check the difference between the previous and current values, and then conducting an inspection and evaluation. However, visually inspecting to within 0.1 mm or 0.01 mm is practically impossible. This leads to subjective safety assessments, which lack objectivity and deteriorate professionalism.

[0013] Third, frequent inspections can lead to owner resistance. During inspections, it's necessary to coordinate schedules with owners and control inspection areas. Therefore, buildings with high traffic, such as ski resorts and amusement parks, are particularly vulnerable to owner resistance.

[0014] Fourth, the current crack measurement system relies on manual labor, resulting in only a formality. Automated measurement is extremely expensive, making it a reluctant choice for private companies and experts. Furthermore, automated measurement only collects numerical results, raising concerns about the accuracy and reliability of the results.

[0015] [Prior Art Literature]

[0016] Registered Patent No. 10-1439282

[0017] Registered Patent No. 10-2320281

[0018] Registered Patent No. 10-1765806

[0019] Registered Patent No. 10-1909212

[0020] Registered Patent No. 10-2192341

[0021] Registered Patent No. 10-2396329

[0022] The purpose of the present invention is to maximize the efficiency and increase the accuracy of crack measurement work.

[0023] First, the purpose of the present invention is to provide a new concept of a crack gauge that can continuously take pictures and store pictures at preset time intervals (cycles) without the need to directly take pictures of the crack area.

[0024] Second, another object of the present invention is to provide a new concept crack gauge that can minimize battery consumption.

[0025] Third, another object of the present invention is to provide a new concept crack gauge that can be temporarily operated by directly supplying external power on site when the battery is exhausted.

[0026] Fourth, the purpose of the present invention is to solve the problems such as the lack of manpower that arises from the necessity of safety inspection of facilities according to the law, the problem of subjective safety diagnosis through visual inspection, the resistance of owners due to frequent inspection, the problem of cost (economic feasibility), and the lack of reliability (objectivity) of data that only confirms numbers.

[0027] The technical configuration of the present invention created to achieve the above-mentioned purpose is as follows.

[0028] The present invention relates to a crack gauge that is attached to a location for measuring a crack in a structure and operates in conjunction with a smartphone, comprising: a housing (100) in the shape of a case with an open bottom and providing an internal space; a magnet (110) attached to an upper outer surface of the housing (100); a lower cover (200) coupled to the open lower portion of the housing (100) and serving as a cover of the housing (100); a PCB assembly (300) installed in the internal space formed by the housing (100) and the lower cover (200); a battery (400) installed in the internal space formed by the housing (100) and the lower cover (200) and supplying power necessary for the operation of the PCB assembly (300); And, it includes an inner cover (500) which is installed in the inner space of the lower cover (200) and acts as a barrier to isolate the inner space of the housing (100) in which the PCB assembly (300) and the battery (400) are installed and the lower cover (200), and the PCB assembly (300) includes a camera (310) which is installed in a direction facing the lower cover (200), and the lower cover (200) is provided with a camera shooting transparent window (210) in which an area corresponding to the camera (310) is partially cut out, and the inner cover (500) is provided with an inner transparent window (510) in which an area corresponding to the camera (310) is partially cut out, and a support pillar (540) which protrudes toward the lower cover (200) is provided on the lower surface of the inner cover (500), and on the inner surface of the lower cover (200) in a portion corresponding to the support pillar (540) Support column receiving groove (230);This is provided, and the end of the support pillar (540) coupled to the support pillar receiving groove (230) has a ball shape so that when the lower cover (200) is attached to the surface of the structure, the lower cover (200) is tilted according to the curvature or deviation of the surface of the structure, thereby minimizing the gap between the rim of the housing (100) and the surface of the structure, and the PCB assembly (300) is provided with a magnetic switch function that blocks the power of the battery (400) from being supplied to the PCB assembly (300) when the magnet (110) is attached to the upper outer surface of the housing (100), and supplies the power of the battery (400) to the PCB assembly (300) when the magnet (110) is separated from the upper outer surface of the housing (100), thereby fundamentally preventing unnecessary power consumption of the battery (400) before being mounted on the surface of the structure.

[0029] In addition, the present invention relates to a crack measurement system for photographing and analyzing cracks in a facility, and is characterized by including: a crack photographing device (600) installed in a facility to photograph a crack area; a user terminal (700) connected to the crack photographing device (600) via short-range wireless communication, capable of controlling the operation of the crack photographing device (600) via short-range wireless communication, and receiving the photos photographed by the crack photographing device (600); and a web server (800) that receives photos or work requests from the user terminal (700) via a web application installed in the user terminal (700), stores or analyzes the photos received from the user terminal (700) to derive a crack width, generates a report analyzing the photos, and transmits the report generated in response to the work request of the user terminal (700) to the user terminal (700).

[0030] The technical effects according to the composition of the present invention are as follows.

[0031] First, there is no need to directly photograph the crack area, and images can be continuously photographed and stored at preset intervals (cycles).

[0032] Second, it can prevent unnecessary battery consumption at the source.

[0033] In other words, the PCB assembly (300) is provided with a magnetic switch function that blocks the power of the battery (400) from being supplied to the PCB assembly (300) when the magnet (110) is attached to the upper outer surface of the housing (100), and supplies the power of the battery (400) to the PCB assembly (300) when the magnet (110) is separated and removed from the upper outer surface of the housing (100). Therefore, separately from the sleep mode function of the PCB assembly (300), it is possible to fundamentally prevent the power of the battery (400) from being unnecessarily consumed until the crack gauge of the present invention is mounted on the surface of the structure.

[0034] Third, even when the battery power runs out, it can be operated temporarily by directly supplying external power on site.

[0035] In other words, the PCB assembly (300) is equipped with an emergency power port (320) that can temporarily supply external power, so that when the battery (400) is exhausted and the crack gauge of the present invention does not operate properly, it can be temporarily operated by directly supplying external power.

[0036] Fourth, the support pillar (540) of the inner cover (500) is coupled to be fitted into the support pillar receiving groove (230) of the lower cover (200), and the end of the support pillar (540) has a ball shape, so that when the crack gauge of the present invention is installed on the surface of a structure, the lower cover (200) can be appropriately tilted according to the curvature or deviation of the surface of the structure so that the edge of the housing (100) can be in close contact with the surface of the structure as much as possible.

[0037] Fifth, since a crack measurement device can be installed at the location where the crack is to be measured and crack information can be checked through a user terminal, inspection can be conducted in a much shorter time and with less manpower compared to the existing method.

[0038] Sixth, it can measure up to 0.0135mm, which is difficult to detect with the naked eye, and can also take multiple pictures and diagnoses. It can also detect and analyze cracks from the pictures taken by executing the deep learning model of the artificial intelligence analysis section of the web server, derive the crack width, and then generate a related report, so that various people who access the web server (inspectors, facility owners or managers, etc.) can check the results at any time.

[0039] Seventh, multiple crack photographing devices can be controlled using short-range wireless communication, and by linking with a web server, only the photographed images can be transmitted, enabling automatic derivation of crack width and automatic generation of related reports. This minimizes complaints such as scheduling issues with facility owners or managers, and uncooperative inspections by owners, managers, or residents.

[0040] Figure 1 is an exploded perspective view of the main components of the present invention.

[0041] Figure 2 illustrates a cross-sectional structure of the present invention.

[0042] Figure 3 illustrates the upper outer structure of the present invention.

[0043] Figure 4 illustrates the lower external structure of the present invention.

[0044] Figure 5 illustrates the concept of linking with a smartphone.

[0045] Figure 6 is a block diagram showing the overall configuration of the present invention.

[0046] FIG. 7 shows an example of a screen displayed on a user terminal (700) of the present invention, and controls the connection (device connection or device disconnection) and data collection (photography) with a crack photographing device (600) through the user terminal (700).

[0047] FIG. 8 shows an example of a screen displayed on a user terminal (700) of the present invention. Through the user terminal (700), a photo of a crack area taken by a crack photographing device (600) can be transmitted to a web server (800) for analysis, temporarily stored in the user terminal (700), or the crack area can be re-photographed.

[0048] Fig. 9 is an example of a report generated by a web server (800), in which the location of the measuring device corresponding to the crack photographing device (600) can be visually confirmed, and the measurement value and displacement amount can be confirmed by order for each measuring device.

[0049] Figure 10 is an example of a report generated by a web server (800), in which the captured photos and measurement values ​​can be checked along with the shooting time.

[0050] [Explanation of symbols]

[0051] 100: Housing

[0052] 110: Magnet

[0053] 200: Lower cover

[0054] 201: Area 1 202: Area 2 203: Protrusion

[0055] 210: Transparency window for camera shooting

[0056] 220: Buffer ring

[0057] 230: Support column receiving groove

[0058] 300:PCB assembly

[0059] 310: Camera

[0060] 320: Emergency power port

[0061] 400: Battery

[0062] 500: Inner cover

[0063] 510: Internal transparent window

[0064] 520: Protective lens

[0065] 530: Double-sided tape for attaching protective lenses

[0066] 540: Support pillar

[0067] 600: Crack imaging device

[0068] 700: User terminal

[0069] 800: Web server

[0070] 810: Artificial Intelligence Analysis Department

[0071] 820: Report Generation Department

[0072] 830: Database Department

[0073] Hereinafter, specific embodiments of the present invention will be described in more detail with reference to the attached drawings.

[0074] The present invention relates to a crack gauge that is attached to a location to measure a crack in a structure and operates in conjunction with a smartphone, and includes a housing (100), a lower cover (200), an inner cover (500), a PCB assembly (300), a battery (400), etc., as shown in FIG. 1.

[0075] The housing (100) has an open bottom and is a case-shaped structure that provides an internal space overall. However, the specific shape is not limited to that shown in Fig. 1, and if the structure has an internal space in which the components of the present invention can be installed, the design can be changed to an appropriate shape.

[0076] The lower cover (200) is coupled to the open lower part of the housing (100) and serves as a cover for the housing (100).

[0077] The PCB assembly (300) is installed in the internal space formed by the housing (100) and the lower cover (200). More specifically, it is installed in the space between the inner cover (500) additionally installed in the inner space of the lower cover (200) and the upper part of the housing (100).

[0078] The battery (400) is also installed in the internal space formed by the housing (100) and the lower cover (200). More specifically, it is installed in the internal space between the inner cover (500) additionally installed in the inner space of the lower cover (200) and the upper part of the housing (100), and serves to supply power required for the operation of the PCB assembly (300).

[0079] That is, as can be confirmed in the cross-sectional structure of Fig. 2, the inner cover (500) installed in the inner space of the lower cover (200) acts as an internal barrier that isolates the lower cover (200) from the inner space of the housing (100) in which the PCB assembly (300) and the battery (400) are installed.

[0080] The lower surface of the inner cover (500) is provided with a support pillar (540) that protrudes toward the lower cover (200), and the inner surface of the lower cover (200) is provided with a support pillar receiving groove (230) in a portion corresponding to the support pillar (540).

[0081] The support pillar (540) of the inner cover (500) is coupled to fit into the support pillar receiving groove (230) of the lower cover (200) as shown in the cross-sectional structure of FIG. 2, and the end of the support pillar (540) has a ball shape.

[0082] Accordingly, when installing the crack gauge of the present invention on the surface of a structure, the lower cover (200) is appropriately tilted according to the curvature or deviation of the surface of the structure so that the edge of the housing (100) is in maximum contact with the surface of the structure. In other words, the gap between the edge of the housing (100) and the surface of the structure can be minimized.

[0083] The camera (310) is installed in the PCB assembly (300) in a direction facing the lower cover (200) to photograph the cracked area. That is, the structure includes a camera module in the PCB assembly (300).

[0084] These cameras (310) may be equipped with a flash function to capture images of cracked areas even in low light conditions.

[0085] The lower cover (200) is provided with a camera shooting window (210) with a portion of the area corresponding to the camera (310) cut out, and the inner cover (500) is also provided with an inner shooting window (510) with a portion of the area corresponding to the camera (310) cut out, so that the crack area can be photographed using the camera (310).

[0086] In addition, as shown in Fig. 1, a transparent protective lens (520) for protecting the camera (310) is attached to the inner transparent window (510) using a double-sided tape (530) for mounting the protective lens, thereby protecting the camera (310) or PCB assembly (300) from external substances.

[0087] The outer surface of the lower cover (200) is divided into a first region (201) equipped with a camera shooting window (210) as shown in FIG. 1 or FIG. 3, and a second region (202) for attaching the lower cover (200) to the surface of the structure, and a number of protrusions (203) are provided in the second region (202) for attaching the lower cover (200) to the surface of the structure, and an attachment bond is applied only to the second region (202).

[0088] The buffer ring (220) is made of an elastic material and is attached in a structure that surrounds the camera shooting window (210) of the first area (201).

[0089] When such a buffer ring (220) is provided, when the lower cover (200) is attached to the surface of the structure, the elastic buffer ring (220) is pressed against the surface of the structure, thereby sealing the area around the camera shooting transparent window (210), thereby preventing foreign substances from entering the area where the camera shooting transparent window (210) is provided.

[0090] The magnet (110) is attached to the upper outer surface of the housing (100) using a double-sided tape or the like as shown in FIG. 4, and the magnet (110) is removed when the crack gauge of the present invention is installed on the surface of the structure.

[0091] The PCB assembly (300) is provided with a magnetic switch function that blocks the power supply of the battery (400) to the PCB assembly (300) when the magnet (110) is attached to the upper outer surface of the housing (100), and supplies the power of the battery (400) to the PCB assembly (300) when the magnet (110) is separated and removed from the upper outer surface of the housing (100). Therefore, unnecessary power consumption of the battery (400) is fundamentally prevented until the crack gauge of the present invention is mounted on the surface of the structure. That is, when the battery (400) is connected, a certain amount of low power is consumed even in sleep mode, and this is fundamentally prevented.

[0092] When the magnet (110) is separated and the PCB assembly (300) receives power from the battery (400), the camera (310) operates at preset intervals to take pictures of the cracked area and store them in the internal memory. When the camera (310) is not taking pictures, it switches to sleep mode to minimize the consumption of the battery (400).

[0093] As illustrated in FIG. 5, the PCB assembly (300) is equipped with a short-range wireless communication function (e.g., low-power Bluetooth), and a web application that is connected to the PCB assembly (300) is installed. When a smartphone on which the web application is running approaches the PCB assembly (300) within a preset distance, image files of the crack area stored in the internal memory of the PCB assembly (300) are transmitted to the smartphone through the short-range wireless communication function.

[0094] The smartphone can send these video files to a cloud server, and the cloud server can analyze the images in the video files and generate reports.

[0095] The PCB assembly (300) is provided with an emergency power port (320) that can temporarily supply external power as shown in FIGS. 1 to 4. One side of the housing (100) is cut open at a location corresponding to the emergency power port (320). Although not shown separately in the attached drawing, in normal times, this cut portion can be covered with a cover of an appropriate shape to prevent foreign substances or moisture from penetrating.

[0096] This emergency power port (320) serves to temporarily supply external power when the battery (400) is exhausted and the crack gauge of the present invention does not operate properly.

[0097] The present invention relates to a crack measurement system that photographs and analyzes cracks in a facility, and its main components include a crack photographing device (600), a user terminal (700), and a web server (800), as illustrated in FIG. 6, wherein the web server (800) includes an artificial intelligence analysis unit (810), a report generation unit (820), and a database unit (830). Here, the smartphone-linked IoT crack gauge illustrated in FIG. 1 can be used as the crack photographing device (600).

[0098] A crack photographing device (600) is installed in a facility subject to safety inspection and takes pictures of the crack area.

[0099] The crack photographing device (600) is equipped with a function for taking a picture of a crack area, a function for transmitting a taken picture file to a user terminal (700) by enabling short-range wireless communication (e.g., Bluetooth Low Energy) with a user terminal (700), and a function for supplying power required for the operation of the crack photographing device (600) (a replaceable battery or a port that can be connected to an external power source).

[0100] The user terminal (700) refers to a smartphone or various digital terminals that can be replaced by the smartphone and can be connected to the crack photographing device (600) via short-range wireless communication and can be connected to the web server (800) via a communication network such as the Internet. As long as it can perform these functions, the specific type or specification is not particularly limited.

[0101] A web application required for the operation of the crack measurement system is installed on this user terminal (700).

[0102] The operation of the crack photographing device (600) can be controlled through short-range wireless communication with the user terminal crack photographing device (600), and the photos taken and transmitted by the crack photographing device (600) can be received.

[0103] FIG. 7 shows an example of a screen displayed on a user terminal (700) of the present invention, and the user terminal (700) can be used to control the connection with the crack photographing device (600) (device connection or device disconnection) and data collection (photographing).

[0104] In other words, when the web application installed on the user terminal (700) is activated and the user approaches the crack photographing device (600) within a preset distance (within 10 m in the example of FIG. 7), device linkage is possible, and the device linkage display button displayed on the screen can be clicked to link or release the device.

[0105] The procedures for user authorization (such as member registration, ID and password entry) during the process of activating a web application are identical or similar to existing commercial methods, so a separate explanation is omitted.

[0106] In addition, when the data collection execution button is clicked while the device is connected, the crack photography device (600) starts shooting and the captured photo can be transmitted.

[0107] FIG. 8 shows an example of a screen of a user terminal (700) in which a photograph taken as a result of data collection execution is transmitted from a crack photographing device (600). The transmitted photograph can be transmitted to a web server (800) by clicking an analysis button, or, if communication with the web server (800) is not smooth, the photograph can be temporarily stored in the user terminal (700) by clicking a temporary save button, or, if re-taking is required after checking the photographed photograph, the re-take button can be clicked. The photograph of the crack area transmitted to the web server (800) is stored in the web server (800) and analyzed.

[0108] The user terminal (700) can be not only the terminal of the person performing the safety inspection, but also the terminal of the owner or manager of the facility, so that the owner or manager of the facility can also access the web server (800) at any time through the user terminal (700) and check photos or reports stored in the web server (800).

[0109] The web server (800) receives photos or other work requests from the user terminal (700), stores or analyzes the photos received from the user terminal (700), derives the crack width, and generates a report analyzing the photos. In addition, the report generated in response to the work request from the user terminal (700) can be transmitted to the user terminal (700).

[0110] The user terminal (700) can create a project for each facility by connecting to the web server (800) and authenticating the user, and can input sub-site information for each project. Such project-related information and sub-site information are stored in the web server (800), and such project-related information and sub-site information can also be retrieved through the user terminal (700).

[0111] When creating a project through a user terminal (700), information regarding the project name, construction company name, and type of work (crack management, site survey, building management, etc.) can be entered to distinguish it from other projects, and when entering sub-site information through the user terminal (700), address information can be entered to distinguish it from other sub-sites, and information regarding panoramic photos, surrounding photos, layout plans, or surrounding maps can be entered by taking photos directly using the camera function provided in the user terminal (700) or uploading photos stored in the user terminal (700).

[0112] The user terminal (700) assigns identification information (identification code, identification number or identification name) to each crack imaging device (600) so that multiple crack imaging devices (600) can be distinguished, and selects each crack imaging device (600) as needed to control its operation (connecting the device, disconnecting the device or executing data collection (shooting).

[0113] In addition, the photos taken by the crack photographing device (600) are received, and each photo is given a unique file name, number of shots taken, and date of shooting, and the photos given a unique file name, number of shots taken, and date of shooting can be transmitted to a web server (800) or temporarily stored in a user terminal (700).

[0114] When the installation location of the crack photographing device (600) is changed or removed, the user terminal (700) can select the identification information of the corresponding crack photographing device (600) and remove the connection information with the user terminal (700). When the connection information between the crack photographing device (600) and the user terminal (700) is deleted, the crack photographing device (600) whose connection information has been deleted is linked to a unique file name, number of shots taken, and date of shooting, and then the existing photos stored in the web server (800) and the contents of the report analyzing the photos are deleted together.

[0115] The artificial intelligence analysis unit (810) detects and analyzes cracks by executing a deep learning model on photos transmitted to the web server (800) via the user terminal (700) and derives the crack width.

[0116] The deep learning model uses the open-source Semantic Segmentation model, without changing the model architecture, and applies additional techniques to improve performance.

[0117] The model applied to the present invention can comprehensively analyze both fine details and overall information of an image compared to other semantic segmentation models, because it extracts and utilizes features or information of an image at multiple scales.

[0118] The present invention introduces a model that can effectively utilize surrounding context information to accurately infer various crack patterns, and to secure high performance with minimal data, a model that has been pre-trained on a large-scale dataset is fine-tuned with a similar open dataset, and then transfer learning is performed with an actual dataset, thereby effectively learning the general characteristics of various images and the characteristics of photos (videos) taken with a crack photographing device (600), thereby securing the generalization performance of the model and drastically reducing the learning time.

[0119] Augmentation of data allows for maximum learning with minimal data, and by providing diversity to the dataset, it alleviates the most common overfitting problem in deep learning models, thereby improving the robustness of the model. However, there is no generally accepted technique, and it must be implemented directly to suit the characteristics of the present invention.

[0120] Due to the nature of the present invention, it is necessary to measure the crack width at a fixed point (location) using the same standard and track the change, and the process of deriving the crack width from the captured photograph is as follows.

[0121] The artificial intelligence analysis unit (810) ① divides the photo into two outlines forming a crack in order to derive the crack width, ② sets a fixed point (point) on one outline as a reference point to be a measurement standard, ③ calculates the shortest distance from the set reference point to the other outline, and derives the shortest distance by calculating the Euclidean distance between the intersections with the other outline that occur according to the angle change from the reference point, and ④ stores the reference point and angle used to derive the shortest distance, and derives the shortest distance by using the same reference point and angle as is when analyzing a photo taken by the same crack photographing device (600) in the future.

[0122] Here, the shortest distance corresponds to the number of pixels between two points, which can be converted to mm by multiplying it by the pixel density (Pixelspermillimeter) of the crack photographing device (600) of the present invention.

[0123] The report generation unit (820) generates a report based on the analysis results of the artificial intelligence analysis unit (810).

[0124] The report generation unit (820) receives project-related information, sub-site information, and identification information (identification code, identification number, or identification name) that can distinguish the crack photographing device (600) transmitted to the web server (800) via the user terminal (700), and receives the photos used for analysis and the crack width derived by the artificial intelligence analysis unit (810) from the artificial intelligence analysis unit (810).

[0125] In addition, the report generation unit (820) generates a report including project-related information, sub-site information, photos used for analysis, crack width, number of shots taken, shooting date, and identification information of the crack shooting device (600) in response to a report generation request from the user terminal (700), and stores the report in the database unit (830).

[0126] When a safety inspection operator, facility owner, or manager accesses a web server (800) through a user terminal (700), the contents of a report related to the facility can be checked. FIG. 9 is an example of a report generated by the web server (800), and the location of the measuring device corresponding to the crack photographing device (600) can be visually checked, and the measured values ​​and displacement amount can be checked by order for each measuring device.

[0127] In addition, Fig. 10 is an example of a report generated by a web server (800), in which the captured photos and measurement values ​​can be checked along with the shooting time.

[0128] The database unit (830) stores the report generated by the report generation unit (820) along with project-related information, sub-site information, and photo data transmitted via the user terminal (700).

[0129] As described above, specific embodiments of the present invention have been described with reference to the attached drawings, but the scope of protection of the present invention is not necessarily limited to these embodiments, and various design changes, additions or deletions of known technologies, simple numerical limitations, etc., within the scope that does not change the technical gist of the present invention, also fall within the scope of protection of the present invention.

Claims

1. Regarding a crack gauge that is attached to a location to measure cracks in a structure and operates in conjunction with a smartphone. A housing (100) in the shape of a case with an open bottom and providing an internal space; A magnet (110) attached to the upper outer surface of the housing (100); A lower cover (200) coupled to the open lower part of the housing (100) and serving as a cover for the housing (100); A PCB assembly (300) installed in an internal space formed by the above housing (100) and the lower cover (200); A battery (400) installed in the internal space formed by the housing (100) and the lower cover (200) and supplying power required for the operation of the PCB assembly (300); and An inner cover (500) installed in the inner space of the lower cover (200) and acting as a barrier to isolate the inner space of the housing (100) in which the PCB assembly (300) and the battery (400) are installed from the lower cover (200); Including, The above PCB assembly (300) has a camera (310) installed in a direction facing the lower cover (200); Includes, The lower cover (200) above has a camera shooting window (210) with a portion corresponding to the camera (310) cut out; This is provided, The inner cover (500) has an inner transparent window (510) with a portion corresponding to the camera (310) cut out; This is provided, On the lower surface of the inner cover (500), A support pillar (540) protruding toward the lower cover (200); This is provided, On the inner surface of the lower cover (200), there is a support pillar receiving groove (230) corresponding to the support pillar (540); This is provided, The end of the support pillar (540) coupled to the support pillar receiving groove (230) has a ball shape, so that when the lower cover (200) is attached to the surface of the structure, the lower cover (200) tilts according to the curvature or deviation of the surface of the structure, thereby minimizing the gap between the edge of the housing (100) and the surface of the structure. In the above PCB assembly (300), A smartphone-linked IoT crack gauge characterized in that it is provided with a magnetic switch function that blocks the power of the battery (400) from being supplied to the PCB assembly (300) when the magnet (110) is attached to the upper outer surface of the housing (100), and supplies the power of the battery (400) to the PCB assembly (300) when the magnet (110) is separated from the upper outer surface of the housing (100), thereby fundamentally preventing unnecessary power consumption of the battery (400) before it is mounted on the surface of the structure.

2. In paragraph 1, A protective lens (520) made of a transparent material that protects the camera (310) is attached to the internal transparent window (510). The outer surface of the lower cover (200) is divided into a first area (201) equipped with a camera shooting window (210) and a second area (202) for attaching the lower cover (200) to the surface of the structure, and an attachment bond is applied only to the second area (202) for attaching the lower cover (200) to the surface of the structure. A smartphone-linked IoT crack gauge characterized in that an elastic buffer ring (220) is provided around the camera shooting transparent window (210), and when the lower cover (200) is attached to the surface of the structure, the buffer ring (220) is pressed against the surface of the structure, thereby sealing the area around the camera shooting transparent window (210).

3. In paragraph 1 or 2, The above PCB assembly (300) is When the magnet (110) is separated and supplied with power from the battery (400), the camera (310) is operated according to a preset cycle to take pictures of the crack area and store them in the internal memory. A smartphone-linked IoT crack gauge characterized in that it switches to sleep mode during times when the camera (310) is not taking pictures, thereby minimizing discharge of the battery (400).

4. In paragraph 3, The above PCB assembly (300) is equipped with a short-range wireless communication function, A smartphone-linked IoT crack gauge characterized in that when a smartphone operating a web application linked to the PCB assembly (300) approaches the PCB assembly (300) within a preset distance, a video file of a crack area stored in the internal memory of the PCB assembly (300) is transmitted to the smartphone.

5. In paragraph 3, The above PCB assembly (300) Emergency power port (320) that can temporarily supply external power; is equipped, A smartphone-linked IoT crack gauge characterized in that one side of the housing (100) is cut open at a location corresponding to the emergency power port (320).

6. Regarding a crack measurement system that photographs and analyzes cracks in facilities, A crack photographing device (600) installed in a facility to take pictures of crack areas; A user terminal (700) connected to the crack photographing device (600) via short-range wireless communication, capable of controlling the operation of the crack photographing device (600) via short-range wireless communication, and receiving a photo taken by the crack photographing device (600); and A web server (800) that receives a photo or work request from the user terminal (700) through a web application installed on the user terminal (700), stores or analyzes the photo received from the user terminal (700) to derive the crack width, generates a report analyzing the photo, and transmits the report generated according to the work request of the user terminal (700) to the user terminal (700); Includes, The above user terminal (700) is By connecting to the above web server (800) and authenticating the user, a project for each facility can be created or an already created project can be loaded. You can enter sub-site information for each project, The generated project-related information and sub-site information are stored in the above web server (800). When creating a project through the user terminal (700) above, you can enter information about the project name, construction company name, and type of work (crack management, field investigation, building management, etc.) to distinguish it from other projects. A crack measurement system for a facility, characterized in that when inputting sub-site information through the user terminal (700), address information is input to distinguish it from other sub-sites, and information on a panoramic photo, a surrounding photo, a layout plan, or a surrounding map is input by directly taking a picture using a camera function provided in the user terminal (700) or uploading a picture stored in the user terminal (700).

7. Regarding a crack measurement system that photographs and analyzes cracks in a facility, A crack photographing device (600) installed in a facility to take pictures of crack areas; A user terminal (700) connected to the crack photographing device (600) via short-range wireless communication, capable of controlling the operation of the crack photographing device (600) via short-range wireless communication, and receiving a photo taken by the crack photographing device (600); and A web server (800) that receives a photo or work request from the user terminal (700) through a web application installed on the user terminal (700), stores or analyzes the photo received from the user terminal (700) to derive the crack width, generates a report analyzing the photo, and transmits the report generated according to the work request of the user terminal (700) to the user terminal (700); Includes, The above user terminal (700) is In order to distinguish a plurality of the above crack photographing devices (600), identification information (identification code, identification number or identification name) is assigned to each crack photographing device (600). Each of the above crack photographing devices (600) is selected and operated as needed, and Receive the photos taken by the above crack photographing device (600) and assign a unique file name, number of shots taken, and shooting date to each photo, A photo with a unique file name, number of shots taken, and date of shooting is transmitted to the web server (800) or temporarily stored in the user terminal (700). When the location of the above crack photographing device (600) is changed or removed, the identification information of the corresponding crack photographing device (600) can be selected to remove the connection information with the user terminal (700). A crack measurement system for a facility, characterized in that when the connection information between the corresponding crack photographing device (600) and the user terminal (700) is deleted, the existing crack photographing device (600) is linked and assigned a unique file name, number of shots, and shooting date, and then the photos stored in the web server (800) and the report analyzing the photos are deleted together.

8. Regarding a crack measurement system that photographs and analyzes cracks in facilities, A crack photographing device (600) installed in a facility to take pictures of crack areas; A user terminal (700) connected to the crack photographing device (600) via short-range wireless communication, capable of controlling the operation of the crack photographing device (600) via short-range wireless communication, and receiving a photo taken by the crack photographing device (600); and A web server (800) that receives a photo or work request from the user terminal (700) through a web application installed on the user terminal (700), stores or analyzes the photo received from the user terminal (700) to derive the crack width, generates a report analyzing the photo, and transmits the report generated according to the work request of the user terminal (700) to the user terminal (700); Includes, The above web server (800) is An artificial intelligence analysis unit (810) that detects and analyzes cracks by executing a deep learning model on a photo transmitted through the user terminal (700) to derive the crack width; A report generation unit (820) that generates a report based on the analysis results of the artificial intelligence analysis unit (810); and A database unit (830) that stores the report generated by the report generation unit (820) along with project-related information, sub-site information, and photo data transmitted through the user terminal (700); Includes, The above artificial intelligence analysis unit (810) To derive the crack width, the crack is divided into two outlines in the photo, Set a fixed point (point) on the one-sided outline as the reference point to serve as the measurement standard, A crack measurement system for a facility characterized in that the shortest distance from a set reference point to the other side contour is calculated, and the shortest distance is derived by calculating the Euclidean distance between intersections with the other side contour that occur according to changes in angle from the reference point, and the reference point and angle used to derive the shortest distance are stored, and the shortest distance is derived by using the same reference point and angle as is when analyzing a photograph taken by the same crack photographing device (600) at a later time.

9. Regarding a crack measurement system that photographs and analyzes cracks in facilities, A crack photographing device (600) installed in a facility to take pictures of crack areas; A user terminal (700) connected to the crack photographing device (600) via short-range wireless communication, capable of controlling the operation of the crack photographing device (600) via short-range wireless communication, and receiving a photo taken by the crack photographing device (600); and A web server (800) that receives a photo or work request from the user terminal (700) through a web application installed on the user terminal (700), stores or analyzes the photo received from the user terminal (700) to derive the crack width, generates a report analyzing the photo, and transmits the report generated according to the work request of the user terminal (700) to the user terminal (700); Includes, The above web server (800) is An artificial intelligence analysis unit (810) that detects and analyzes cracks by executing a deep learning model on a photo transmitted through the user terminal (700) to derive the crack width; A report generation unit (820) that generates a report based on the analysis results of the artificial intelligence analysis unit (810); and A database unit (830) that stores the report generated by the report generation unit (820) along with project-related information, sub-site information, and photo data transmitted through the user terminal (700); Includes, The above report generation unit (820) Project-related information, sub-site information, and identification information (identification code, identification number, or identification name) that can distinguish the crack photographing device (600) are received through the user terminal (700) and transmitted to the web server (800). Receive the photo and crack width used for analysis from the above artificial intelligence analysis unit (810), A system for measuring cracks in a facility, characterized in that, in response to a request for report generation from the user terminal (700), a report including project-related information, sub-site information, photos used for analysis, crack width, number of shots, shooting date, and identification information of the crack photographing device (600) is generated and stored in the database unit (830), and the report can be confirmed by accessing the web server (800) through the user terminal (700).

10. In any one of paragraphs 6 to 9, The above crack photographing device (600) is A crack measurement system for a facility, characterized by having a function for taking pictures of a crack area, a function for enabling short-range wireless communication with the user terminal (700), and a function for supplying power necessary for the operation of the crack photographing device (600).

Citation Information

Patent Citations

  • Electronic camera and photographic device using the same

    JP1994153204A

  • Bulb mounting tool

    JP2013191332A

  • Server device, image processing method, and image processing system

    JP2022000646A

  • Method for Safety Inspection and Maintenance of Infrastructure Based Information Communication Technology

    KR101606002B1

  • Information exchange support system for collaborative design work

    KR1020100053227A