Leak inspection device, information processing device and program

Abstract

To reduce the deviation between a measurement point on data and a measurement point on a site.SOLUTION: A leakage inspection device used on a site for inspecting leakage of fluid from a pipe is provided with a control section that displays a whole image of the site on a work screen and a receiving section that receives a partial area on the whole image as a measurement point. The control section associates measured vibration data with the measurement point on the whole image.SELECTED DRAWING: Figure 17

Description

[Technical Field]

[0001] The present invention relates to a leak inspection device, an information processing device, and a program. [Background technology]

[0002] At the site where leaks are being inspected, vibration data is recorded for each measurement point, and any suspected leaks are recorded. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-164613 Summary of the Invention [Problem to be solved by the invention]

[0004] It is possible to link the location of suspected leaks to records determined by GPS (Global Positioning System), but the distance accuracy of GPS available for private use is only about 10 meters. This makes it insufficient for pinpointing leak locations. It is also possible to improve the accuracy of GPS locations by using special equipment, but this equipment is expensive. Furthermore, even if you want to check the results of analyzing the vibration data recorded at each measurement point and the positional relationship of the measurement points after the fact, existing products have low position reproducibility due to the low accuracy of the recorded positions.

[0005] The present invention aims to reduce the discrepancy between measurement points on the data and measurement points on site. [Means for solving the problem]

[0006] The invention described in claim 1 is a leak inspection device used by an operator at a site where fluid leaks from pipes are inspected, and includes a control unit that displays an overall image of the site on a work screen, and a reception unit that accepts partial areas on the overall image as measurement points, wherein the control unit links measured vibration data to the measurement points on the overall image, and the control unit synthesizes and displays a virtual section on the overall image, and sets the position of the section selected by the operator as the measurement point. A second aspect of the present invention is the leak test device according to the first aspect, wherein the control unit receives settings for the entire image in an initial step of the on-site test. The invention described in claim 3 is the leak test device described in claim 1, wherein the number and arrangement of the compartments are set in advance. A fourth aspect of the present invention is the leak test device according to the first aspect, wherein the number and arrangement of the sections are automatically set in accordance with information on the scale of the entire image. A fifth aspect of the invention is the leak test device according to the first aspect, wherein the number and arrangement of the sections are set according to the size of the entire image displayed on the work screen. The invention as set forth in claim 6 is the leak test device as set forth in any one of claims 3 to 5, wherein the number and arrangement of the compartments can be changed by an operator. The invention described in claim 7 is a leak testing device described in any one of claims 1 to 6, wherein the control unit displays, for each of the measurement points on the overall image, the analysis results of the vibration data linked to that measurement point. An eighth aspect of the present invention is the leak test device according to the seventh aspect, wherein the control unit displays the section corresponding to the measurement point in a color according to the analysis result. The invention described in claim 9 is a leak testing device described in any one of claims 1 to 8, wherein the control unit links a photograph of the site that is different from the overall image and that was taken when measuring the measurement point. The invention described in claim 10 is the leak test device described in any one of claims 1 to 9, wherein the control unit has an interface for registering a specific measurement point on the entire image as a leak point. Claim 11 The invention described in is an information processing device that works in conjunction with a leak inspection device used at a site where fluid leaks from pipes are inspected, and has a control unit that displays an overall image of the site on the work screen of the leak inspection device, and a reception unit that receives partial areas on the overall image as measurement points through the leak inspection device, wherein the control unit links measured vibration data to the measurement points on the overall image, and the control unit synthesizes and displays a virtual section on the overall image, and sets the position of the section selected by the worker as the measurement point. Claim 12 The invention described in is a program for enabling a computer used to inspect fluid leaks from pipes to have the following functions: display an overall image corresponding to the site on a work screen; accept partial areas on the overall image as measurement points; link measured vibration data to the measurement points on the overall image; synthesize and display a virtual section on the overall image; and set the position of the section selected by the worker as the measurement point. [Effects of the Invention]

[0007] According to the invention of claim 1, since the partial area candidates are displayed as partitions, it becomes easy to specify the measurement points. According to the invention of claim 2, the display of the image used to specify the measurement points can be completed in the initial work, thereby improving workability. According to the invention of claim 3, there is no need to set the number and arrangement of sections each time work is performed, thereby improving workability. According to the invention described in claim 4, the number and arrangement of sections can be optimized according to the scale of the image. According to the invention of claim 5, the number and arrangement of the sections can be adjusted according to the size of the display on the work screen, thereby improving visibility. According to the invention of claim 6, the number and arrangement of the sections can be optimized depending on the purpose of the inspection, etc. According to the invention of claim 7, the results of analyzing the vibration data can be confirmed in association with the measurement points on site. According to the invention of claim 8, the results of analyzing the vibration data can be confirmed in association with the measurement points on site. According to the invention of claim 9, subsequent on-site inspection can be facilitated. According to the invention of claim 10, the leak point can be registered at the discretion of the on-site worker at the time of measurement. Claim 11 According to the described invention, it is possible to reduce the discrepancy between the measurement points on the data and the measurement points on site. Claim 12 According to the described invention, it is possible to reduce the discrepancy between the measurement points on the data and the measurement points on site. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the conceptual configuration of a water leakage inspection system used in the first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an outline of the connection configuration of the water leakage inspection system used in the first embodiment and the flow of data between devices. [Figure 3] 1A and 1B are diagrams illustrating an example of the hardware configuration of an information terminal and an analysis server used in embodiment 1. FIG. 1A is an example of the configuration of an information terminal, and FIG. 1B is an example of the configuration of an analysis server. [Figure 4] FIG. 2 illustrates an example of a data structure of a database. [Figure 5] 10 is a diagram illustrating an example of a processing operation executed by cooperation between an information terminal and an analysis server when an operator selects a simple measurement mode. FIG. [Figure 6] 10A to 10D are diagrams illustrating an example of transition of operation screens up to the input of site information when the simple measurement mode is selected, where (A) is the initial screen, and (B) to (D) are screens for inputting site information. [Figure 7]10A and 10B are diagrams illustrating an example of the transition of the operation screen after inputting on-site information when the simple measurement mode is selected. (A) is the operation screen used to select whether or not to capture an image of the measurement location, (B) is the operation screen during image capture, (C) is the operation screen for instructing the start of measurement, and (D) is the operation screen indicating that measurement is in progress. [Figure 8] 10A and 10B are diagrams illustrating examples of spectra obtained as a result of analyzing vibration data. (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when there is a suspected possibility of water leakage, and (C) is an example of a spectrum when there is a high possibility of water leakage. [Figure 9] 10A and 10B are diagrams illustrating an example of the transition of the operation screen displayed after the first measurement is completed when the simplified measurement mode is selected. (A) is the operation screen used to select whether to continue the measurement, (B) is the operation screen used to select whether to capture an image of the measurement point, (C) is the operation screen during the image capture, and (D) is the operation screen for instructing the start of the measurement. [Figure 10] 10A and 10B are diagrams illustrating another example of transition of the operation screen displayed after the first measurement is completed when the simplified measurement mode is selected. (A) is the operation screen used to select whether to continue measurement, (B) is the operation screen used to select whether to capture an image of the measurement point, and (C) is the operation screen indicating that measurement is in progress. [Figure 11] 10A and 10B are diagrams illustrating another example of transitions in the operation screen displayed after the second measurement is completed when the simplified measurement mode is selected. (A) is the operation screen immediately after the second measurement is completed, (B) is a selection screen that explains the state when the button labeled "Details" is selected, (C) is a screen that displays details of the analysis results, and (D) is the operation screen after the "Close" button is operated. [Figure 12]10A and 10B are diagrams illustrating another example of transitions in the operation screen displayed after the second measurement is completed when the simplified measurement mode is selected. (A) is the operation screen immediately after the second measurement is completed, (B) is the operation screen illustrating the state in which the check boxes for the first and second analysis results are selected, (C) is a comparison screen for the two selected analysis results, and (D) is the operation screen after the "Close" button is operated. [Figure 13] 10 is a diagram illustrating an example of a processing operation executed by cooperation between the information terminal and the analysis server when an operator selects a detailed measurement mode. FIG. [Figure 14] 10A to 10D are diagrams illustrating an example of transition of operation screens up to the input of construction information when the detailed measurement mode is selected, where (A) is the initial screen, and (B) to (D) are construction information input screens. [Figure 15] 10A to 10C are diagrams illustrating an example of transitions used to input site information when the detailed measurement mode is selected, where (A) to (C) are screens for inputting site information. [Figure 16] 10A and 10B are diagrams illustrating an example of the transition of the operation screen when measuring the entire image of the measurement point when the detailed measurement mode is selected. (A) is the operation screen used to select whether or not to capture the entire image of the measurement point, (B) is the operation screen during capture, (C) is the operation screen after capture, and (D) is the operation screen used to specify the measurement point. [Figure 17] 10A and 10B are diagrams illustrating an example of the transition of operation screens displayed before the first measurement is started when the detailed measurement mode is selected. (A) is the operation screen when setting the measurement location, (B) is the selection screen for imaging the measurement location, (C) is the operation screen immediately after imaging, and (D) is the operation screen for starting measurement. [Figure 18] 10A and 10B are diagrams illustrating an example of the transition of the operation screen when on-site measurements are repeated with the detailed measurement mode selected. (A) is the operation screen indicating that measurement is in progress, (B) is the operation screen displayed immediately after measurement of two measurement locations is completed, (C) is the operation screen displayed immediately after measurement of three measurement locations is completed, and (D) is the operation screen displayed immediately after measurement of six measurement locations is completed. [Figure 19] 1A and 1B are diagrams illustrating an example of an operation screen used to display detailed analysis results of a measurement point, where (A) shows the upper part of the screen and (B) shows the lower part of the screen. [Figure 20] 10A and 10B are diagrams illustrating an example of the transition of the operation screen when the detailed measurement mode is ended, where (A) shows the operation screen when the end of the measurement is instructed, (B) shows the operation screen for specifying how to handle the measurement results, and (C) shows the operation screen used to end the detailed measurement mode. [Figure 21] FIG. 10 is a diagram illustrating an example of the conceptual configuration of a water leakage inspection system used in a second embodiment. [Figure 22] FIG. 10 is a diagram for explaining an outline of the flow of data between devices constituting the water leakage inspection system used in the second embodiment. [Figure 23] 10A and 10B are diagrams illustrating an example of the conceptual configuration of a water leak detection system used in embodiment 3. FIG. 10A is an example of the appearance of the water leak detection system, and FIG. 10B is a diagram illustrating an outline of the data flow between devices that make up the water leak detection system. [Figure 24] FIG. 10 is a diagram illustrating an example of an operation screen used to select the type of image to be used as the whole image. [Figure 25] 10 is a diagram illustrating an example of the display on the operation screen when an aerial photograph taken from above the water leak inspection site, an image taken by a drone, or any similar image is used as the overall image. FIG. [Figure 26] 10A and 10B are diagrams illustrating examples of spectra resulting from analysis of vibration data. (A) is an example of the spectrum when there is no water leakage, (B) is an example of the spectrum when there is a suspected water leakage, and (C) is an example of the spectrum when there is a high possibility of water leakage. [Figure 27] 10A and 10B are diagrams illustrating an example of the transition of the operation screen before and after a change in the mesh structure. (A) shows the entire image combined with the mesh set in the initial settings, (B) shows an example of a screen used to accept changes to the mesh structure, and (C) shows the entire image combined with the changed mesh. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <First Embodiment> <System configuration> FIG. 1 is a diagram illustrating an example of the conceptual configuration of a water leakage inspection system 1 used in the first embodiment.

[0010] The water leak inspection system 1 shown in FIG. 1 is made up of a water leak detection system 10 used at the site of a water leak inspection, an analysis server 40, and a communication network 50. The communication network 50 here is, for example, the Internet or a mobile communication system such as 4G or 5G. Note that part of the communication network 50 also includes a wireless LAN (=Local Area Network) and a wired LAN.

[0011] The water leak detection system 10 shown in Fig. 1 is composed of a water leak detector 20 that measures vibrations at a measurement point, and an information terminal 30 that presents to an operator the results of analyzing the vibrations (hereinafter referred to as "vibration data") measured by the water leak detector 20. The information terminal 30 here is an example of a leak inspection device used on-site. The measurement points here are assumed to be, for example, the surface of an exposed pipe, the ground surface where the pipe is buried, the wall or ceiling of a structure where the pipe is installed, and equipment such as valves. In this embodiment, the points where vibration data is measured are referred to as “measurement points” or “measurement locations.” In this embodiment, the measurement points or measurement locations are determined by workers on-site.

[0012] The piping in this embodiment is assumed to include, for example, water distribution pipes, water supply pipes, drainage pipes, sewer pipes, gas pipes, and refrigerant pipes. Liquids flow through water pipes, drainage pipes, and sewer pipes, while gases flow through gas pipes and refrigerant pipes. Examples of liquids include tap water, sewage, rainwater, and cooling water. Furthermore, gases include not only city gas but also gases as fuels or reactants, air, steam, and the like. The term "pipes" also includes pipes through which liquid materials and fuels used in various chemical plants and factories flow. These liquids and gases are examples of fluids that flow through pipes.

[0013] The water leak detector 20 is composed of a metal listening rod 21 that transmits vibrations at the measurement point, a grip 22 that is held by the operator, a vibration sensor 23 that converts the vibration data transmitted from the listening rod 21 into an electrical signal, a communication cable 24, and a device main body 25. The vibration sensor 23 may be, for example, a bone conduction pickup sensor. The device main body 25 has, for example, a built-in rechargeable battery, and the battery supplies the power required for the operation of the vibration sensor 23 and the like.

[0014] The device main body 25 also includes an amplifier that adjusts the gain of vibration data received as an electrical signal from the vibration sensor 23, and a communication device that transmits the amplified vibration data to the information terminal 30. In this embodiment, a USB (Universal Serial Bus) connector is used for the communication device, so that the device main body 25 and the information terminal 30 are electrically connected via a USB cable 24A.

[0015] A notch 26 is provided at the upper end of the device body 25 so as not to interfere with imaging by a camera 35 (see FIG. 3 described later) provided in the information terminal 30. The position and size of the notch 26 are determined depending on the information terminal 30 that is attached to the device body 25 and used. In addition, the device main body 25 also has built-in volume buttons for adjusting the volume when playing vibration data as sound from earphones, a controller for adjusting the signal strength of vibration data input from the vibration sensor 23, a power button, etc.

[0016] In this embodiment, a smartphone is used as the information terminal 30. In addition, the information terminal 30 may be a tablet computer, a notebook computer, a smart watch, smart glasses, or the like that are wirelessly connected via a USB wireless adapter or a Bluetooth (registered trademark) adapter.

[0017] The analysis server 40 is located on the cloud side and performs analysis processing of vibration data. In this embodiment, it generates the spectrum of vibration data, a waveform diagram of the spectrum, and the like, and also has the function of calculating the possibility that the measurement point is a leak location in numerical value such as a percentage. For example, artificial intelligence for determining water leakage is provided in the analysis server 40. The artificial intelligence is realized as a learning model that learns from vibration data at the water leakage point as training data.

[0018] When vibration data is input into the learning model, the possibility of a water leak is output as a numerical value such as a percentage. It is desirable for the learning model to learn from vibration data that corresponds to the pipe material, the type of equipment used for measurement, the estimated depth of the pipe, the density of the soil in which the pipe is buried, the diameter of the pipe, the water pressure, and the condition of the measurement surface as training data. The learning algorithm uses, for example, a neural network.

[0019] <Circuit configuration> FIG. 2 is a diagram for explaining an outline of the connection configuration of the water leakage inspection system 1 used in the first embodiment and the flow of data between the devices. In the water leak detector 20, vibration data is provided from the vibration sensor 23 to the main circuit 25A of the device main body 25. The main circuit 25A here is equipped with an amplifier that electronically amplifies the vibration data. The gain of the amplifier in this embodiment can be switched between three levels by operating a switch. In one measurement, vibration data is acquired for approximately 5 seconds.

[0020] The main circuit 25A is provided with a bandpass filter that selectively extracts a frequency band that contains many vibration components due to water leakage. For example, a bandpass filter with a passband of approximately 100 Hz to 4 kHz is used. However, vibration data in the frequency band that passes through the bandpass filter includes environmental sounds in addition to the water leakage sound. Environmental sounds depend on the measurement point and become noise when detecting the water leakage sound.

[0021] The vibration data amplified by the main circuit 25A is output to the information terminal 30. The information terminal 30 adds the measurement time, on-site information, etc. to the acquired vibration data and transmits it to the analysis server 40. The analysis server 40 generates a spectrum of the vibration data and transmits to the information terminal 30 the possibility that the measurement point is a water leak location as an analysis result. It takes about 15 to 20 seconds for the information terminal 30 to acquire the analysis results from the analysis server 40. However, this time varies depending on the communication environment and the processing capacity of the analysis server 40. The information terminal 30 displays the acquired analysis results to the workers on-site in real time.

[0022] <Hardware configuration> 3A and 3B are diagrams illustrating an example of the hardware configuration of the information terminal 30 and the analysis server 40 used in the first embodiment. Illustrated in (A) is an example of the configuration of the information terminal 30, and (B) is an example of the configuration of the analysis server 40. The information terminal 30 shown in Figure 3(A) is composed of a processor 31 that controls the operation of the entire device, a RAM (Random Access Memory) 32 used as the main storage device, a flash memory 33 which is a non-volatile semiconductor memory, a touch panel 34, a camera 35, and a communication module 36 used for communication with an analysis server 40, etc. In this embodiment, the processor 31 is configured with a CPU (=Central Processing Unit) and a GPU (=Graphics Processing Unit), and realizes various functions through the execution of programs.

[0023] One of the functions is to acquire vibration data at measurement points during inspection work. This function corresponds to the "acquisition unit" in the claims. Another function is to transmit the acquired vibration data to a predetermined analysis server 40 via the communication module 36 . Another function is to display an operation screen to assist the operator in the inspection work. This function also includes a function to display the spectrum obtained as the analysis result on the touch panel 34. This function corresponds to the "controller" in the claims.

[0024] The RAM 32 is used as an execution area for programs. The flash memory 33 stores the BIOS (=Basic Input Output System), firmware, an application program for leak detection, vibration data, etc. The vibration data is deleted after it has been uploaded to the analysis server 40. Therefore, if uploading of the vibration data to the analysis server 40 is not completed due to poor communication or the like, the vibration data is stored in the flash memory 33.

[0025] The touch panel 34 is composed of a display and a capacitance type touch sensor arranged on the surface of the display. The display may be, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. A touch sensor is a device that is highly transparent to light, so it can detect a tap operation or the like by a worker without interfering with the worker's vision.

[0026] The camera 35 uses, for example, a CMOS (=Complementary Metal Oxide Semiconductor) image sensor. The communication module 36 uses a device that complies with a mobile communication system such as USB (=Universal Serial Bus), wireless LAN, Bluetooth, 4G, or 5G. In this embodiment, the processor 31, RAM 32, and flash memory 33 constitute a so-called computer.

[0027] 3(B) is composed of a processor 41 that controls the operation of the entire device, a RAM 42 used as a main storage device, a ROM (Read Only Memory) 43 in which the BIOS and the like are recorded, a hard disk drive 44 used as a secondary storage device, and a communication module 45 used for communication with a communication network 50. These devices are connected via a signal line 46 such as a bus.

[0028] In addition to the display, devices such as a keyboard and a mouse may be connected to the analysis server 40. Furthermore, the analysis server 40 does not have to be a single server, but may be a collection of multiple servers with different roles and functions.

[0029] The processor 41 is composed of a CPU and realizes various functions by executing programs. In the present embodiment, some of the functions include a function to store the acquired vibration data in association with the site, a function to analyze the acquired vibration data and return it to the information terminal 30 at the site, etc. The analysis results are stored in the hard disk drive 44.

[0030] A database 400 for leak detection (see FIG. 4, which will be described later) is stored in the hard disk drive 44. The database 400 stores vibration data, analysis results, and the like uploaded from the site, linked to measurement points. In addition, the hard disk drive 44 also stores an operating system and an application program for analysis. However, instead of the hard disk drive 44, a large-capacity semiconductor memory may be used.

[0031] The communication module 45 uses a device that complies with a mobile communication system such as wireless LAN, Ethernet (registered trademark), 4G, or 5G. In this embodiment, the processor 41, RAM 42, and ROM 43 constitute a so-called computer.

[0032] <Database data structure example> FIG. 4 is a diagram showing an example of the data structure of the database 400. As shown in FIG. The data structure shown in Fig. 4 is an example, and other items may be included instead of the displayed items. Also, items not shown in Fig. 4 may be included. The site ID 401 is an ID used to link with information that identifies the site of the leak inspection. The ID here is linked to the name, address, etc. of the site of the leak inspection. The name, address, etc. of the site of the leak inspection are stored in a separate table.

[0033] The examination date is stored in the examination date 402. In Fig. 4, the examination date is specified by the month and day, but the examination date in the data is stored including the examination year. The entire image ID 403 is an ID used to link with an image including the entire area of ​​the site to be inspected. In this embodiment, an image, drawing, etc. corresponding to the site periphery used to identify measurement points is called an "entire image."

[0034] The overall image may include images captured by the information terminal 30 (see Figure 1) or other terminals, aerial photographs, photographs taken by a drone from above the site (hereinafter also referred to as "aerial photographs"), drawings such as construction drawings and blueprints of the site, scanned maps, and digital maps. The whole image to be used is specified by the operator at the start of the inspection.

[0035] The in-mesh position information 404 is information that indicates the position within a virtual mesh that is combined with the entire image to identify the measurement point. If the mesh is composed of 10 rows and 10 columns of partitions, the in-mesh position information 404 identifies the position of any one of a total of 100 partitions. The partition here defines a specific partial area within the entire image.

[0036] In the case of FIG. 4, the intra-mesh position information 404 is given as coordinates within the mesh. "10*10" in the figure means the section in the 10th row and 10th column. The origin of the coordinates is predetermined. For example, if the north direction is the top of the image, the upper left corner of the image is set as the origin.

[0037] The measurement point ID 405 is an ID for managing the measurement point. In the case of the database 400 shown in Fig. 4, the measurement points in the first and second rows are the same. This means that two measurements were performed for the same measurement point. The time at which the vibration data was measured is recorded in the measurement time 406. For example, the time at which the information terminal 30 acquired the vibration data is used as the measurement time 406. The vibration data ID 407 is an ID that identifies the vibration data stored in the storage area.

[0038] The captured image ID 408 is an ID that identifies an image captured at a site by linking it to a measurement point. If multiple images are captured, multiple IDs are recorded. The analysis waveform ID 409 is an ID that identifies the spectrum of the vibration data stored in the hard disk drive 44 (see FIG. 3(B)). A spectrum is a characteristic diagram with frequency on the horizontal axis and sound pressure (dB) on the vertical axis. A spectrum is a characteristic diagram with time on the horizontal axis and frequency on the vertical axis, and the difference in sound pressure (dB) for each frequency at each time is expressed by different colors.

[0039] A numerical value indicating the probability that the measurement point is a leak location is recorded in the leak probability 410. In this embodiment, the possibility of a leak location is given as a percentage. Note that instead of or together with the leak probability 410, a classification of the leak possibility may be recorded. The analytical waveform and leakage probability shown here are both examples of analysis results. In the water leakage location setting 411, information on whether or not the worker has set the location as a water leakage location is recorded.

[0040] <Processing operation> <Simple measurement mode> The processing operations and transitions of operation screens executed when the simple measurement mode is selected will be described below with reference to Figures 5 to 12. Note that the operation screens and transitions between screens described below are all examples. In this embodiment, the simplified measurement mode is a measurement mode used to narrow down the pipeline systems that are likely to have a water leak. The purpose of this measurement mode is to narrow down the pipeline systems that may have a water leak, so even if the analysis server 40 (see FIG. 1) analyzes the vibration data, the vibration data is not stored.

[0041] 5 is a diagram illustrating an example of a processing operation that is executed in cooperation between the information terminal 30 and the analysis server 40 when the operator selects the simple measurement mode. Note that the symbol S in the diagram represents a step. 6 to 12 show examples of transitions of operation screens displayed on the information terminal 30 (see FIG. 1) when the simple measurement mode is selected.

[0042] The processing shown in FIG. 5 is realized through the execution of a program by the processor 31 of the information terminal 30 (see FIG. 3(A)) or the processor 41 of the analysis server 40 (see FIG. 3(B)). First, the information terminal 30 accepts the selection of a measurement mode on the initial screen (Step 1). In addition to the simple measurement mode, the options include a detailed measurement mode. The detailed measurement mode is a measurement mode used to narrow down points where there is a high possibility of a water leak. When the selection is accepted, the information terminal 30 determines whether or not the mode is the simple measurement mode (step 2). If the simple measurement mode has been selected as the measurement mode, the information terminal 30 obtains a positive result in step 2. The information terminal 30 that obtains a positive result in step 2 accepts input of on-site information (step 3).

[0043] 6A to 6D are diagrams illustrating an example of transition of operation screens up to the input of site information when the simple measurement mode is selected. (A) is an initial screen 300A, and (B) to (D) are site information input screens 300B to 300D. An initial screen 300A shown in Fig. 6(A) has a button 301 labeled "Simple Measurement" and a button 302 labeled "Detailed Measurement." In Fig. 6(A), the selected state of button 301 is indicated by shading.

[0044] An input screen 300B shown in FIG. 6(B) is used to input the material of the pipes buried or exposed at the site. The input screen 300B has a material selection field 303, a button 304 with a left-pointing arrow that means "back," a button 305 with a right-pointing arrow that means "forward," and a "cancel" button 306. In the case of Fig. 6(B), five options, namely, steel pipe, plastic pipe, PVC pipe, other, and unknown, are displayed in the selection field 303. Of course, these are just examples. When button 304 is operated, the screen transitions to initial screen 300A. On the other hand, when button 305 is operated, the screen transitions to input screen 300C shown in Fig. 6(C). Checking a checkbox may be required to transition to input screen 300C. The same applies to the other input screens 300C and 300D.

[0045] An input screen 300C shown in FIG. 6(C) is used for inputting information about a measuring device. Input screen 300C has a selection field 307 for the device to be used to measure vibration data, a button 304 with a left-pointing arrow meaning "back," a button 305 with a right-pointing arrow meaning "forward," and a "cancel" button 306. In the case of Figure 6(C), three options are displayed in the selection field 307: "listening rod," "flat placement," and "don't know." Here, "flat placement" means removing the vibration sensor 23 (see Figure 1) from the listening rod 21 (see Figure 1) and placing it directly at the measurement point. Of course, the options are just examples. When button 304 is operated, the screen transitions to the previous input screen 300B. On the other hand, when button 305 is operated, the screen transitions to input screen 300D shown in FIG.

[0046] An input screen 300D shown in FIG. 6(D) is used to input the measurement depth. Input screen 300D has a depth selection field 308, a button 304 with a left-pointing arrow meaning "back," a button 305 with a right-pointing arrow meaning "forward," and a "cancel" button 306. In the case of Figure 6(D), seven options are displayed in the selection field 308: 20cm, 40cm, 60cm, 80cm, 150cm, 200cm, and 250cm. Of course, this is just one example. An option of "I don't know" may also be provided. When button 304 is operated, the screen transitions to the previous operation screen 300C. On the other hand, when button 305 is operated, the screen transitions to operation screen 300E shown in Fig. 7(A).

[0047] Returning to the explanation of Figure 5. When the input of the site information is completed in step 3, the information terminal 30 determines whether or not to capture an image of the measurement location (step 4). If a positive result is obtained in step 4, the information terminal 30 acquires the captured image (step 5). The image is captured using, for example, the camera 35 of the information terminal 30 (see FIG. 3(A)). In the simple measurement mode, the captured image data is used exclusively for confirmation during on-site work.

[0048] When an image is acquired in step 5, or when a negative result is obtained in step 4, the information terminal 30 starts measurement (step 6) and transmits the measured vibration data and the like to the analysis server 40 (step 7). Here, in addition to the vibration data, site information is also uploaded. When the vibration data etc. are received, the analysis server 40 analyzes the vibration data (step 8). When the analysis process is completed, the analysis server 40 transmits the analysis results to the information terminal 30 (step 9).

[0049] The information terminal 30 receives the analysis results from the analysis server 40 and displays the analysis results (step 10). Thereafter, the information terminal 30 determines whether or not to continue measuring (step 11). If a positive result is obtained in step 11, the information terminal 30 returns to step 4. On the other hand, if a negative result is obtained in step 11, the information terminal 30 ends the inspection process.

[0050] It takes about 15 to 20 seconds from the transmission of the vibration data until the analysis server 40 notifies the information terminal 30 of the analysis results. Therefore, it is possible to start the next measurement immediately after the analysis results are displayed. In this embodiment, the spectrum of the vibration data is displayed as the analysis result. When the analysis result is displayed, it is also possible to display the results of multiple analyses for comparison.

[0051] 7 is a diagram illustrating an example of the transition of the operation screen after inputting site information when the simplified measurement mode is selected. (A) is operation screen 300E used to select whether or not to capture an image of the measurement location, (B) is operation screen 300F while capturing an image, (C) is operation screen 300G for instructing the start of measurement, and (D) is operation screen 300H indicating that measurement is in progress. 7(A) has arranged thereon a button 309 labeled "Take image of measurement point," a button 310 labeled "Do not take image," and a button 311 labeled "Stop measurement." In FIG. 7(A), the selected state of button 309 is indicated by shading.

[0052] When button 310 is selected, information terminal 30 immediately starts measuring vibration data. In this case, operation screen 300E transitions to operation screen 300H. On the other hand, when the button 311 is operated, the information terminal 30 transitions to the initial screen 300A (see FIG. 6(A)). An operation screen 300F shown in FIG. 7(B) displays an image of a subject 312 within the imaging field of view of the camera 35 (see FIG. 3(A)). In the case of FIG. 7(B), an image of the vibration sensor 23 (reference numeral omitted in the figure) placed flat on the floor, which is the measurement location, is captured. When the imaging button 313 is tapped, the image of the subject 312 at the time of tapping is acquired as an image of the measurement location.

[0053] On the operation screen 300G shown in FIG. 7(C), a button 314 labeled "Start measurement" and a button 315 labeled "Stop measurement" are displayed on the screen. When button 314 is selected, operation screen 300G transitions to operation screen 300H. Operation screen 300H shown in FIG. 7(D) displays a waveform display field 316 showing the sound pressure change in the time axis direction of the vibration data, and icon 317 showing that measurement is in progress. In this embodiment, the vibration at the measurement location is measured for about 5 seconds. The measured vibration data is automatically uploaded from the information terminal 30 to the analysis server 40 (see FIG. 1).

[0054] Figure 8 shows an example of a spectrum resulting from the analysis of vibration data. (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when there is a suspected possibility of water leakage, and (C) is an example of a spectrum when there is a high possibility of water leakage. The spectrum when there is no water leak is almost flat, but the spectrum where there is a suspected water leak has whisker-like spikes superimposed in the frequency band enclosed by the dashed line. This is thought to be caused by temporary vibrations detected at the site, such as wind or noise. This is what is known as noise. The effect of noise may be distinguishable by acquiring vibration data multiple times. The spectrum indicating a high possibility of a water leak contains a steady, continuous high sound pressure in the frequency band indicated by the dashed line. This type of waveform is characteristic of a water leak.

[0055] <When the second measurement starts consecutively> 9 is a diagram illustrating an example of the transition of the operation screens displayed after the first measurement is completed when the simplified measurement mode is selected. (A) is an operation screen 300I used to select whether or not to continue measuring, (B) is an operation screen 300E used to select whether or not to image the measurement location, (C) is an operation screen 300F during imaging, and (D) is an operation screen 300G for instructing the start of measurement. In FIG. 9, parts corresponding to those in FIG. 7 are assigned the same reference numerals.

[0056] 9(A) is arranged with a button 318 labeled "Continue measurement," a button 319 labeled "End," a display field 320 for the analysis results of the first measurement, and a button 321 labeled "Details." In FIG. 9(A), the selected state of button 318 is indicated by shading. When button 318 is selected, a measurement similar to the first measurement is started. When button 319 is selected, the measurement of vibration data is immediately terminated and the screen transitions to the initial screen 300A.

[0057] In the analysis result display field 320, the time when the first measurement was performed and the completion of transmission of vibration data to the analysis server 40 are written alongside check boxes for selection. In the case of the operation screen 300I shown in FIG. 9(A), 16:31 is shown as the first measurement time. When button 321 is selected, the details of the analysis results of the first vibration data are displayed.

[0058] The operation screen 300E shown in Fig. 9(B) is the same as the operation screen 300E in Fig. 7(A). In Fig. 9(B) as well, the button 309 labeled "Take an image of the measurement point" is selected. Operation screen 300F shown in Fig. 9(C) is the same as operation screen 300F in Fig. 7(B). When image capture button 313 is tapped in Fig. 9(C), operation screen 300F transitions to operation screen 300G shown in Fig. 9(D). The screen transition after measurement starts is the same as that for the first image capture, so a description thereof will be omitted.

[0059] <When not measuring the image of the measurement point> Figure 10 is a diagram illustrating another example of the transition of the operation screen displayed after the first measurement is completed when the simplified measurement mode is selected. (A) is operation screen 300I used to select whether or not to continue measuring, (B) is operation screen 300E used to select whether or not to capture an image of the measurement location, and (C) is operation screen 300H indicating that measurement is in progress. In Figure 10, parts corresponding to those in Figures 7 and 9 are assigned the same reference numerals. 10(A) and (B), button 310 labeled "Do not capture image" is selected after button 318 is selected. As a result, operation screen 300E transitions to operation screen 300H shown in FIG. 10(C), and recording of vibration data begins.

[0060] <If the Details button is pressed after the second measurement is completed> 11 is a diagram illustrating another example of transitions in the operation screen displayed after the second measurement is completed when the simplified measurement mode is selected. (A) is the operation screen 300J immediately after the second measurement is completed, (B) is the selection screen 300J illustrating the state in which the button 321A labeled "Details" is selected, (C) is the detailed display screen 300K of the analysis results, and (D) is the operation screen 300J after the "Close" button 325 is operated. In FIG. 11, parts corresponding to those in FIG. 9 are denoted by the same reference numerals.

[0061] The operation screen 300J shown in FIG. 11(A) displays display fields 320A and 320B for two analysis results, and corresponding buttons 321A and 321B labeled "Details." Note that in FIG. 11(A), the second analysis result has already been notified from the analysis server 40. Therefore, display field 320B shows that the second measurement time was 16:32 and that the possibility of a leak location is 0%. Note that in FIG. 11(A), neither button has been selected.

[0062] On the operation screen 300J shown in FIG. 11(B), a button 321A corresponding to a display field 320A for the first analysis result is selected. When button 321A is selected, operation screen 300J shown in FIG. 11(B) transitions to detailed display screen 300K shown in FIG. 11(C). The detailed display screen 300K shown in Figure 11(C) displays a spectrum 322 of the vibration data recorded in the first measurement, a leakage probability field 323 of the first measurement results, an image 324 of the measurement point measured during the first measurement, and a button 325 labeled "Close."

[0063] The detailed display screen 300K displays the spectrum 322, allowing the operator to visually determine the characteristics of the vibration data. Because the characteristics of the vibration data are visualized, there is no need for the skilled artisan to distinguish between the vibration data by listening to them. Furthermore, the detailed display screen 300K indicates in the leak probability column 323 that the first analysis result indicates that there is a 0% chance that the measurement point is a leak point. By referring to the probability, the operator can assist in making his or her own judgment based on the spectrum 322. When the button 325 is operated, the detailed display screen 300K transitions to an operation screen 300J shown in FIG. 11(D).

[0064] 11(D), a button 319 labeled "End" is selected. When button 319 is selected, the measurement of vibration data is immediately ended and the screen transitions to the initial screen 300A shown in FIG. 6(A). The simple measurement mode is a measurement mode used by on-site workers to easily and efficiently identify leaking pipelines, and therefore vibration data and analysis results are not stored in the analysis server 40.

[0065] <When the button to compare the two analysis results is pressed after the second measurement is completed> 12 is a diagram illustrating another example of transitions in the operation screen displayed after the second measurement is completed when the simplified measurement mode is selected. (A) is the operation screen 300J immediately after the second measurement is completed, (B) is the operation screen 300L illustrating the state in which the check boxes for the first and second analysis results are selected, (C) is the comparison screen 300M of the two selected analysis results, and (D) is the operation screen 300N after the "Close" button 325 is operated. The comparison screen 300M here is an example of the "screen" in the claims. In FIG. 12, parts corresponding to those in FIG. 11 are denoted by the same reference numerals.

[0066] The operation screen 300J shown in Fig. 12(A) displays display fields 320A and 320B for two analysis results, and corresponding buttons 321A and 321B labeled "Details." Note that in Fig. 12(A), the second analysis result has already been notified from the analysis server 40. Therefore, display field 320B shows that the second measurement time was 16:32 and that the possibility of a leak location is 0%. Note that in Fig. 12(A), neither button has been selected.

[0067] In operation screen 300L shown in Fig. 12(B), two check boxes have been selected, and as a result, button 326 labeled "Compare" is displayed. In Fig. 12(B), button 326 is in a selected state. The comparison screen 300M shown in Figure 12(C) displays a spectrum 327 corresponding to the vibration data recorded in the first and second measurements, a water leakage probability field 328A for the first measurement results, a water leakage probability field 328B for the second measurement results, and a button 325 labeled "Close."

[0068] The comparison screen 300M displays a first water leakage probability column 328A and a second water leakage probability column 328B side by side, allowing the operator to visually determine the possibility of water leakage. When the "Close" button 325 is pressed on the comparison screen 300M, the screen transitions to the operation screen 300N shown in Fig. 12(D). When the operation screen 300N is transitioned to by pressing the "Close" button 325, the check boxes in the analysis result display fields 320A and 320B are displayed in a cleared state. 12(D), the "End" button 319 is selected. When the button 319 is selected, the measurement of vibration data is immediately ended, and the screen transitions to the initial screen 300A shown in FIG. 6(A). The simple measurement mode is a measurement mode used by on-site workers to easily and efficiently identify leaking pipelines, and therefore vibration data and analysis results are not stored in the analysis server 40.

[0069] <Detailed measurement mode> The following describes the processing operations and transitions of operation screens that are executed when the detailed measurement mode is selected, using Figures 13 to 20. Note that the operation screens and transitions between screens that will be described later are all examples. In this embodiment, the detailed measurement mode is a measurement mode used to pinpoint locations where there is a high possibility of water leakage.

[0070] 13 is a diagram illustrating an example of a processing operation that is executed in cooperation between the information terminal 30 and the analysis server 40 when the operator selects the detailed measurement mode. Note that the symbol S shown in the diagram represents a step. The processing procedure shown in Fig. 13 is started when a negative result is obtained in the above-mentioned step 2 (see Fig. 5) because in this embodiment, two selectable measurement modes are assumed: a simple measurement mode and a detailed measurement mode. 14 to 20 show examples of transitions of operation screens displayed on the information terminal 30 (see FIG. 1) when the detailed measurement mode is selected.

[0071] The processing shown in FIG. 13 is also realized through the execution of a program by the processor 31 of the information terminal 30 (see FIG. 3(A)) or the processor 41 of the analysis server 40 (see FIG. 3(B)). The information terminal 30 that has started the detailed measurement mode accepts input of construction information and site information (step 21). 14 is a diagram illustrating an example of the transition of operation screens up to the input of construction information when the detailed measurement mode is selected. (A) is the initial screen 300A, and (B) to (D) are construction information input screens 300O to 300Q. In FIG. 14, parts corresponding to those in FIG. 6 are assigned the same reference numerals.

[0072] An initial screen 300A shown in Fig. 14(A) has a button 301 labeled "Simple Measurement" and a button 302 labeled "Detailed Measurement." In Fig. 14(A), the selected state of button 302 is indicated by shading. An input screen 300O shown in FIG. 14(B) is used to select a registered construction name or to register a new construction name.

[0073] Input screen 300O displays work 1 to work 7 as a list 330 of registered work names. Also, a button 331 labeled "New Registration" is located at the bottom of input screen 300O. In input screen 300O shown in Fig. 14(B), the selected state of button 331 is indicated by shading. Incidentally, when one of the registered construction names is selected, the input screen 300O transitions to a site information input screen.

[0074] 14(C) is used to input a new construction name. Input screen 300P has an input field 332 for registration information, a button 333 labeled "Cancel," and a button 334 labeled "Register." In the case of input screen 300P shown in FIG. 14(C), "construction name," "construction number," "address" of the site, and "comments" are prepared as registration items. When button 333 is operated, the screen transitions to input screen 300O. On the other hand, when button 334 is operated, the input items are registered, and the screen transitions to input screen 300Q shown in Fig. 14(D). On the input screen 300Q shown in FIG. 14(D), a line "Project name 8: Buried pipe measurement 1" has been added.

[0075] When a predetermined time has elapsed since the input screen 300Q shown in FIG. 14(D) was displayed, the screen switches to an input screen for site information. 15A to 15C are diagrams illustrating an example of transitions used to input site information when the detailed measurement mode is selected. (A) to (C) are site information input screens 300B to 300D. In Fig. 15, parts corresponding to those in Fig. 6 are assigned the same reference numerals.

[0076] Input screen 300B shown in Figure 15(A) is used to input the material of pipes buried or exposed at the site, and on this screen are arranged material selection field 303, button 304 with a left-pointing arrow meaning "back," button 305 with a right-pointing arrow meaning "forward," and "cancel" button 306. When button 304 is operated, the screen transitions to input screen 300O (or input screen 300Q). On the other hand, when button 305 is operated, the screen transitions to input screen 300C shown in FIG.

[0077] Input screen 300C shown in FIG. 15(B) is used to input the equipment to be used to measure vibration data, and on this screen are arranged equipment selection field 307, button 304 with a left-pointing arrow meaning "back," button 305 with a right-pointing arrow meaning "forward," and "cancel" button 306. When button 304 is operated, the screen transitions to the previous input screen 300B. On the other hand, when button 305 is operated, the screen transitions to input screen 300D shown in Fig. 15(C).

[0078] The input screen 300D shown in Figure 15(C) is for inputting the measurement depth, and on this screen are arranged a depth selection field 308, a button 304 with a left-pointing arrow meaning "back," a button 305 with a right-pointing arrow meaning "forward," and a "cancel" button 306. When button 304 is operated, the screen transitions to the previous input screen 300C. On the other hand, when button 305 is operated, the screen transitions to operation screen 300R shown in Fig. 16(A).

[0079] Returning to the explanation of FIG. When input of the construction information and site information is completed in step 21, the information terminal 30 determines whether or not to acquire an entire image of the measurement location (step 22). If a positive result is obtained in step 22, the information terminal 30 acquires an entire image of the type designated by the worker (step 23). For example, an image capturing an area where there is a high possibility of water leakage is acquired. Next, the information terminal 30 combines the mesh with the entire image (step 24). As described above, the mesh is made up of a plurality of sections. In the present embodiment, the arrangement of the sections is determined in advance.

[0080] Next, the information terminal 30 accepts the designation of a measurement point by the operator (step 25). The measurement point here is determined by designating one of the multiple sections that make up the mesh. Thereafter, the information terminal 30 determines whether or not to capture an image of the measurement location (step 26). If a negative result is obtained in the above-mentioned step 22, the information terminal 30 skips steps 23 to 25 and executes the determination in step 26. The image captured in step 26 is not for identifying the measurement point, but refers to any image that can be linked to the measurement point.

[0081] If a positive result is obtained in step 26, the information terminal 30 acquires the captured image (step 27). To capture the image, for example, the camera 35 of the information terminal 30 (see FIG. 3(A)) is used. When an image is acquired in step 27, or when a negative result is obtained in step 26, the information terminal 30 starts measurement (step 28) and transmits the acquired vibration data and the like to the analysis server 40 (step 29). Here, construction information, site information, measurement date and time, and other information to be linked to the vibration data are also uploaded.

[0082] Upon receiving the vibration data, etc., the analysis server 40 analyzes the vibration data (step 30). Upon completion of the analysis process, the analysis server 40 transmits the analysis results to the information terminal 30 (step 31). The analysis server 40 also records the acquired measurement data, etc. in the database 400 (see FIG. 4) (step 32). Meanwhile, the information terminal 30 that has received the analysis results displays the analysis results in association with specific measurement points within the mesh (step 33). Next, the information terminal 30 determines whether or not the location has been set as a water leakage location (step 34). Specifically, it determines whether or not the worker has set the location as a water leakage location.

[0083] If a positive result is obtained in step 34, the information terminal 30 instructs the analysis server 40 to set the location of the water leak (step 35). Upon receiving the instruction, the analysis server 40 links the instruction to the measurement point currently being analyzed and updates the database 400 (step 37). After issuing an instruction to set the location of the water leak, or if a negative result is obtained in step 34, the information terminal 30 determines whether or not to continue measuring (step 36). If a positive result is obtained in step 36, the information terminal 30 returns to step 25 and accepts the specification of a new measurement point. On the other hand, if a negative result is obtained in step 36, the information terminal 30 ends the inspection process.

[0084] 16 is a diagram illustrating an example of the transition of the operation screen when measuring the entire image of the measurement point when the detailed measurement mode is selected. (A) is the operation screen 300R used to select whether or not to capture the entire image of the measurement point, (B) is the operation screen 300S during image capture, (C) is the operation screen 300T after image capture, and (D) is the operation screen 300U used to specify the measurement point. 16(A) has arranged thereon a button 335 labeled "Take a full image of the measurement point," a button 336 labeled "Do not take an image," and a button 337 labeled "Stop measurement." In FIG. 16(A), the selected state of button 335 is indicated by shading.

[0085] When button 336 is selected, information terminal 30 immediately starts measuring vibration data. In this case, selection screen 300R transitions to operation screen 300H (see FIG. 18). On the other hand, when the button 337 is operated, the information terminal 30 transitions to the initial screen 300A (see FIG. 14(A)). An operation screen 300S shown in FIG. 16(B) displays an image 312 of a subject within the field of view of the camera 35 (see FIG. 3(A)). In the case of FIG. 16(B), an image of the vibration sensor 23 (reference numeral omitted in the figure) placed flat on the floor, which is the measurement location, is captured. When the image capture button 313 is tapped, the image 312 of the subject at the time of tapping is acquired as an overall image 312A of the measurement location.

[0086] An operation screen 300T shown in FIG. 16(C) displays the acquired image as a whole image. If the worker wishes to retake the displayed image, he or she operates button 338 labeled "Retake." Upon detecting the operation of this button 338, information terminal 30 returns to operation screen 300S. On the other hand, if the displayed image is to be used as is, the worker operates button 339 labeled "Use Photo." Upon detecting the operation of this button 339, information terminal 30 transitions to operation screen 300U. Note that in FIG. 16(C), the selected state of button 339 is indicated by shading.

[0087] An operation screen 300U shown in Fig. 16(D) is used for inputting the designation of measurement points. In the case of the operation screen 300U, a virtual mesh 340 is displayed in the center of the screen, superimposed on the entire image 312A. In the case of Fig. 16(D), the mesh 340 is made up of a total of 84 sections, arranged in 12 rows and 7 columns. In the case of this embodiment, the mesh configuration is based on the initial setting. In FIG. 16(D), the cursor K indicating the position of the measurement point candidate is located at the upper left corner of the mesh 340.

[0088] The position of cursor K, which specifies the measurement point, can be moved by operating cursor key 341. Note that even after acquiring overall image 312A, imaging may be continued using information terminal 30 fixed to a tripod or the like, and the captured image may be superimposed on overall image 312A on operation screen 300U. In this case, the actual positions of the tip of listening rod 21 and vibration sensor 23 can be confirmed on the screen. This makes it easy to ensure that the section specified on the screen is the same as the actual positions of the tip of listening rod 21 and vibration sensor 23.

[0089] However, this method is just one example, and it is also possible to match the image of the measurement point taken for each measurement with the entire image 312A by image processing, and confirm whether the designated section matches the actual measurement point. Furthermore, if the section specified on the entire image 312A does not match the actual measurement point, the relationship between the actual measurement point and the section on the entire image 312A may be automatically adjusted by image processing.

[0090] Furthermore, a survey map of the site may be generated using LiDAR (Light Detection and Ranging) or the like installed in the information terminal 30 and used for the overall image. A virtual map in which the mesh 340 is superimposed on the survey map may be linked to other devices related to the site work, such as other smartphones or smart glasses. If there are artificial or natural objects in the virtual map that can be used as markers, capturing the markers in the imaging field of view of the camera of another smartphone or smart glasses makes it easy to share the mesh 340 as seen from the location of another device or a specified measurement point.

[0091] Markers can be natural objects such as stones or trees, or man-made objects such as plastic ornaments in multiple colors such as red, blue, and yellow. To specify the direction, multiple markers, preferably three or more, are required. It is desirable for the markers to have a color, shape, and size that allow them to be distinguished from others. This function can also be used to easily guide on-site workers to designated measurement points. Guidance can be achieved by voice, or by displaying a virtual arrow on the display of another smartphone or in front of the wearer of smart glasses. In other words, augmented reality (AR) technology can also be used.

[0092] Alternatively, a projector may be used to project an image of mesh 340 onto the site of leak inspection so as to match mesh 340 on captured overall image 312A. If it is guaranteed that the image of mesh 340 projected by the projector matches mesh 340 captured as part of overall image 312A displayed on the screen, then after capturing overall image 312A, even if an actual measurement point is determined with reference to the division of mesh 340 projected onto the site, it is possible to ensure that the actual measurement point matches the division specified on operation screen 300U.

[0093] Furthermore, when an image of the mesh 340 is projected onto the site using a projector and the projected site state is captured as the overall image 312A, measurements are performed with the listening rod 21 or vibration sensor 23 positioned in the section of the projected image, and the state is captured by the camera 35, so that it is not necessary to superimpose the mesh 340 onto the overall image 312A of the information terminal 30. In this case, the image captured by capturing the projected image of the mesh 340 becomes the overall image. In this case, the overall image 312A is processed to extract straight line segments corresponding to the mesh 340, and the area surrounded by the extracted straight lines is identified as the section. The identified section is then managed using intra-mesh position information 404 (see FIG. 4).

[0094] Furthermore, in this embodiment, virtual mesh 340 is superimposed on overall image 312A, but it is also possible to install surveying threads in a matrix at the site prior to inspection and capture this state as overall image 312A. In this case, mesh 340 included in overall image 312A is given by actual surveying threads. In this case, as in the case where an image of mesh 340 is projected at the site, image processing of the captured overall image 312A can be performed to extract straight line segments corresponding to the surveying threads, and the areas surrounded by the extracted straight lines can be identified as sections, allowing measurement points to be managed.

[0095] In the upper section of the operation screen 300U shown in Fig. 16(D), an indicator 342 is displayed, which indicates the probability of a water leak using a color. The indicator 342 shown in Fig. 16(D) has six levels: "0%", "20%", "40%", "60%", "80%", and "Leak", and the higher the possibility, the darker the color. Note that these classifications and display formats are just an example. In addition, operation screen 300U displays a display field 343 for the number of sections that have been measured. In the case of Fig. 16(D), since the entire image 312A has just been captured, the number of sections that have been measured is 0 (zero). The denominator is 84 (= 12 × 7).

[0096] The operation screen 300U also has a button 344 for setting the section where the cursor K is located as the measurement point, a button 345 for displaying detailed analysis results of the measurement point on the screen, and a button 346 for ending measurement in the detailed measurement mode. The button 344 is labeled "Measurement Point." The button 345 is labeled "Display." The button 346 is labeled "Back."

[0097] Figure 17 is a diagram illustrating an example of the transition of operation screens displayed until the first measurement is started when the detailed measurement mode is selected. (A) is operation screen 300V when setting the measurement location, (B) is operation screen 300E for imaging the measurement location, (C) is operation screen 300T immediately after imaging, and (D) is operation screen 300G for starting measurement. In Figure 17, parts corresponding to those in Figures 7 and 16 are assigned the same symbols.

[0098] 17(A), cursor K is moved to the section where vibration sensor 23 (see FIG. 1) placed flat on the floor is located. When button 344 is operated, the section where cursor K is located is set as the measurement point. Thereafter, operation screen 300V transitions to operation screen 300E. 17(B) has arranged thereon a button 309 labeled "Take an image of the measurement point," a button 310 labeled "Do not take an image," and a button 311 labeled "Stop measurement." In FIG. 17(B), the selected state of button 309 is indicated by shading.

[0099] When the button 309 is operated, the operation screen 300E transitions to an operation screen 300T via an operation screen 300F (see FIG. 7(B)). 17(C) displays on the screen an image 312 of a subject within the imaging field of view of camera 35 (see FIG. 3(A)). Here, image 312 of the subject is an image captured independently of overall image 312A. 17(D), a button 314 labeled "Start measurement" and a button 315 labeled "Stop measurement" are displayed on the screen. Here, button 314 used to instruct the start of measurement is selected. By operating the button 314, the operation screen 300G transitions to the operation screen 300H (see FIG. 18(A)).

[0100] 18 is a diagram illustrating an example of the transition of the operation screen when on-site measurements are repeated with the detailed measurement mode selected. (A) is an operation screen 300H indicating that measurement is in progress, (B) is an operation screen 300U displayed immediately after measurement of two measurement locations has been completed, (C) is an operation screen 300U displayed immediately after measurement of three measurement locations has been completed, and (D) is an operation screen 300U displayed immediately after measurement of six measurement locations has been completed. In FIG. 18, parts corresponding to those in FIGS. 7 and 16 are denoted by the same reference numerals.

[0101] As the number of measurement locations increases, the number displayed in the display field 343 for the number of sections that have been measured is also counted up. In the overall image 312A, the sections for which vibration data has been measured are colored in accordance with the analysis results. The color of the section is updated every time the analysis results are notified from the analysis server 40 (see FIG. 1). According to the operation screen 300U shown in FIG. 18(D), it can be seen that there is a high possibility that water leakage has occurred at the fourth to sixth designated measurement points.

[0102] In Fig. 18(D), button 345 used to display detailed analysis results of the measurement location is in a selected state. When button 345 is operated, operation screen 300U transitions to information screen 300X shown in Fig. 19(A). Information screen 300X here is an example of a "screen" in the claims. 19 is a diagram illustrating an example of an operation screen used to display detailed analysis results of a measurement point, where (A) shows the upper part of the screen and (B) shows the lower part of the screen. In the information screen 300X shown in Fig. 19(A), the slider of the scroll bar 357 is located at the top of the screen. Therefore, the top of the analysis result page is displayed. In the information screen 300X shown in Fig. 19(B), the slider of the scroll bar 357 is located at the bottom of the screen. Therefore, the bottom of the analysis result page is displayed.

[0103] The information screen 300X shown in Figures 19(A) and (B) has a mesh information column 347, a leakage probability column 348, a diagnostic comment column 349, a measurement data column 350, a measurement date and time column 351, a measurer column 352, a tag column 353, an image column 354 of the measurement location, and a spectrum column 355. Additionally, the information screen 300X is provided with a button 356 labeled "Set as leak location," a scroll bar 357, and a button 358 labeled "Back." Operating button 358 returns to the previous screen.

[0104] The mesh information field 347 displays the structure and type of the mesh used, for example, it displays that the mesh is made up of 12 rows and 7 columns, for a total of 84 sections. The water leakage probability column 348 displays the water leakage probability calculated by the analysis server 40 (see FIG. 1). Since the button 356 is selected, the water leakage probability is displayed as "100%." ​​Incidentally, even if a measurement point has been set at the location of a water leakage, the setting can be canceled by operating the button 356 again. The button 356 here is an example of an interface for registering a specific measurement point on the overall image 312A as a leak point. The location of the water leak may be set using voice recognition technology. Also, a dedicated hardware key may be provided on the device main body 25 or the like for setting the location of the water leak.

[0105] Furthermore, the diagnostic comment field 349 displays a simple diagnostic comment notified by the analysis server 40. Here, the facts set by the worker as the leak location are displayed. The facts set by the worker as the leak location are also uploaded to the analysis server 40 and reflected in the database 400 (see FIG. 4).

[0106] The measurement data field 350 displays various information related to the acquisition of vibration data. On the information screen 300X, a measurement date and time field 351, a field for an operator of measurement 352, a tag field 353, a field for an image of the measurement location 354, and a field for a spectrum 355 are displayed in association with a measurement data field 350. The information in each field related to the measurement data field 350 is stored in the database 400 in association with the measurement location. The screen of the measurement location image field 354 can also be used to check the measurement location when visiting at a later date. The spectrum of the vibration data is displayed in the spectrum field 355. In other words, the operator can visually confirm the characteristics of the vibration data. Displaying the spectrum of the vibration data makes it easier to determine whether there is a water leak compared to listening to the vibration data.

[0107] 20 is a diagram illustrating an example of the transition of the operation screen when terminating the detailed measurement mode. (A) shows the operation screen 300U when an instruction to terminate measurement is given, (B) shows the operation screen 300Y for specifying how to handle the measurement results, and (C) shows the operation screen 300Z used to terminate the detailed measurement mode. In FIG. 20, parts corresponding to those in FIG. 16 are denoted by the same reference numerals. 20(A), the button 346 labeled "Back" is in a selected state. In this case, the information terminal 30 recognizes that the measurement in the detailed measurement mode has ended.

[0108] When the operator operates the button 346, the operation screen 300U transitions to an operation screen 300Y shown in FIG. 20(B). The operation screen 300Y has arranged thereon a button 359 used to instruct the output of a report linked to the construction name that was initially input, and a button 360 used to instruct the new registration of measurement results. The button 359 is labeled "Result Output." The button 360 is labeled "New Registration." In the case of FIG. 20(B), the button 360 is in a selected state. On the operation screen 300Z shown in Fig. 20(C), a button 361 labeled "Exit" is arranged. The button 361 in Fig. 20(C) is in a selected state. When the button 361 is operated, the screen returns to the initial screen 300A (see Fig. 14).

[0109] <Summary> In this embodiment, the spectrum of the vibration data measured on-site is displayed as the analysis result on the information terminal 30. Therefore, workers working on-site can visually confirm the difference in frequency characteristics of the vibration data. Furthermore, since the spectrum of the vibration data is displayed, even workers who do not possess so-called craftsmanship can determine the location of the leak with high accuracy. In addition, displaying the spectrum of vibration data makes it easier to share information and transfer skills.

[0110] In this embodiment, the probability that the measurement point is a leak location is displayed on the screen using text and color. In particular, in the detailed measurement mode, the section designated as the measurement point within the mesh 340 is displayed in a color according to the probability that it is a leak location, making it easy to confirm the location of the leak on site. Furthermore, because the actual measurement points are linked to the sections within the mesh 340, it is possible to reduce the discrepancy between the measurement points in the data and the measurement points on-site. As a result, it is possible to pinpoint the location of the leak even during repair work at a later date. In addition, in this embodiment, a button 356 (see Figure 19) is provided for setting the measurement point corresponding to the information screen 300X (see Figure 19) as a water leak location, so that the determination by an on-site worker that it is a water leak location can be recorded.

[0111] <Embodiment 2> <System configuration> Fig. 21 is a diagram illustrating an example of the conceptual configuration of a water leakage inspection system 1A used in embodiment 2. In Fig. 21, parts corresponding to those in Fig. 1 are assigned the same reference numerals. The water leak inspection system 1A shown in FIG. 21 differs from the water leak detection system 10 (see FIG. 1) described in the first embodiment in that the water leak detection system 10A is composed of a water leak detector 20 and a device main body 250.

[0112] The device main body 250 used in this embodiment is a device in which the device main body 25 (see FIG. 1) in the first embodiment and the information terminal 30 (see FIG. 1) are integrated. Fig. 22 is a diagram for explaining an outline of the flow of data between devices constituting the water leakage inspection system 1A used in embodiment 2. In Fig. 22, parts corresponding to those in Fig. 2 are assigned the same reference numerals.

[0113] The device main body 250 shown in Fig. 22 is composed of a main body circuit 25A and an information processing unit 25B. The hardware configuration of the information processing unit 25B is similar to that of the information terminal 30 shown in Fig. 3(A), for example. That is, the information processing unit 25B is provided with a processor 31 that executes a program required to display an operation screen presented to a worker on-site, a touch panel 34 used to display the operation screen, a camera 35 used to capture an overall image 312A of the site (see Fig. 17(A)) and an image of a subject 312 at a measurement location (see Fig. 17(C)), a communication module 36 used to communicate with the analysis server 40, and the like. The device body 250 here is an example of a leak test device.

[0114] <Third Embodiment> Fig. 23 is a diagram illustrating an example of the conceptual configuration of a water leak detection system 1B used in embodiment 3. (A) is an example of the appearance of the water leak detection system 1B, and (B) is a diagram illustrating an outline of the data flow between devices that make up the water leak detection system 1B. In Fig. 23, parts corresponding to those in Fig. 1 are assigned the same reference numerals. The water leak inspection system 1B shown in Figure 23 differs from the water leak detection system 10 (see Figure 1) described in embodiment 1 and the water leak detection system 10A (see Figure 21) described in embodiment 2 in that the water leak detection system 10B is composed of a water leak detector 20 and a device main body 260, and the device main body 260 performs analysis processing of vibration data.

[0115] That is, the water leakage inspection system 1B used in this embodiment does not require the analysis server 40 (see FIG. 1). 23(B) is composed of a main circuit 25A and an information processing unit 25C. The hardware configuration of the information processing unit 25C is similar to that of the information processing unit 25B (see FIG. 22) described in the second embodiment. However, the calculation capability of the information processing section 25C is much faster than that of the information processing section 25B described in the second embodiment, and has a sufficient storage capacity to store the measurement data. In this system configuration, communication with the analysis server 40 is not required, so leak inspection of the measurement point can be performed even in a field with poor communication conditions. The device body 260 here is an example of a leak test device.

[0116] <Other embodiments> (1) Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the scope of the above-described embodiments. It is clear from the claims that various modifications and improvements to the above-described embodiments are also included in the technical scope of the present invention.

[0117] (2) In the above-described embodiment, when button 335 (see FIG. 16(A)) is operated, the camera 35 (see FIG. 3) of the information terminal 30 (see FIG. 1) starts capturing an entire image 312A (see FIG. 16(D)). However, after button 335 is operated, an operation screen 300AA for selecting the type of entire image 312A may be displayed. FIG. 24 is a diagram illustrating an example of an operation screen used to select the type of image to be used as the whole image 312A.

[0118] The operation screen 300AA shown in FIG. 24 has arranged thereon a button 371 labeled "Use images taken by camera," a button 372 labeled "Use map," a button 373 labeled "Use piping diagram," a button 374 labeled "Use aerial photograph," a button 375 labeled "Use photos taken by drone," and a button 376 labeled "Stop measurement." The contents of the labels attached to these buttons 371 to 375 and the number of buttons are examples. When any button is operated, a screen for selecting the corresponding type of image is displayed instead of operation screen 300S (see FIG. 16(B)) or operation screen 300T (see FIG. 16(C)).

[0119] Fig. 25 is a diagram illustrating a display example of the operation screen 300U when an aerial photograph of the leak inspection site taken from above, an image taken by a drone, or any similar image is used as the overall image. In Fig. 25, parts corresponding to those in Fig. 16(D) are assigned the same reference numerals. In the operation screen 300U shown in Figure 25, a virtual mesh 340 is displayed within an aerial photograph of a site where multiple vehicles are parked, and the leakage probability notified as an analysis result is displayed in color at the measured locations in the sections that divide the mesh 340.

[0120] (3) In the above embodiment, an example was described in which a spectrum was displayed as the analysis result of vibration data, but a spectrum may also be displayed. 26 is a diagram illustrating an example of a spectrum that is the analysis result of vibration data. (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when there is a suspected possibility of water leakage, and (C) is an example of a spectrum when there is a high possibility of water leakage. When there is no water leakage (i.e., the case of FIG. 26(A)), the sound pressure level at all frequencies is low and no change over time is observed.

[0121] On the other hand, when there is a suspicion of a water leak (i.e., the case of Figure 26(B)), an increase in sound pressure level in the mid-to-high frequency range is observed, and particularly high sound pressure levels appear over time in the mid-range frequency range. However, the sound pressure level is discrete and is likely to be temporary noise. When there is a high possibility of a water leak (i.e., the case of Figure 26(C)), the sound pressure level of the mid-to-high frequency range remains high. When this spectrum appears, even an unskilled person can easily determine that there is an extremely high possibility that there is a water leak.

[0122] (4) In the above embodiment, the case where mesh 340 having a structure given by default is synthesized with whole image 312A has been described, but the structure of mesh 340 may be changeable by the operator. 27 is a diagram illustrating an example of the transition of the operation screen before and after a change in the structure of the mesh 340. (A) shows the entire image 312A onto which the mesh 340 set in the initial settings has been composited, (B) shows an example of a screen used to accept a change to the structure of the mesh 340, and (C) shows the entire image 312A onto which the modified mesh 340 has been composited.

[0123] The operation screen 300U shown in Fig. 27(A) is the same as the operation screen 300U shown in Fig. 16(D). Therefore, a mesh 340 made up of 12 rows and 7 columns of sections is synthesized with the entire image 312A. 27(B), a screen used to accept changes to the mesh structure (hereinafter referred to as the "change acceptance screen") 361A is displayed as a pop-up. The change acceptance screen 361A has a display field 362 showing the current structure, a display field 363 showing the structure after the change, and an execute change button 364.

[0124] In the case of the change acceptance screen 361A shown in Fig. 27(B), the values ​​of the number of rows and columns after the change are input fields. For example, the numerical values ​​that can be input may be displayed outside the fields. An example of changing to 4 rows and 4 columns is shown in the display field 363. 27(C), the structure of mesh 340 superimposed on overall image 312A has been changed to 4 rows and 4 columns. By using this function, it is possible to freely set the mesh structure according to the site.

[0125] The structure of the mesh 340 may be automatically adjusted according to the scale information of the entire image 312A and the display size of the entire image 312A displayed on the operation screen 300U. For example, the structure of mesh 340 is automatically optimized between a 1:1 scale and a 1:100 scale. If the structure of mesh 340 is the same, the size of each section in real space will be significantly different, even if it is the same section on the overall image 312A. For example, if one section on the screen corresponds to an area of ​​20 m x 20 m in real space, it will be difficult to identify the location of the leak in real space. Therefore, if scale information is available, the structure of mesh 340 can be automatically adjusted according to the scale.

[0126] Furthermore, when the display size of the entire image 312A displayed on the operation screen 300U is small, displaying the mesh 340 in the same structure as when the display size is large may impair the visibility of the sections. In such cases, the structure of the mesh 340 synthesized on the screen may be automatically changed to ensure visibility.

[0127] (5) The analysis server 40 (see Figures 1 and 21) in the above-mentioned first and second embodiments analyzes vibration data measured on-site and records the measurement data, etc. in a database. In addition to these functions, the analysis server 40 may also perform processing related to the operation screens and transitions between screens displayed on the touch panel 34 (see Figure 3) of the information terminal 30 (see Figure 1) or the device main body 250 (see Figure 21) used on-site. In particular, the analysis server 40 may have the function of displaying an overall image of the leak inspection site as an operation screen and the function of accepting specific sections of the overall image as measurement points. In this case, the information terminal 30 and the device main body 250 used at the site are used as information input / output devices. The analysis server 40 having this function is an example of an information processing device that cooperates with the leak inspection device used at the site, and is also an example of a computer used for leak inspection.

[0128] It is also possible to provide a server that analyzes vibration data and a server that provides operation screens for the information terminal 30 and the device main body 250 used on-site. In other words, a cloud service consisting of a service that analyzes vibration data and a service that manages operation screens and transitions between those screens may be realized on a single server or through the cooperation of multiple servers. Incidentally, the server may be in any hardware form as long as it is a computer that provides services to the information terminals 30 used on-site.

[0129] (6) In the above-described embodiment, an example was described in which a virtual mesh 340 (see FIG. 16(D)), in which each section is defined as a collection of squares, is directly composited onto the overall image 312A (see FIG. 16(D)) and displayed. However, when capturing images of the ground or walls at a leak inspection site, if the capturing range is wide, the plane will be captured from an oblique direction. For example, Figures 16(B) and 16(C) show examples of capturing images of a floor surface covered with square tiles, but because the image was captured from obliquely above the floor surface, the tiles appear trapezoidal. In other words, the capturing direction of the information terminal 30 is tilted in one axis direction from the direction directly facing the floor surface. Therefore, when synthesizing mesh 340, the tilt angle may be calculated from the subject in whole image 312A, mesh 340 may be deformed into a trapezoid according to the calculated tilt angle, and the deformed mesh 340 may be synthesized with whole image 312A. Note that deformation of mesh 340 may also be performed via a manual interface. [Explanation of symbols]

[0130] 1, 1A, 1B... Water leak inspection system, 10, 10A, 10B... Water leak detection system, 20... Water leak detector, 21... Sound listening rod, 23... Vibration sensor, 25, 250, 260... Device main body, 25B, 25C... Information processing unit, 30... Information terminal, 40... Analysis server, 400... Database

Claims

1. A leak testing device used by a worker at a site where a fluid leak from a pipe is to be tested, a control unit that displays an overall image of the work site on a work screen; a reception unit that receives a partial area on the entire image as a measurement point; and The control unit associates the measured vibration data with the measurement point on the entire image. It is a leak testing device, the control unit synthesizes and displays a virtual section on the entire image, setting the position of the section selected by the operator as the measurement point; Leak testing equipment.

2. the control unit accepts a setting of the entire image in an initial operation of the on-site inspection. The leak test device according to claim 1 .

3. The number and arrangement of the compartments are preset. The leak test device according to claim 1 .

4. the number and arrangement of the sections are automatically set according to information on the scale of the entire image; The leak test device according to claim 1 .

5. the number and arrangement of the sections are set according to the size of the entire image displayed on the work screen; The leak test device according to claim 1 .

6. The number and arrangement of the compartments can be changed by the operator. The leak inspection device according to any one of claims 3 to 5.

7. the control unit displays, at each of the measurement points on the entire image, an analysis result of the vibration data associated with the measurement point. The leak inspection device according to any one of claims 1 to 6.

8. the control unit displays the section corresponding to the measurement point in a color according to the analysis result. The leak test device according to claim 7.

9. The control unit associates a photograph of the site, which is taken when measuring the measurement point and is different from the overall image, with the measurement point. The leak inspection device according to any one of claims 1 to 8.

10. The control unit has an interface for registering a specific measurement point on the entire image as a leak point. The leak inspection device according to any one of claims 1 to 9.

11. An information processing device that cooperates with a leak inspection device used on-site to inspect for fluid leaks from piping, a control unit that displays an overall image of the site on a work screen of the leak test device; a receiving unit that receives a partial area on the entire image as a measurement point through the leak inspection device; and the control unit associates the measured vibration data with the measurement points on the entire image; the control unit synthesizes and displays a virtual section on the entire image, and sets the position of the section selected by the operator as the measurement point. Information processing device.

12. The computer used to check for fluid leaks from pipes A function to display an overall image of the site on the work screen, a function of accepting a partial area on the entire image as a measurement point; a function of linking measured vibration data to measurement points on the entire image; a function of synthesizing and displaying a virtual section on the entire image; a function of setting the position of the section selected by the operator as the measurement point; A program to achieve this.

Images