Leak detection device and program

Abstract

To enable leakage inspection that does not require craftsmanship.SOLUTION: A leakage inspection device used by an operator on a site for inspecting leakage of fluid from a pipe is provided with an acquisition section that acquires vibration data at a measurement point during inspection work and a control section that displays a spectrum of the vibration data on a screen showing a result obtained by analyzing the vibration data in real-time.SELECTED DRAWING: Figure 11

Description

[[Technical Field]]

[0001] The present invention relates to a leak inspection apparatus and a program. [[Background Art]]

[0002] At sites where water leakage and the like are inspected, an operator is required to distinguish the state of water leakage by ear as sound. However, much experience is required to distinguish between sound generated by water leakage or the like and other sounds. That is, craftsmanship is required. [[Prior Art Documents]] [[Patent Documents]]

[0003] [[Patent Document 1]] Japanese Unexamined Patent Publication No. 2008-292338 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]

[0004] Nowadays, the aging of on-site workers and the succession of skills have become problems. Furthermore, with methods that rely on craftsmanship, it is difficult to perform ex-post verification and ensure objectivity.

[0005] An object of the present invention is to enable leak inspection that does not require craftsmanship. [[Means for Solving the Problem]]

[0006] The invention according to claim 1 is a leak inspection apparatus used by an operator at a site where leakage of fluid from a pipe is inspected, comprising: an acquisition unit that acquires vibration data of a measurement point during inspection work; a reception unit that combines and displays virtual sections on an overall image of the site displayed on a work screen, and receives the position of a section selected by the operator as the measurement point; and a control unit that displays a spectrum of the vibration data on the work screen as a result of analyzing the vibration data in real time. The leak inspection apparatus has the above components. The invention described in claim 2 is a leak inspection device according to claim 1, wherein the control unit has a button on the work screen for registering the displayed measurement point as a leak point. The invention described in claim 3 is a leak inspection device according to claim 1 or 2, wherein the control unit displays an image of the measurement point on the work screen. The invention described in claim 4 is a leak inspection device according to any one of claims 1 to 3, wherein the control unit displays information on the work screen indicating the probability that a leak has occurred at the measurement point. The invention described in claim 5 is a leak inspection device according to claim 4, wherein the probability is displayed in association with multiple measurements for the same measurement point. The invention described in claim 6 is a program for a computer used for fluid leak testing from piping, which provides the following functions: acquiring vibration data of measurement points during the inspection process; superimposing and displaying virtual sections on an overall image of the site displayed on the work screen, and accepting the location of the section selected by the operator as the measurement point; and displaying the spectrum of the vibration data on the work screen as a result of real-time analysis of the vibration data. 。 [Effects of the Invention]

[0007] According to the invention described in claim 1, leak testing can be performed without requiring skilled craftsmanship. According to the invention described in claim 2, if the location of the leak can be confirmed by the spectral waveform, the operator can register it as the leak location at the time of measurement. According to the invention described in claim 3, the presence of an image of the measurement point makes it easier to determine the leak location on-site after the fact. According to the invention described in claim 4, confirmation of probability-indicating information can assist in determining leak locations based on spectral waveforms. According to the invention described in claim 5, the possibility of leakage can be easily determined by checking the probability multiple times. According to the invention described in claim 6, leak testing can be performed without requiring skilled craftsmanship. According to the invention described in claim 7, confirmation of probability-indicating information can assist in determining leak locations based on spectral waveforms. According to the invention described in claim 8, if the location of the leak can be confirmed by the spectral waveform, the operator can register it as the leak location at the time of measurement. According to the invention described in claim 9, the presence of an image of the measurement point makes it easier to determine the leak location on-site after the fact. According to the invention described in claim 10, the possibility of leakage can be easily determined by checking the probability multiple times. According to the invention described in claim 11, leak testing can be performed without requiring skilled craftsmanship. [Brief explanation of the drawing]

[0008] [Figure 1] This figure illustrates a conceptual configuration example of a leak detection system used in Embodiment 1. [Figure 2] This diagram illustrates the connection configuration and data flow between devices of the leak detection system used in Embodiment 1. [Figure 3] This figure illustrates an example of the hardware configuration of the information terminal and analysis server used in Embodiment 1. (A) is an example of the information terminal configuration, and (B) is an example of the analysis server configuration. [Figure 4] This diagram shows an example of a database data structure. [Figure 5] This diagram illustrates an example of the processing operations performed through the cooperation between the information terminal and the analysis server when the operator selects the simplified measurement mode. [Figure 6] This diagram illustrates an example of the screen transitions from the initial screen to the input of field information when the simplified measurement mode is selected. (A) is the initial screen, and (B) to (D) are the screens for inputting field information. [Figure 7] This diagram illustrates an example of the transition of the operation screen after inputting field information when the simplified measurement mode is selected. (A) is the operation screen used to select whether or not to image the measurement location, (B) is the operation screen during image acquisition, (C) is the operation screen for instructing the start of measurement, and (D) is the operation screen indicating that measurement is in progress. [Figure 8] This figure illustrates an example of a spectrum resulting from the analysis of vibration data. (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when water leakage is suspected, and (C) is an example of a spectrum when water leakage is highly likely. [Figure 9]It is a diagram illustrating an example of transition of operation screens displayed after the end of the first measurement when the simple measurement mode is selected. (A) is an operation screen used for selecting whether or not to perform measurement continuously, (B) is an operation screen used for selecting whether or not to image the measurement site, (C) is an operation screen during imaging, and (D) is an operation screen for instructing the start of measurement. [Figure 10] It is a diagram illustrating another example of transition of operation screens displayed after the end of the first measurement when the simple measurement mode is selected. (A) is an operation screen used for selecting whether or not to perform measurement continuously, (B) is an operation screen used for selecting whether or not to image the measurement site, and (C) is an operation screen indicating that measurement is in progress. [Figure 11] It is a diagram illustrating another example of transition of operation screens displayed after the end of the second measurement when the simple measurement mode is selected. (A) is an operation screen immediately after the end of the second measurement, (B) is a selection screen illustrating a state where the button labeled "Details" is selected, (C) is a detail display screen of analysis results, and (D) is an operation screen after the "Close" button is operated. [Figure 12] It is a diagram illustrating another example of transition of operation screens displayed after the end of the second measurement when the simple measurement mode is selected. (A) is an operation screen immediately after the end of the second measurement, (B) is an operation screen illustrating a state where the checkboxes for the analysis results of the first measurement and the second measurement are selected, (C) is a comparison screen of the two selected analysis results, and (D) is an operation screen after the "Close" button is operated. [Figure 13] It is a diagram illustrating an example of processing operations executed through cooperation between an information terminal and an analysis server when an operator selects the detailed measurement mode. [Figure 14] It is a diagram illustrating an example of transition of operation screens until input of construction information when the detailed measurement mode is selected. (A) is an initial screen, and (B) to (D) are input screens for construction information. [Figure 15]It is a diagram illustrating an example of transition used for inputting on-site information when the detailed measurement mode is selected. (A) to (C) are on-site information input screens. [Figure 16] It is a diagram illustrating an example of transition of operation screens when measuring an overall image of a measurement location in a case where the detailed measurement mode is selected. (A) is an operation screen used for selecting whether to capture an overall image of the measurement location, (B) is an operation screen during imaging, (C) is an operation screen after imaging, and (D) is an operation screen used for specifying measurement points. [Figure 17] It is a diagram illustrating an example of transition of operation screens displayed before the first measurement is started when the detailed measurement mode is selected. (A) is an operation screen when setting a measurement location, (B) is an imaging selection screen for the measurement location, (C) is an operation screen immediately after imaging, and (D) is an operation screen for starting measurement. [Figure 18] It is a diagram illustrating an example of transition of operation screens when on-site measurement is repeated while the detailed measurement mode is selected. (A) is an operation screen indicating that measurement is in progress, (B) is an operation screen displayed immediately after measurement of two measurement locations is completed, (C) is an operation screen displayed immediately after measurement of three measurement locations is completed, and (D) is an operation screen displayed immediately after measurement of six measurement locations is completed. [Figure 19] It is a diagram illustrating an example of an operation screen used for displaying detailed analysis results of a measurement location. (A) shows the upper part of the screen, and (B) shows the lower part of the screen. [Figure 20] It is a diagram illustrating an example of transition of operation screens when exiting the detailed measurement mode. (A) shows an operation screen when an instruction to end measurement is given, (B) shows an operation screen for specifying handling of measurement results, and (C) shows an operation screen used for exiting the detailed measurement mode. [Figure 21] It is a diagram illustrating an example of a conceptual configuration of a water leakage inspection system used in Embodiment 2. [Figure 22] It is a diagram illustrating an outline of a data flow between devices constituting the water leakage inspection system used in Embodiment 2. [Figure 23]This figure illustrates a conceptual configuration example of a leak detection system used in Embodiment 3. (A) is an example of the external appearance of the leak detection system, and (B) is a diagram illustrating an overview of the data flow between the devices constituting the leak detection system. [Figure 24] This diagram illustrates an example of an operation screen used to select the type of image to be used as the overall image. [Figure 25] This diagram illustrates an example of the operation screen display when using an aerial photograph taken from above, an image taken by a drone, or any similar image as the overall image of a leak inspection site. [Figure 26] This figure illustrates an example of a spectrum resulting from the analysis of vibration data. (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when water leakage is suspected, and (C) is an example of a spectrum when water leakage is highly likely. [Figure 27] This diagram illustrates examples of screen transitions before and after a change in the mesh structure. (A) shows the overall image with the mesh set in the initial settings, (B) shows an example of a screen used to accept a change in the mesh structure, and (C) shows the overall image with the modified mesh. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below with reference to the drawings. <Embodiment 1> <System Configuration> Figure 1 is a diagram illustrating a conceptual configuration example of the leak detection system 1 used in Embodiment 1.

[0010] The leak detection system 1 shown in Figure 1 consists of a leak detection system 10 used at the leak detection site, an analysis server 40, and a communication network 50. The communication network 50 here refers to, for example, the internet, or mobile communication systems such as 4G or 5G. Note that the communication network 50 also includes wireless LAN (=Local Area Network) and wired LAN.

[0011] The leak detection system 10 shown in Figure 1 consists of a leak detector 20 that measures vibrations at a measurement point, and an information terminal 30 that presents the operator with the results of the analysis of the vibrations measured by the leak detector 20 (hereinafter referred to as "vibration data"). The information terminal 30 here is an example of a leak inspection device used on site. Measurement points here include, for example, the surface of exposed pipes, the ground surface where pipes are buried, the walls and ceilings of structures in which pipes are installed, and equipment such as valves. In this embodiment, the points where vibration data is measured are referred to as "measurement points" or "measurement locations." In this implementation, the measurement points or measurement locations are determined by the on-site workers.

[0012] In this embodiment, the piping may include, for example, water distribution pipes, water supply pipes, drainage pipes, sewer pipes, gas pipes, and refrigerant pipes. Liquids flow through water pipes, drainage pipes, and sewer pipes, while gases flow through gas pipes and refrigerant pipes. Examples of liquids include tap water, sewage, rainwater, and cooling water. Furthermore, gases include not only city gas, but also gases used as fuels or reactants, air, steam, etc. Furthermore, piping includes pipes that carry liquid materials and fuels handled in various chemical plants and factories. These liquids and gases are examples of fluids that flow through piping.

[0013] The leak detector 20 consists of a metal listening rod 21 that transmits vibrations at the measurement point, a grip 22 held by the operator, a vibration sensor 23 that converts vibration data transmitted from the listening rod 21 into an electrical signal, a communication cable 24, and the main body of the device 25. For example, a bone conduction pickup sensor is used for the vibration sensor 23. The main body of the device 25 has, for example, a built-in rechargeable battery, from which power necessary for the operation of the vibration sensor 23 and other components is supplied.

[0014] Furthermore, the main unit 25 of the device incorporates, for example, an amplifier that adjusts the gain of vibration data received as an electrical signal from the vibration sensor 23, and a communication device that transmits the amplified vibration data to the information terminal 30. In this embodiment, a USB (Universal Serial Bus) connector is used for the communication device. Therefore, the main unit 25 and the information terminal 30 are electrically connected via a USB cable 24A.

[0015] A notch 26 is provided at the upper end of the main body 25 of the device so as not to obstruct imaging by the camera 35 (see Figure 3, described later) installed on the information terminal 30. The position and size of the notch 26 are determined according to the information terminal 30 used by being attached to the main body 25 of the device. In addition, the main unit 25 of the device also incorporates a volume control button for adjusting the volume when vibration data is played back as sound through earphones, a controller for adjusting the signal strength of vibration data input from the vibration sensor 23, a power button, and the like.

[0016] In this embodiment, a smartphone is used as the information terminal 30. In addition, the information terminal 30 can also use tablet computers, notebook computers, smartwatches, smart glasses, etc., which are connected wirelessly via USB wireless adapters or Bluetooth® adapters.

[0017] The analysis server 40 is located on the cloud side and is a server that performs analysis processing of vibration data. In this embodiment, in addition to generating the spectrum and waveform diagram of the vibration data, it has a function to calculate the probability that a measurement point is a water leak location as a percentage or other numerical value. The analysis server 40 is equipped with, for example, artificial intelligence for leak detection. The artificial intelligence is implemented as a learning model that has learned from vibration data at the leak location as training data.

[0018] When vibration data is input into the learning model, the probability of water leakage is output as a percentage or other numerical value. Ideally, the learning model should be trained using vibration data tailored to the pipe material, the type of measuring instrument used, the estimated pipe depth, the density of the soil in which the pipe is buried, the pipe diameter, water pressure, and the condition of the measurement surface. For example, a neural network can be used as the learning algorithm.

[0019] <Circuit Configuration> Figure 2 is a diagram illustrating the connection configuration and data flow between devices of the leak detection system 1 used in Embodiment 1. In the water leak detector 20, vibration data is supplied from the vibration sensor 23 to the main circuit 25A of the device body 25. The main circuit 25A here is equipped with an amplifier that electronically amplifies the vibration data. In this embodiment, the gain of the amplifier can be switched in three stages by operating a switch. Each measurement captures vibration data for approximately 5 seconds.

[0020] Furthermore, the main circuit 25A is equipped with a bandpass filter that selectively extracts frequency bands containing a large amount of vibration components due to water leakage. For example, a bandpass filter with a passband of approximately 100 Hz to 4 kHz is used. However, vibration data in the frequency band that passes through the bandpass filter includes ambient noise in addition to the sound of water leaks. Ambient noise is dependent on the measurement point and becomes noise in the detection of water leaks.

[0021] The vibration data amplified by the main circuit 25A is output to the information terminal 30. The information terminal 30 adds the measurement time, site information, etc., to the acquired vibration data and transmits it to the analysis server 40. The analysis server 40 generates a spectrum or pattern of vibration data and transmits the analysis result to the information terminal 30 indicating the possibility that the measurement point is a water leak location. It takes approximately 15 to 20 seconds for the information terminal 30 to obtain the analysis results from the analysis server 40. However, this time varies depending on the communication environment and the processing capacity of the analysis server 40. The information terminal 30 displays the acquired analysis results to the on-site workers in real time.

[0022] <Hardware Configuration> Figure 3 illustrates an example of the hardware configuration of the information terminal 30 and analysis server 40 used in Embodiment 1. (A) is an example of the configuration of the information terminal 30, and (B) is an example of the configuration of the analysis server 40. The information terminal 30 shown in Figure 3(A) consists of a processor 31 that controls the operation of the entire device, RAM (=Random Access Memory) 32 used as main memory, flash memory 33 which is a non-volatile semiconductor memory, a touch panel 34, a camera 35, and a communication module 36 used for communication with the analysis server 40, etc. In this embodiment, the processor 31 consists of a CPU (=Central Processing Unit) and a GPU (=Graphics Processing Unit), and realizes various functions through the execution of programs.

[0023] One of its functions is to acquire vibration data from measurement points during inspection work. This function corresponds to the "acquisition unit" in the patent claims. Another function is to transmit the acquired vibration data to a predetermined analysis server 40 via the communication module 36. Another function is to display an operation screen to assist workers in their inspection tasks. This function also includes the ability to display the spectrum or spectrum obtained as an analysis result on the touch panel 34. This function corresponds to the "control unit" in the patent claims.

[0024] RAM32 is used as the program execution area. The flash memory 33 stores the BIOS (Basic Input Output System), firmware, application programs for leak detection, vibration data, and other data. The vibration data is deleted after it has been uploaded to the analysis server 40. Therefore, if the upload of vibration data to the analysis server 40 is not completed due to communication failure or other reasons, the vibration data will be stored in the flash memory 33.

[0025] The touch panel 34 consists of a display and a capacitive touch sensor placed on its surface. For example, liquid crystal displays (LCDs) and organic EL (Electro-Luminescence) displays are used for the displays. Touch sensors are devices with high light transmittance. Therefore, touch sensors can detect tap operations and other actions performed by workers without obstructing their vision.

[0026] Camera 35 uses, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The communication module 36 uses devices compliant with mobile communication systems such as USB (Universal Serial Bus), Wi-Fi, Bluetooth, 4G, or 5G. In this embodiment, the processor 31, RAM 32, and flash memory 33 constitute a so-called computer.

[0027] The analysis server 40 shown in Figure 3(B) consists of a processor 41 that controls the operation of the entire device, RAM 42 used as main memory, ROM (Read Only Memory) 43 on which the BIOS and other data are stored, a hard disk drive 44 used as secondary memory, and a communication module 45 used for communication with the communication network 50. These devices are connected via signal lines 46 such as a bus.

[0028] In addition to a display, devices such as a keyboard and mouse may also be connected to the analysis server 40. Furthermore, the analysis server 40 does not need to be a single server; it may be a collection of multiple servers with different roles and functions.

[0029] The processor 41 consists of a CPU and performs various functions through program execution. In this embodiment, some of the functions include a function to store acquired vibration data linked to the site, and a function to analyze the acquired vibration data and send the results back to the information terminal 30 at the site. The analysis results are stored in the hard disk drive 44.

[0030] Furthermore, the hard disk drive 44 stores a database 400 for leak detection (see Figure 4, described later). The database 400 stores vibration data and analysis results uploaded from the field, linked to the measurement points. In addition, the hard disk drive 44 also stores the operating system and application programs for analysis. However, a large-capacity semiconductor memory may be used instead of the hard disk drive 44.

[0031] The communication module 45 uses devices compliant with mobile communication systems such as wireless LAN, Ethernet (registered trademark), 4G, or 5G. In this embodiment, the processor 41, RAM 42, and ROM 43 constitute a so-called computer.

[0032] <Example of database data structure> Figure 4 shows an example of the data structure of database 400. The data structure shown in Figure 4 is just one example; other items may be included instead of those shown. Furthermore, items not shown in Figure 4 may also be included. Site ID 401 is an ID used to link information that identifies the leak detection site. This ID is linked to the name and address of the leak detection site. The name and address of the leak detection site are stored in a separate table.

[0033] The inspection date is stored in the entry for inspection date 402. In Figure 4, the inspection date is identified by month and day, but in the data, the inspection date is stored including the inspection year. Overall image ID 403 is an ID used to link an image that includes the entire area of ​​the site being inspected. In this embodiment, the image or drawing corresponding to the area surrounding the site used to identify measurement points is called the "overall image".

[0034] The overall image includes images captured by information terminal 30 (see Figure 1) and other terminals, as well as aerial photographs, photographs taken by drones from above the site (hereinafter also referred to as "aerial photographs"), drawings such as construction drawings and design drawings of the site, and maps and digital maps captured by scanners. The overall image to be used is specified by the operator at the start of the inspection.

[0035] The in-mesh position information 404 is information indicating the position within a virtual mesh that is composited into the overall image for the purpose of identifying measurement points. If the mesh consists of 10x10 grid sections, the in-mesh position information 404 identifies the position of one of the 100 sections. Here, each section defines a specific sub-region within the overall image.

[0036] In Figure 4, the mesh position information 404 is given by coordinates within the mesh. "10*10" in the figure refers to the 10th row and 10th column section. Incidentally, the origin of the coordinates is predetermined. For example, if north is the orientation of the top of the image, the upper left corner of the image is used as the origin.

[0037] Measurement point ID 405 is the management ID for the measurement point. In the case of database 400 shown in Figure 4, the measurement points in the first and second rows are the same. This means that two measurements were performed for the same measurement point. The measurement time 406 records the time the vibration data was measured. For example, the time when the information terminal 30 acquired the vibration data is used for measurement time 406. Vibration data ID 407 is an ID that identifies vibration data stored in the memory area.

[0038] Image ID 408 is an ID that identifies images taken at the site, linked to the measurement point. If multiple images are taken, multiple IDs will be recorded. Analysis waveform ID 409 is an ID that identifies the spectrum, spectrum, etc., of the vibration data stored in the hard disk drive 44 (see Figure 3(B)). A spectrum is a characteristic diagram with frequency on the horizontal axis and sound pressure (dB) on the vertical axis. A spectrum is a characteristic diagram with time on the horizontal axis and frequency on the vertical axis, which represents the difference in sound pressure (dB) for each frequency at each time point in time using differences in color.

[0039] The leakage probability 410 records a numerical value indicating the probability that the measurement point is a water leak location. In this embodiment, the probability of a water leak location is given as a percentage. Alternatively, a classification of the likelihood of a water leak may be recorded in place of, or together with, the leakage probability 410. The analysis waveforms and leakage probabilities shown here are just examples of analysis results. The leak location setting 411 records whether or not the worker has designated the location as a leak.

[0040] <Processing Actions> <Simple Measurement Mode> The following sections will explain the processing actions and screen transitions performed when selecting the simplified measurement mode, using Figures 5 to 12. Note that the screen transitions and screen transitions described below are all examples. In this embodiment, the simplified measurement mode is a measurement mode used to narrow down the pipeline system that is highly likely to have a water leak. The purpose of this measurement mode is to narrow down the pipeline system that may have water leaks; therefore, even if the vibration data is analyzed by the analysis server 40 (see Figure 1), the vibration data is not stored.

[0041] Figure 5 illustrates an example of processing operations performed through the cooperation between the information terminal 30 and the analysis server 40 when the operator selects the simplified measurement mode. In the figure, the symbol S stands for step. Figures 6 to 12 show examples of the transitions in the operation screen displayed on the information terminal 30 (see Figure 1) when the simplified measurement mode is selected.

[0042] The process shown in Figure 5 is realized through the execution of programs by the processor 31 of the information terminal 30 (see Figure 3(A)) and the processor 41 of the analysis server 40 (see Figure 3(B)). First, the information terminal 30 accepts the selection of a measurement mode on its initial screen (Step 1). In addition to the simple measurement mode, there is also a detailed measurement mode. The detailed measurement mode is used to narrow down the locations where water leakage is likely to occur. Upon receiving the selection, the information terminal 30 determines whether or not to be in simplified measurement mode (step 2). If the simplified measurement mode is selected as the measurement mode, the information terminal 30 obtains a positive result in step 2. Having obtained a positive result in step 2, the information terminal 30 accepts on-site information input (step 3).

[0043] Figure 6 illustrates an example of the screen transitions from the initial screen to the input of field information when the simplified measurement mode is selected. (A) is the initial screen 300A, and (B) to (D) are the field information input screens 300B to 300D. The initial screen 300A shown in Figure 6(A) has a button 301 labeled "Simple Measurement" and a button 302 labeled "Detailed Measurement". In Figure 6(A), the selected state of button 301 is indicated by shading.

[0044] The input screen 300B shown in Figure 6(B) is for inputting the material of pipes that are buried or exposed at the site. The input screen 300B includes a material selection field 303, a button 304 with a left-pointing arrow indicating "back", a button 305 with a right-pointing arrow indicating "forward", and a "cancel" button 306. In Figure 6(B), the selection field 303 displays five options: steel pipe, polyethylene pipe, PVC pipe, other, and unknown. Of course, these are just examples. When button 304 is pressed, the screen transitions to the initial screen 300A. On the other hand, when button 305 is pressed, the screen transitions to the input screen 300C shown in Figure 6(C). Checking the checkbox may be required to transition to the input screen 300C. The same applies to the other input screens 300C and 300D.

[0045] The input screen 300C shown in Figure 6(C) is for inputting information from measuring instruments. The input screen 300C includes a selection field 307 for the equipment to be used to measure vibration data, a button 304 with a left-pointing arrow indicating "back", a button 305 with a right-pointing arrow indicating "forward", and a "cancel" button 306. In Figure 6(C), the selection field 307 displays three options: "listening rod," "flat placement," and "unsure." Here, "flat placement" means removing the vibration sensor 23 (see Figure 1) from the listening rod 21 (see Figure 1) and placing it directly on the measurement point. Of course, the options shown are just examples. When button 304 is pressed, the screen transitions to the previous input screen 300B. On the other hand, when button 305 is pressed, the screen transitions to the input screen 300D shown in Figure 6(D).

[0046] The input screen 300D shown in Figure 6(D) is for inputting the measurement depth. The input screen 300D includes a depth selection field 308, a button 304 with a left-pointing arrow indicating "back", a button 305 with a right-pointing arrow indicating "forward", and a "cancel" button 306. In Figure 6(D), the selection field 308 displays seven options: 20cm, 40cm, 60cm, 80cm, 150cm, 200cm, and 250cm. Of course, this is just one example. Alternatively, an "I don't know" option could also be included. When button 304 is pressed, the screen transitions to the previous operation screen 300C. On the other hand, when button 305 is pressed, the screen transitions to the operation screen 300E shown in Figure 7(A).

[0047] Let's return to the explanation of Figure 5. Once the on-site information input is complete in step 3, the information terminal 30 determines whether or not to take an image of the measurement location (step 4). If a positive result is obtained in step 4, the information terminal 30 acquires the captured image (step 5). For example, the camera 35 of the information terminal 30 (see Figure 3(A)) is used to capture the image. In the simplified measurement mode, the captured image data is used exclusively for verification during on-site work.

[0048] When an image is acquired in step 5, or when a negative result is obtained in step 4, the information terminal 30 starts measurement (step 6) and transmits the measured vibration data, etc., to the analysis server 40 (step 7). Here, in addition to vibration data, on-site information is also uploaded. Upon receiving vibration data, the analysis server 40 analyzes the vibration data (step 8). Once the analysis process is complete, the analysis server 40 sends the analysis results to the information terminal 30 (step 9).

[0049] The information terminal 30, having received the analysis results from the analysis server 40, displays the analysis results (step 10). After this, the information terminal 30 determines whether or not to continue the measurement (step 11). If a positive result is obtained in step 11, the information terminal 30 returns to step 4. On the other hand, if a negative result is obtained in step 11, the information terminal 30 terminates the inspection process.

[0050] It takes approximately 15 to 20 seconds from the transmission of vibration data for the analysis results to be notified to the information terminal 30 from the analysis server 40. Therefore, it is possible to start the next measurement immediately after the analysis results are displayed. In this embodiment, the spectrum of vibration data is displayed as the analysis result. Furthermore, when displaying the analysis results, it is possible to compare and display the results of multiple analyses.

[0051] Figure 7 illustrates an example of the transition of the operation screen after inputting field information when the simplified measurement mode is selected. (A) is the operation screen 300E used to select whether or not to image the measurement location, (B) is the operation screen 300F during image acquisition, (C) is the operation screen 300G for instructing the start of measurement, and (D) is the operation screen 300H indicating that measurement is in progress. The operation screen 300E shown in Figure 7(A) has a button 309 labeled "Image measurement location," a button 310 labeled "Do not image," and a button 311 labeled "Cancel measurement." In Figure 7(A), the selected state of button 309 is shown by shading.

[0052] If button 310 is selected, the information terminal 30 immediately starts measuring vibration data. In this case, the operation screen 300E transitions to the operation screen 300H. On the other hand, if button 311 is pressed, the information terminal 30 transitions to the initial screen 300A (see Figure 6(A)). The operation screen 300F shown in Figure 7(B) displays the subject image 312 within the imaging field of the camera 35 (see Figure 3(A)). In Figure 7(B), the vibration sensor 23 (notation omitted in the figure) is placed flat on the floor surface, which is the measurement location, and this is what is being captured. When the imaging button 313 is tapped, the subject image 312 at the time of the tap is acquired as the image of the measurement location.

[0053] The operation screen 300G shown in Figure 7(C) displays a button 314 labeled "Start Measurement" and a button 315 labeled "Stop Measurement". If button 314 is selected, operation screen 300G transitions to operation screen 300H. The operation screen 300H shown in Figure 7(D) displays a waveform display area 316 showing the sound pressure change in the time axis direction of the vibration data, and an icon 317 indicating that measurement is in progress. In this embodiment, the vibration at the measurement point is measured for approximately 5 seconds. The measured vibration data is automatically uploaded from the information terminal 30 to the analysis server 40 (see Figure 1).

[0054] Figure 8 illustrates an example of a spectrum resulting from the analysis of vibration data. (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when water leakage is suspected, and (C) is an example of a spectrum when water leakage is highly likely. The spectrum is almost flat when there is no water leakage, but in spectra where water leakage is suspected, whisker-like spikes are superimposed in the frequency band enclosed by the dashed line. The cause of this is thought to be the detection of temporary vibrations such as wind and noise at the site. This is what is known as noise. The influence of noise may be distinguishable by acquiring vibration data multiple times. In spectra highly likely to indicate a water leak, a steady and continuous high sound pressure appears in the frequency band indicated by the dashed line. This type of waveform is characteristic of water leaks.

[0055] <If the second measurement is started immediately afterward> Figure 9 illustrates an example of the transitions in the operation screens displayed after the first measurement is completed when the simplified measurement mode is selected. (A) is the operation screen 300I used to select whether or not to continue measuring, (B) is the operation screen 300E used to select whether or not to image the measurement area, (C) is the operation screen 300F during imaging, and (D) is the operation screen 300G for instructing the start of measurement. In Figure 9, parts corresponding to those in Figure 7 are indicated with corresponding reference numerals.

[0056] The selection screen 300I shown in Figure 9(A) includes a button 318 labeled "Continue Measurement," a button 319 labeled "End," a display area 320 for the analysis results of the first measurement, and a button 321 labeled "Details." In Figure 9(A), the selected state of button 318 is indicated by shading. If button 318 is selected, the same measurement as the first measurement will begin. If button 319 is selected, the measurement of vibration data will be immediately terminated, and the system will return to the initial screen 300A.

[0057] The analysis results display area 320 shows, alongside selection checkboxes, the time the first measurement was performed and the completion of the transmission of vibration data to the analysis server 40. In the case of the operation screen 300I shown in Figure 9(A), 16:31 is indicated as the time of the first measurement. If button 321 is selected, the detailed results of the first vibration data analysis will be displayed.

[0058] The operation screen 300E shown in Figure 9(B) is the same as the operation screen 300E in Figure 7(A). In Figure 9(B), the button 309 labeled "Image measurement location" is selected. The operation screen 300F shown in Figure 9(C) is the same as the operation screen 300F shown in Figure 7(B). When the imaging button 313 is tapped in Figure 9(C), the operation screen 300F transitions to the operation screen 300G shown in Figure 9(D). The screen transitions after the start of measurement are the same as for the first imaging, so the explanation is omitted.

[0059] <If you do not measure the image of the measurement location> Figure 10 illustrates other examples of transitions in the operation screen displayed after the first measurement is completed when the simplified measurement mode is selected. (A) is the operation screen 300I used to select whether or not to continue measuring, (B) is the operation screen 300E used to select whether or not to image the measurement area, and (C) is the operation screen 300H that indicates that measurement is in progress. Figure 10 is denoted with reference numerals corresponding to the parts that correspond to those in Figures 7 and 9. In Figures 10(A) and (B), after selecting button 318, button 310 labeled "Do not image" is selected. As a result, the operation screen 300E transitions to the operation screen 300H shown in Figure 10(C), and vibration data recording begins.

[0060] <If the details button is pressed after the second measurement is completed> Figure 11 illustrates other transitions in the operation screen displayed after the second measurement is completed when the simplified measurement mode is selected. (A) is the operation screen 300J immediately after the second measurement is completed, (B) is the selection screen 300J showing the state when the button 321A labeled "Details" is selected, (C) is the detailed analysis result display screen 300K, and (D) is the operation screen 300J after the "Close" button 325 has been operated. Figure 11 shows the corresponding parts with reference numerals, as shown in Figure 9.

[0061] The operation screen 300J shown in Figure 11(A) displays two analysis result fields 320A and 320B, with corresponding buttons 321A and 321B labeled "Details". In Figure 11(A), the second analysis result has already been notified from the analysis server 40. Therefore, display field 320B shows that the second measurement time was 16:32 and the probability of a water leak is 0%. In Figure 11(A), neither button is selected.

[0062] In the operation screen 300J shown in Figure 11(B), button 321A, which corresponds to the display field 320A for the first analysis results, is selected. When button 321A is selected, the operation screen 300J shown in Figure 11(B) transitions to the detailed display screen 300K shown in Figure 11(C). The detailed display screen 300K shown in Figure 11(C) displays the spectrum 322 of the vibration data recorded in the first measurement, the leakage probability column 323 of the first measurement results, an image 324 of the measurement location taken during the first measurement, and a button 325 labeled "Close".

[0063] The detailed display screen 300K shows spectrum 322, allowing operators to visually determine the characteristics of the vibration data. Because the characteristics of the vibration data are visualized, the skilled ability to distinguish vibration data by ear is not required. Furthermore, the detailed display screen 300K shows in the leak probability column 323 that the probability of the measurement point being a leak point is 0% based on the first analysis results. By referring to the probability, the operator can assist in making their own judgment based on the spectrum 322. When button 325 is operated, the screen transitions from the detailed display screen 300K to the operation screen 300J shown in Figure 11(D).

[0064] In the operation screen 300J shown in Figure 11(D), the button 319 labeled "End" is selected. When button 319 is selected, the measurement of vibration data is immediately terminated, and the system transitions to the initial screen 300A shown in Figure 6(A). The simplified measurement mode is a measurement mode used by on-site workers to quickly and efficiently identify leaky pipelines; therefore, vibration data and analysis results are not stored in the analysis server 40.

[0065] <If the "Compare the two analysis results" button is pressed after the second measurement is completed> Figure 12 illustrates other transitions in the operation screen displayed after the completion of the second measurement when the simplified measurement mode is selected. (A) is the operation screen 300J immediately after the completion of the second measurement, (B) is the operation screen 300L which shows the state in which the checkboxes for the first and second analysis results are selected, (C) is the comparison screen 300M of the two selected analysis results, and (D) is the operation screen 300N after the "close" button 325 has been operated. The comparison screen 300M here is an example of a "screen" in the claims. Figure 12 shows the parts corresponding to those in Figure 11, indicated by corresponding reference numerals.

[0066] The operation screen 300J shown in Figure 12(A) displays two analysis result fields 320A and 320B, with corresponding buttons 321A and 321B labeled "Details". In Figure 12(A), the second analysis result has already been notified from the analysis server 40. Therefore, display field 320B shows that the second measurement time was 16:32 and the probability of a water leak is 0%. In Figure 12(A), neither button is selected.

[0067] In the operation screen 300L shown in Figure 12(B), a button 326 labeled "Compare" is displayed as a result of two checkboxes being selected. In Figure 12(B), button 326 is selected. The comparison screen 300M shown in Figure 12(C) displays spectra 327 corresponding to the vibration data recorded in the first and second measurements, the leakage probability column 328A for the first measurement result, the leakage probability column 328B for the second measurement result, and a button 325 labeled "Close".

[0068] On the comparison screen 300M, the first leak probability column 328A and the second leak probability column 328B are displayed side by side, allowing the operator to visually determine the possibility of a leak. When the "Close" button 325 is pressed on the comparison screen 300M, the system transitions to the operation screen 300N shown in Figure 12(D). When the system transitions to the operation screen 300N by pressing the "Close" button 325, the checkboxes in the analysis result display fields 320A and 320B are displayed in an unchecked state. In Figure 12(D), the "End" button 319 is selected. When button 319 is selected, the measurement of vibration data is immediately terminated, and the system transitions to the initial screen 300A shown in Figure 6(A). The simplified measurement mode is a measurement mode used by on-site workers to quickly and efficiently identify leaky pipelines; therefore, vibration data and analysis results are not stored in the analysis server 40.

[0069] <Detailed Measurement Mode> The following sections will explain the processing actions and screen transitions performed when selecting the detailed measurement mode, using Figures 13 to 20. Note that the screen transitions and transitions described below are examples only. In this embodiment, the detailed measurement mode is a measurement mode used to pinpoint locations that are highly likely to be leaks.

[0070] Figure 13 illustrates an example of processing operations performed through the cooperation between the information terminal 30 and the analysis server 40 when the operator selects the detailed measurement mode. In the figure, the symbol S represents a step. The processing procedure shown in Figure 13 is initiated when a negative result is obtained in step 2 (see Figure 5) as described above. This is because this embodiment assumes two selectable measurement modes: a simplified measurement mode and a detailed measurement mode. Figures 14 to 20 show examples of the transitions in the operation screen displayed on the information terminal 30 (see Figure 1) when the detailed measurement mode is selected.

[0071] The process shown in Figure 13 is also realized through the execution of programs by the processor 31 of the information terminal 30 (see Figure 3(A)) and the processor 41 of the analysis server 40 (see Figure 3(B)). The information terminal 30, which has started the detailed measurement mode, accepts input of construction information and site information (step 21). Figure 14 illustrates an example of the transitions between operation screens up to the input of construction information when the detailed measurement mode is selected. (A) is the initial screen 300A, and (B) to (D) are the construction information input screens 300O to 300Q. Figure 14 is denoted with corresponding symbols for parts that correspond to Figure 6.

[0072] The initial screen 300A shown in Figure 14(A) has a button 301 labeled "Simple Measurement" and a button 302 labeled "Detailed Measurement". In Figure 14(A), the selected state of button 302 is indicated by shading. The input screen 300O shown in Figure 14(B) is used to select a registered project name or to register a new project name.

[0073] The input screen 300O displays a list of registered project names 330, including Project 1 to Project 7. At the bottom of the input screen 300O is a button 331 labeled "New Registration." In the input screen 300O shown in Figure 14(B), the selected state of button 331 is indicated by shading. Incidentally, if one of the registered project names is selected, the user will be redirected from input screen 300O to the site information input screen.

[0074] The input screen 300P shown in Figure 14(C) is used to enter the name of a new construction project. The input screen 300P has input fields 332 for registration details, a button 333 labeled "Cancel", and a button 334 labeled "Register". In the case of the input screen 300P shown in Figure 14(C), the registration items provided are "Project Name," "Project Number," "Site Address," and "Comments." When button 333 is pressed, the screen transitions to the input screen 300O. On the other hand, when button 334 is pressed, the entered information is registered, and the screen transitions to the input screen 300Q shown in Figure 14(D). In the input screen 300Q shown in Figure 14(D), the line "Project Name 8: Buried Pipe Measurement 1" has been added.

[0075] After a predetermined amount of time has elapsed since the display of the input screen 300Q shown in Figure 14(D), the screen switches to the input screen for on-site information. Figure 15 illustrates an example of the transitions used for inputting field information when the detailed measurement mode is selected. (A) to (C) are the field information input screens 300B to 300D. Figure 15 is indicated with corresponding symbols for parts that correspond to those in Figure 6.

[0076] The input screen 300B shown in Figure 15(A) is for inputting the material of pipes buried or exposed at the site. The screen contains a material selection field 303, a button 304 with a left-pointing arrow indicating "back", a button 305 with a right-pointing arrow indicating "forward", and a "cancel" button 306. When button 304 is pressed, the screen transitions to input screen 300O (or input screen 300Q). On the other hand, when button 305 is pressed, the screen transitions to input screen 300C shown in Figure 15(B).

[0077] The input screen 300C shown in Figure 15(B) is for inputting the equipment used to measure vibration data. The screen contains an equipment selection field 307, a button 304 with a left-pointing arrow indicating "back", a button 305 with a right-pointing arrow indicating "forward", and a "cancel" button 306. When button 304 is pressed, the screen transitions to the previous input screen 300B. On the other hand, when button 305 is pressed, the screen transitions to the input screen 300D shown in Figure 15(C).

[0078] The input screen 300D shown in Figure 15(C) is for inputting the measurement depth, and on this screen there is a depth selection field 308, a button 304 with a left-pointing arrow indicating "back", a button 305 with a right-pointing arrow indicating "forward", and a "cancel" button 306. When button 304 is pressed, the screen transitions to the previous input screen 300C. On the other hand, when button 305 is pressed, the screen transitions to the operation screen 300R shown in Figure 16(A).

[0079] Returning to the explanation of Figure 13. Once the input of construction information and site information is completed in step 21, the information terminal 30 determines whether or not to acquire an overall image of the measurement location (step 22). If a positive result is obtained in step 22, the information terminal 30 acquires an overall image of the type specified by the worker (step 23). For example, an image of the area with a high probability of water leakage is acquired. Next, the information terminal 30 synthesizes a mesh onto the overall image (step 24). As mentioned above, the mesh is composed of multiple sections. In this embodiment, the arrangement of the sections is predetermined.

[0080] Next, the information terminal 30 accepts the worker's designation of a measurement point (step 25). The measurement point here is designated as one of several sections that make up the mesh. Next, the information terminal 30 determines whether or not to image the measurement area (step 26). If a negative result is obtained in step 22, the information terminal 30 skips steps 23 to 25 and performs the determination in step 26. The images captured in step 26 are not for identifying the measurement points, but rather any images that can be associated with the measurement points.

[0081] If a positive result is obtained in step 26, the information terminal 30 acquires the captured image (step 27). For capturing the image, for example, the camera 35 of the information terminal 30 (see Figure 3(A)) is used. When an image is acquired in step 27, or when a negative result is obtained in step 26, the information terminal 30 starts measurement (step 28) and transmits the acquired vibration data, etc., to the analysis server 40 (step 29). At this point, information such as construction information, site information, and the date and time of measurement, which are linked to the vibration data, are also uploaded.

[0082] Upon receiving vibration data, the analysis server 40 analyzes the vibration data (step 30). Once the analysis process is complete, the analysis server 40 transmits the analysis results to the information terminal 30 (step 31). The analysis server 40 also records the acquired measurement data in the database 400 (see Figure 4) (step 32). Meanwhile, the information terminal 30 that receives the analysis results displays the results linked to specific measurement points within the mesh (step 33). Next, the information terminal 30 determines whether or not it has been set as a water leak location (step 34). Specifically, it determines whether or not the worker has set it as a water leak location.

[0083] If a positive result is obtained in step 34, the information terminal 30 instructs the analysis server 40 to set the leak location (step 35). Upon receiving the instruction, the analysis server 40 updates the database 400, linking it to the measurement point currently being analyzed (step 37). After setting the location of the water leak, or if a negative result is obtained in step 34, the information terminal 30 determines whether or not to continue the measurement (step 36). If a positive result is obtained in step 36, the information terminal 30 returns to step 25 and accepts the designation of a new measurement point. On the other hand, if a negative result is obtained in step 36, the information terminal 30 terminates the inspection process.

[0084] Figure 16 illustrates an example of the transitions between operation screens when the detailed measurement mode is selected and an overall image of the measurement area is measured. (A) is the operation screen 300R used to select whether or not to capture an overall image of the measurement area, (B) is the operation screen 300S during image capture, (C) is the operation screen 300T after image capture, and (D) is the operation screen 300U used to specify the measurement point. The selection screen 300R shown in Figure 16(A) has a button 335 labeled "Capture an overall image of the measurement area," a button 336 labeled "Do not capture," and a button 337 labeled "Cancel measurement." In Figure 16(A), the selected state of button 335 is shown by shading.

[0085] If button 336 is selected, the information terminal 30 immediately starts measuring vibration data. In this case, the selection screen 300R transitions to the operation screen 300H (see Figure 18). On the other hand, if button 337 is pressed, the information terminal 30 transitions to the initial screen 300A (see Figure 14(A)). The operation screen 300S shown in Figure 16(B) displays the subject image 312 within the imaging field of the camera 35 (see Figure 3(A)). In Figure 16(B), the vibration sensor 23 (notation omitted in the figure) is placed flat on the floor surface, which is the measurement location, and this is what is being captured. When the imaging button 313 is tapped, the subject image 312 at the time of the tap is acquired as the overall image 312A of the measurement location.

[0086] The operation screen 300T shown in Figure 16(C) displays the image acquired as a whole image. If the operator wishes to retake the displayed image, they operate button 338 labeled "Retake". Upon detecting the operation of button 338, the information terminal 30 returns to the operation screen 300S. On the other hand, if the displayed image is to be used as is, the operator operates button 339 labeled "Use Photo". Upon detecting the operation of button 339, the information terminal 30 transitions to the operation screen 300U. In Figure 16(C), the selected state of button 339 is represented by shading.

[0087] The operation screen 300U shown in Figure 16(D) is used for specifying measurement points. In the case of the operation screen 300U, a virtual mesh 340 is superimposed on the overall image 312A and displayed in the center of the screen. In Figure 16(D), the mesh 340 consists of a total of 84 sections arranged in 12 rows and 7 columns. In this embodiment, the mesh configuration is determined by the initial settings. Note that in Figure 16(D), the cursor K, which indicates the location of a candidate measurement point, is located in the upper left corner of mesh 340.

[0088] The position of the cursor K, which specifies the measurement point, can be moved by operating the cursor key 341. Furthermore, even after acquiring the overall image 312A, imaging can be continued using the information terminal 30 fixed to a tripod or the like, and the captured images can be combined with the overall image 312A on the operation screen 300U. In this case, the actual positions of the tip of the listening rod 21 and the vibration sensor 23 can be confirmed on the screen. This makes it easier to ensure the identity between the area specified on the screen and the actual positions where the tip of the listening rod 21 and the vibration sensor 23 are installed.

[0089] However, this method is just one example; the images of the measurement points captured for each measurement can be matched with the overall image 312A using image processing to confirm the agreement between the designated area and the actual measurement points. Furthermore, if the designated area on the overall image 312A does not coincide with the actual measurement point, the relationship between the actual measurement point and the area on the overall image 312A may be automatically adjusted by image processing.

[0090] Alternatively, a survey map of the site may be generated using LiDAR (=Light Detection and Ranging) or the like installed in the information terminal 30 and used for the overall image. A virtual map created by combining the survey map with mesh 340 may be linked with other devices related to the field work, such as other smartphones or smart glasses. If there are man-made or natural objects that can be used as markers in the virtual map, the markers can be captured within the field of view of the cameras of other smartphones or smart glasses, making it easy to share the mesh 340 and designated measurement points as seen from the location of the other device.

[0091] The markers can be natural objects such as stones or wood, or artificial objects such as plastic ornaments using multiple colors such as red, blue, and yellow. Multiple markers, preferably three or more, are preferred for determining the orientation. It is desirable that the markers have a color, shape, and size that allows them to be distinguished from others. Furthermore, this function makes it easy to guide on-site workers to designated measurement points. Guidance can be done using voice, or by displaying virtual arrows on the display of another smartphone or in front of the wearer of smart glasses. In other words, augmented reality (AR) technology can also be used.

[0092] Alternatively, a projector may be used to project an image of the mesh 340 onto the leak inspection site so as to match the mesh 340 on the captured overall image 312A. If the image of the mesh 340 projected by the projector matches the mesh 340 captured as part of the overall image 312A displayed on the screen, then after capturing the overall image 312A, even if the actual measurement points are determined by referring to the mesh 340 sections projected onto the site, the identity with the sections specified on the operation screen 300U can be ensured.

[0093] Furthermore, when projecting an image of the mesh 340 onto the site using a projector and capturing the projected site as an overall image 312A, if measurements are taken with the listening rod 21 and vibration sensor 23 positioned within the projected image's boundaries and the results are captured by the camera 35, it is not necessary to composite the mesh 340 onto the overall image 312A on the information terminal 30. In this case, the image of the projected mesh 340 becomes the overall image. In this case, the overall image 312A is processed to extract the straight line portions corresponding to the mesh 340, and the area enclosed by the extracted straight lines is identified as a boundary. The identified boundary is then managed using mesh position information 404 (see Figure 4).

[0094] Furthermore, in this embodiment, a virtual mesh 340 is composited into the overall image 312A. However, prior to the inspection, surveying strings may be set up in a matrix pattern at the site, and this state may be captured as the overall image 312A. In this case, the mesh 340 included in the overall image 312A is provided by the actual surveying strings. In this case as well, just as when the image of the mesh 340 is projected at the site, the straight lines corresponding to the surveying strings can be extracted by image processing of the captured overall image 312A, and the regions enclosed by the extracted straight lines can be identified as sections, thereby enabling the management of measurement points.

[0095] Furthermore, the upper part of the operation screen 300U shown in Figure 16(D) displays an index 342 that uses color to represent the probability of a water leak. The index 342 shown in Figure 16(D) has six levels: "0%", "20%", "40%", "60%", "80%", and "Water Leak", with darker colors indicating a higher probability. Note that this classification and display format is just one example. In addition, the operation screen 300U displays a column 343 showing the number of measured sections. In the case of Figure 16(D), the number of measured sections is 0 (zero) because the overall image 312A has just been captured. The denominator is 84 (=12 × 7).

[0096] The operation screen 300U also includes a button 344 for setting the area where the cursor K is located as a measurement point, a button 345 for displaying detailed analysis results of the measurement location on the screen, and a button 346 for ending the measurement in detailed measurement mode. Button 344 is labeled "Measurement Point." Button 345 is labeled "Display." Button 346 is labeled "Back."

[0097] Figure 17 illustrates an example of the transitions between operation screens displayed before the first measurement is started when the detailed measurement mode is selected. (A) is the operation screen 300V when setting the measurement location, (B) is the operation screen 300E when imaging the measurement location, (C) is the operation screen 300T immediately after imaging, and (D) is the operation screen 300G for starting the measurement. Figure 17 is denoted with reference numerals corresponding to the parts that correspond to Figures 7 and 16.

[0098] In the case of the operation screen 300V shown in Figure 17(A), the cursor K is moved to the area where the vibration sensor 23 (see Figure 1), which is laid flat on the floor, is located. When button 344 is operated, the area where cursor K is located is set as the measurement location. After this, the operation screen 300V transitions to the operation screen 300E. The operation screen 300E shown in Figure 17(B) has a button 309 labeled "Image measurement location," a button 310 labeled "Do not image," and a button 311 labeled "Cancel measurement." In Figure 17(B), the selected state of button 309 is indicated by shading.

[0099] When button 309 is pressed, the operation screen 300E transitions to the operation screen 300T via the operation screen 300F (see Figure 7(B)). The operation screen 300T shown in Figure 17(C) displays the subject image 312 within the imaging field of the camera 35 (see Figure 3(A)). The subject image 312 here is an image captured independently of the overall image 312A. The operation screen 300G shown in Figure 17(D) displays a button 314 labeled "Start Measurement" and a button 315 labeled "Stop Measurement". In this case, button 314, which is used to instruct the start of measurement, is selected. By operating button 314, operation screen 300G transitions to operation screen 300H (see Figure 18(A)).

[0100] Figure 18 illustrates an example of the transition of the operation screen when on-site measurements are repeated while the detailed measurement mode is selected. (A) is the operation screen 300H which indicates that measurement is in progress, (B) is the operation screen 300U which is displayed immediately after the measurement of two measurement points is completed, (C) is the operation screen 300U which is displayed immediately after the measurement of three measurement points is completed, and (D) is the operation screen 300U which is displayed immediately after the measurement of six measurement points is completed. Figure 18 is indicated with reference numerals corresponding to the parts that correspond to those in Figures 7 and 16.

[0101] As the number of measurement locations increases, the number displayed in the measurement area 343 is also counted up. Furthermore, within the overall image 312A, the sections where vibration data has been measured are colored according to the analysis results. The color of the sections is updated each time the analysis results are notified from the analysis server 40 (see Figure 1). According to the operation screen 300U shown in Figure 18(D), it is highly likely that water leakage is occurring at the 4th to 6th designated measurement points.

[0102] In Figure 18(D), button 345, used to display detailed analysis results of the measurement location, is selected. When button 345 is operated, the operation screen 300U transitions to the information screen 300X shown in Figure 19(A). The information screen 300X here is an example of a "screen" in the claims. Figure 19 illustrates an example of an operation screen used to display detailed analysis results of measurement points. (A) represents the top of the screen, and (B) represents the bottom of the screen. In the information screen 300X shown in Figure 19(A), the slider of scroll bar 357 is located at the top of the screen. Therefore, the top of the analysis results page is displayed. In contrast, in the information screen 300X shown in Figure 19(B), the slider of scroll bar 357 is located at the bottom of the screen. Therefore, the bottom of the analysis results page is displayed.

[0103] The information screen 300X shown in Figures 19(A) and (B) includes a mesh information field 347, a leakage probability field 348, a diagnostic comment field 349, a measurement data field 350, a measurement date and time field 351, a measurer field 352, a tag field 353, a measurement location image field 354, and a spectrum field 355. In addition, the information screen 300X has a button 356 labeled "Set as leak location," a scroll bar 357, and a button 358 labeled "Back." When button 358 is pressed, the user returns to the previous screen.

[0104] The mesh information section 347 here displays the structure and type of the mesh used. For example, it may show that it consists of 84 sections arranged in 12 rows and 7 columns. The water leakage probability field 348 displays the water leakage probability calculated by the analysis server 40 (see Figure 1). Since button 356 is selected, "100%" is displayed for the water leakage probability. Incidentally, even if a measurement point has been set as a water leakage location, it can be reset by operating button 356 again. Button 356 here is an example of an interface for registering a specific measurement point on the overall image 312A as a leak point. Voice recognition technology may be used to set the leak location. Additionally, a dedicated hardware key may be provided on the device body 25 or similar for setting the leak location.

[0105] Additionally, the diagnostic comment field 349 displays a brief diagnostic comment notified by the analysis server 40. Here, the fact that the worker has identified the leak location is displayed. The fact that the worker has identified the leak location is also uploaded to the analysis server 40 and reflected in the database 400 (see Figure 4).

[0106] The measurement data section 350 displays various information related to the acquisition of vibration data. On the information screen 300X, the measurement date and time field 351, measurer field 352, tag field 353, image field 354 of the measurement location, and spectrum field 355 are displayed in association with the measurement data field 350. The information in each field related to the measurement data field 350 is stored in the database 400, linked to the measurement location. The image of the measurement location (354) can also be used to confirm the measurement location during a subsequent visit. Furthermore, the spectrum of the vibration data is displayed in the spectrum column 355. This means that the operator can visually confirm the characteristics of the vibration data. Displaying the spectrum of the vibration data makes it easier to determine whether a water leak has occurred compared to listening to the vibration data.

[0107] Figure 20 illustrates an example of the transition of the operation screen when exiting the detailed measurement mode. (A) shows the operation screen 300U when the end of the measurement is instructed, (B) shows the operation screen 300Y for specifying how to handle the measurement results, and (C) shows the operation screen 300Z used to exit the detailed measurement mode. Figure 20 shows the parts corresponding to those in Figure 16, indicated by corresponding reference numerals. In the operation screen 300U shown in Figure 20(A), the button 346 labeled "Back" is selected. In this case, the information terminal 30 recognizes the end of the measurement in detailed measurement mode.

[0108] When the operator operates button 346, the operation screen 300U transitions to the operation screen 300Y shown in Figure 20(B). The operation screen 300Y includes a button 359 used to instruct the output of a report linked to the initially entered project name, and a button 360 used to instruct the registration of a new measurement result. Button 359 is labeled "Output Results," and button 360 is labeled "New Registration." In Figure 20(B), button 360 is selected. The operation screen 300Z shown in Figure 20(C) has a button 361 labeled "Exit". Button 361 in Figure 20(C) is selected. When button 361 is pressed, the screen returns to the initial screen 300A (see Figure 14).

[0109] <Summary> In this embodiment, the spectrum of vibration data measured on-site is displayed on the information terminal 30 as an analysis result. Therefore, workers performing tasks on-site can visually confirm the differences in the frequency characteristics of the vibration data. Furthermore, since the spectrum of vibration data is displayed, even workers without specialized skills can accurately identify the location of water leaks. Furthermore, the display of the vibration data spectrum facilitates information sharing and skill transfer.

[0110] Furthermore, in this embodiment, the probability that a measurement point is a leak location is displayed on the screen in text and color. In particular, in detailed measurement mode, the area designated as the measurement point within the mesh 340 is displayed in a color corresponding to the probability that it is a leak location, making it easy to confirm the leak location on site. Furthermore, because the actual measurement points are linked to the sections within the 340-mesh grid, the discrepancy between the measurement points in the data and the measurement points on site can be reduced. As a result, leak locations can be pinpointed even during subsequent repair work. Furthermore, in this embodiment, a button 356 (see Figure 19) is provided for setting a measurement point corresponding to the information screen 300X (see Figure 19) as a leak location, so that the determination of the leak location by the on-site worker can be recorded.

[0111] <Embodiment 2> <System Configuration> Figure 21 is a diagram illustrating a conceptual configuration example of the leak detection system 1A used in Embodiment 2. Figure 21 is denoted with reference numerals corresponding to the parts that correspond to those in Figure 1. In the case of the leak detection system 1A shown in Figure 21, the leak detection system 10A differs from the leak detection system 10 (see Figure 1) described in Embodiment 1 in that the leak detection system 10A consists of a leak detector 20 and a device body 250.

[0112] The device body 250 used in this embodiment is a device that integrates the device body 25 (see Figure 1) and the information terminal 30 (see Figure 1) from Embodiment 1. Figure 22 is a diagram illustrating the overview of the data flow between the devices that make up the leak detection system 1A used in Embodiment 2. Figure 22 is denoted with reference numerals corresponding to the parts that correspond to those in Figure 2.

[0113] The main unit 250 shown in Figure 22 consists of a main circuit 25A and an information processing unit 25B. The hardware configuration of the information processing unit 25B is the same as that of the information terminal 30 shown in Figure 3(A), for example. Specifically, the information processing unit 25B is equipped with a processor 31 that executes programs necessary for displaying the operation screen to be presented to the on-site worker, a touch panel 34 used for displaying the operation screen, a camera 35 used for capturing an overall image of the site 312A (see Figure 17(A)) and an image of the subject at the measurement location 312 (see Figure 17(C)), and a communication module 36 used for communication with the analysis server 40. The device body 250 shown here is an example of a leak detection device.

[0114] <Embodiment 3> Figure 23 is a diagram illustrating a conceptual configuration example of the leak detection system 1B used in Embodiment 3. (A) is an example of the external appearance of the leak detection system 1B, and (B) is a diagram illustrating an overview of the data flow between the devices constituting the leak detection system 1B. In Figure 23, parts corresponding to those in Figure 1 are indicated with corresponding reference numerals. The leak detection system 1B shown in Figure 23 differs from the leak detection system 10 (see Figure 1) described in Embodiment 1 and the leak detection system 10A (see Figure 21) described in Embodiment 2 in that the leak detection system 10B consists of a leak detector 20 and a device body 260, and the device body 260 performs vibration data analysis processing.

[0115] In other words, the leak detection system 1B used in this embodiment does not require an analysis server 40 (see Figure 1). The main unit 260 shown in Figure 23(B) consists of a main circuit 25A and an information processing unit 25C. The hardware configuration of the information processing unit 25C is the same as that of the information processing unit 25B (see Figure 22) described in Embodiment 2. However, the computing power of the information processing unit 25C is significantly faster than that of the information processing unit 25B described in Embodiment 2, and it has sufficient storage capacity to store measurement data. In this system configuration, communication with the analysis server 40 is unnecessary, making it possible to perform leak detection tests at measurement points even in locations with poor communication conditions. The device body 260 shown here is an example of a leak detection device.

[0116] <Other Embodiments> (1) Although embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the embodiments described above. It is clear from the claims that embodiments with various modifications or improvements made to those described above are also included in the technical scope of the present invention.

[0117] (2) In the above embodiment, when button 335 (see Figure 16(A)) is operated, the camera 35 (see Figure 3) of the information terminal 30 (see Figure 1) starts capturing an overall image 312A (see Figure 16(D)). However, after operating button 335, an operation screen 300AA for selecting the type of overall image 312A may be displayed. Figure 24 illustrates an example of an operation screen used to select the type of image to be used as the overall image 312A.

[0118] The operation screen 300AA shown in Figure 24 has the following buttons: button 371 labeled "Use images captured by camera", button 372 labeled "Use map", button 373 labeled "Use piping diagram", button 374 labeled "Use aerial photograph", button 375 labeled "Use photographs taken by drone", and button 376 labeled "Stop measurement". The labels attached to buttons 371-375 and the number of buttons shown are examples only. When any of the buttons are pressed, a screen for selecting the corresponding type of image is displayed instead of the operation screen 300S (see Figure 16(B)) or the operation screen 300T (see Figure 16(C)).

[0119] Figure 25 illustrates an example of the display of the operation screen 300U when using an aerial photograph taken from above, an image taken by a drone, or any similar image as the overall image of the leak inspection site. In Figure 25, parts corresponding to those in Figure 16(D) are indicated with corresponding reference numerals. In the operation screen 300U shown in Figure 25, a virtual mesh 340 is displayed in an aerial photograph of the site where multiple vehicles are parked, and the leakage probability notified as an analysis result is displayed in different colors for each measured location within the sections that make up the mesh 340.

[0120] (3) In the above embodiment, an example was described in which the spectrum is displayed as the result of the analysis of vibration data, but the spectrum may also be displayed. Figure 26 illustrates an example of a spectrum resulting from the analysis of vibration data. (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when water leakage is suspected, and (C) is an example of a spectrum when water leakage is highly likely. In the absence of water leakage (i.e., as shown in Figure 26(A)), the sound pressure levels at all frequencies are low and show no temporal variation.

[0121] On the other hand, when a water leak is suspected (i.e., in the case of Figure 26(B)), an increase in sound pressure levels is observed in the mid-to-high frequency range, and in particular, high sound pressure levels appear over time in the mid-range frequency range. However, the sound pressure levels are discrete and are likely to be temporary noise. In cases where a water leak is highly likely (i.e., as shown in Figure 26(C)), the sound pressure level in the mid-to-high frequency range remains high and persistent. When this spectrum appears, even an unskilled person can easily determine that there is a very high probability that a water leak is present.

[0122] (4) In the above embodiment, the case in which a mesh 340 with a structure given in the initial settings is composited into the overall image 312A was described, but the structure of the mesh 340 may be changed by the operator. Figure 27 illustrates an example of the transition of the operation screen before and after a change in the structure of mesh 340. (A) shows the overall image 312A with the mesh 340 set in the initial settings, (B) shows an example of the screen used to accept a change in the structure of mesh 340, and (C) shows the overall image 312A with the modified mesh 340.

[0123] The operation screen 300U shown in Figure 27(A) is the same as the operation screen 300U shown in Figure 16(D). Therefore, a mesh 340 consisting of 12 rows and 7 columns is superimposed on the overall image 312A. The operation screen 300U shown in Figure 27(B) displays a pop-up screen 361A used to accept changes to the mesh structure (hereinafter referred to as the "change acceptance screen") 361A. The change acceptance screen 361A has a display field 362 showing the current structure, a display field 363 showing the structure after the change, and an execution button 364 for the change.

[0124] In the change request screen 361A shown in Figure 27(B), the values ​​for the changed number of rows and columns are input fields. For example, the input values ​​may be displayed outside the fields. Display field 363 shows an example of changing to 4 rows and 4 columns. In the case of the operation screen 300U shown in Figure 27(C), the structure of the mesh 340 superimposed on the overall image 312A has been changed to 4 rows and 4 columns. Using this function, it becomes possible to freely set the mesh structure according to the site conditions.

[0125] Furthermore, the structure of the mesh 340 may be automatically adjusted according to the scale information of the overall image 312A and the displayed size of the overall image 312A shown on the operation screen 300U. For example, the structure of mesh 340 is automatically optimized for a 1:1 scale and a 1:100 scale. If the structure of mesh 340 is the same, even if it is the same single section on the overall image 312A, the size of each section in real space will differ greatly. For example, if one section on the screen corresponds to a 20m x 20m area in real space, it will be difficult to pinpoint the location of the water leak in real space. Therefore, when scale information is available, the structure of mesh 340 is automatically adjusted according to the scale.

[0126] Furthermore, if the overall image 312A displayed on the operation screen 300U is small, displaying the mesh 340 with the same structure as when the display size is large may impair the visibility of the sections. In such cases, the structure of the mesh 340 composited on the screen may be automatically changed to ensure visibility.

[0127] (5) In the above-described embodiments 1 and 2, the analysis server 40 (see Figures 1 and 21) performs analysis of vibration data measured on-site and records the measurement data, etc., into a database. In addition to these functions, it may also perform operations related to the operation screen displayed on the information terminal 30 (see Figure 1) used on-site and the touch panel 34 (see Figure 3) of the main unit 250 (see Figure 21), as well as the transitions between screens. In particular, the analysis server 40 may perform functions to display an overall image of the leak inspection site as an operation screen and to accept specific sections of the overall image as measurement points. In this case, the information terminal 30 and the main unit 250 used at the site are used as information input / output devices. The analysis server 40 having these functions is an example of an information processing device that works in conjunction with a leak inspection device used at the site, as well as an example of a computer used for leak inspection.

[0128] Alternatively, separate servers may be provided for analyzing vibration data and for providing the operation screens for the information terminals 30 and the main unit 250 used on-site. In other words, a cloud service consisting of a service for analyzing vibration data and a service for managing the user interface and transitions between those interfaces may be implemented on a single server or through the cooperation of multiple servers. Incidentally, the server can take any form of hardware, as long as it is a computer that provides services to the information terminals 30 used on-site.

[0129] (6) In the above-described embodiment, an example was explained in which a virtual mesh 340 (see Figure 16(D)), in which each section is defined as a set of squares, is directly composited and displayed on the overall image 312A (see Figure 16(D)). However, when imaging the ground or walls at a leak inspection site, a wider imaging range results in imaging a plane from an oblique angle. For example, Figures 16(B) and 16(C) show examples of imaging a floor covered with square tiles, but because the image is taken from diagonally above the floor, the tiles appear trapezoidal. In other words, the imaging direction of the information terminal 30 is tilted in one axis direction from the direction directly facing the floor. Therefore, when compositing the mesh 340, the tilt angle may be calculated from the subject in the overall image 312A, the mesh 340 may be deformed trapezoidally according to the calculated tilt angle, and the deformed mesh 340 may be composited into the overall image 312A. Note that the deformation of the mesh 340 may also be performed via a manual interface. [Explanation of Symbols]

[0130] 1, 1A, 1B… Leak detection system; 10, 10A, 10B… Leak detection system; 20… Leak detector; 21… Listening rod; 23… Vibration sensor; 25, 250, 260… Main unit; 25B, 25C… Information processing unit; 30… Information terminal; 40… Analysis server; 400… Database

Claims

1. A leak detection device used by workers at a site where fluid leaks from pipes are being inspected, During the inspection process, an acquisition unit acquires vibration data from the measurement point, A reception unit that superimposes and displays virtual sections on an overall image of the work site displayed on the work screen, and accepts the location of the section selected by the worker as the measurement point, A control unit that displays the spectrum or spectrum of the vibration data on the aforementioned work screen as a result of real-time analysis of the vibration data, A leak detection device having the following features.

2. The control unit places a button on the work screen for registering the displayed measurement point as a leak point. The leak detection device according to claim 1.

3. The control unit displays an image of the measurement point on the work screen. The leak detection device according to claim 1 or 2.

4. The control unit displays information on the work screen indicating the probability that leakage has occurred at the measurement point. A leak detection device according to any one of claims 1 to 3.

5. The aforementioned probability is displayed in relation to multiple measurements taken at the same measurement point. The leak detection device according to claim 4.

6. A computer used to test for fluid leaks from pipes, During the inspection process, it has a function to acquire vibration data from the measurement point, The system includes a function that superimposes and displays virtual sections onto an overall image of the work site displayed on the work screen, and accepts the location of the section selected by the worker as the measurement point, The aforementioned work screen includes a function to display the spectrum or spectrum of the vibration data as a result of real-time analysis of the vibration data, A program to achieve this.

Images