Information processing system, information processing method, and program

Abstract

To provide an information processing system or the like capable of remotely supporting damage investigation of piping.SOLUTION: According to an aspect of the present invention, there is provided an information processing system including one or more processors. In the processor of the information processing system, in the vibration acquisition step, vibration data indicating vibration transmitted through the ground detected by a vibration inspection machine operated by a worker in an inspection area for damage to a buried pipe is acquired. In the vibration transmission step, the acquired vibration data is transmitted to a professional terminal, and the professional terminal is a terminal used by a professional who determines breakage of piping from vibration and has a function of outputting vibration. In the instruction acquisition step, instruction data indicating an instruction from the expert based on the vibration output by the expert terminal is acquired. In the instruction output step, an instruction indicated by the acquired instruction data is output from an operator terminal used by an operator.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a technology that uses a movable vibration applying device that applies low-frequency vibrations from the ground surface and a plurality of water leakage sound detection devices that are placed at a distance from each other on a pipe buried underground, to calculate a pseudo-failure position of the pipe from the low-frequency vibrations detected by the plurality of water leakage sound detection devices, and to calculate an actual failure position of the pipe from the water leakage sounds of the pipe detected by the plurality of water leakage sound detection devices. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-39891 Summary of the Invention [Problem to be solved by the invention]

[0004] Even when it is not possible to attach a device to a pipe buried underground, as in the technology of Patent Document 1, it is possible to investigate whether or not the pipe is damaged and where the damage is located by measuring vibrations transmitted through the ground. In such cases, the way vibrations are transmitted varies depending on the underground structure, and various noises may be mixed into the vibrations transmitted through the ground, so damage investigation requires the know-how of an expert. However, if an expert goes to the investigation site to conduct the damage investigation, it takes time to travel, and depending on the situation at the site, multiple investigations may be necessary, making it difficult to increase the number of locations that can be investigated.

[0005] In view of the above circumstances, the present invention provides an information processing system and the like that can enable remote support for the investigation of pipe damage. [Means for solving the problem]

[0006] According to one aspect of the present invention, an information processing system including one or more processors is provided. In the processor of this information processing system, a vibration acquisition step acquires vibration data indicating vibrations traveling through the ground detected by a vibration surveying device operated by a worker in an area where buried pipe damage is being investigated. A vibration transmission step transmits the acquired vibration data to an expert terminal, and the expert terminal is a terminal used by an expert who determines whether the pipe is damaged from the vibration and has a function of outputting vibrations. An instruction acquisition step acquires instruction data indicating instructions from the expert based on the vibration output by the expert terminal. An instruction output step causes an instruction indicated by the acquired instruction data to be output from a worker terminal used by the worker.

[0007] According to this aspect, it is possible to provide remote support for the investigation of pipe damage. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing the overall configuration of a piping inspection support system 1. FIG. [Figure 2] FIG. 2 is a diagram illustrating a hardware configuration of the worker terminal 10. [Figure 3] FIG. 10 is an activity diagram showing an example of a piping inspection support process. [Figure 4] FIG. 10 is a diagram illustrating an example of a remote support screen. [Figure 5] FIG. 10 is a diagram illustrating an example of a position image. [Figure 6] FIG. 10 is a diagram showing an example of a displayed range image. [Figure 7] FIG. 2 is a diagram showing an example of a screen displayed on the worker terminal 10. [Figure 8] 10 is a diagram showing another example of a screen displayed on the worker terminal 10. FIG. [Figure 9] 1 is a diagram showing the overall configuration of a piping inspection support system 1a. DETAILED DESCRIPTION OF THE INVENTION

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings. Various features shown in the following embodiments can be combined with each other.

[0010] Incidentally, the program for realizing the software appearing in one embodiment may be provided as a non-transitory computer-readable medium, or may be provided so that it can be downloaded from an external server, or may be provided so that the program is started on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] Furthermore, various information processing according to an embodiment may realize input and output corresponding to the input. Here, the form of information referenced in such information processing (hereinafter referred to as reference information) is not limited as long as an output is obtained as a result of the input. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression formula constructed using a statistical method), a trained model that has previously trained the correlation between input and output, or a large-scale language model that can output a desired result by inputting a prompt.

[0012] In one embodiment, a "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In one embodiment, various information is handled, and this information is represented, for example, by physical values ​​of signal values ​​representing voltage and current, high and low signal values ​​as a binary bit set consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculations can be performed on a circuit in the broad sense.

[0013] Furthermore, a circuit in the broad sense is a circuit realized by at least an appropriate combination of a circuit, circuitry, processor, memory, etc. The processor may be a general-purpose processor or a dedicated circuit. That is, it includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0014] <Embodiment> 1. System Configuration The system configuration according to the embodiment will be described below. Fig. 1 is a diagram showing the overall configuration of the piping inspection support system 1. Fig. 1 shows an overview of each device provided in the piping inspection support system 1 and the users who use those devices. Each overview will be explained as needed, with reference to other figures.

[0015] The piping inspection support system 1 is an information processing system that performs information processing to support the inspection of pipes buried underground. The piping inspection support system 1 is used by a worker U1 who inspects pipes for damage on-site, and an expert U2 who can determine the presence and location of damage from vibrations transmitted underground. Damage inspections of pipes P1 can be conducted periodically, called planned inspections, or mobile inspections, which are conducted when a suspected damage is reported.

[0016] In either case, worker U1 sets the area to be investigated and conducts a damage investigation in the set investigation area. In the example of Figure 1, worker U1 conducts a damage investigation in investigation area R1 where pipe P1 is buried underground G1. A fluid W1 flows through pipe P1, and the fluid W1 leaks from a damaged location C1 into the underground G1. The fluid W1 may be either a liquid or a gas, such as water (water supply and sewerage) or gas (city gas, etc.).

[0017] The piping inspection support system 1 includes a communication line 2, a vibration inspection machine 3, a worker terminal 10, and an expert terminal 20. The communication line 2 is not particularly limited, but may be configured, for example, by the Internet. The communication line 2 may also include a local area network, a mobile communication network, a VPN (Virtual Private Network), etc. The communication line 2 mediates the exchange of data between devices connected to the communication line. In the example of FIG. 1, the worker terminal 10 and the expert terminal 20 are wirelessly connected to the communication line 2. The expert terminal 20 may also be connected to the communication line 2 via a wired connection.

[0018] The vibration surveying machine 3 is a machine for surveying vibrations transmitted through the ground. The vibration surveying machine 3 is equipped with a vibration sensor 4 connected by a cable, and generates vibration data by amplifying the underground vibrations detected by the vibration sensor 4. A worker U1 wears the vibration surveying machine 3 around his / her waist or the like, and while holding the cable, grounds the vibration sensor 4 to detect vibrations transmitted through the ground G1. The worker U1 grounds the vibration sensor 4 at multiple positions in the survey area R1 to detect vibrations at the multiple positions. The vibration surveying machine 3 is directly connected to a worker terminal 10 wirelessly or via a wire, and transmits the generated vibration data to the worker terminal 10.

[0019] The vibration surveyor 3 also includes a position sensor 5. The position sensor 5 is a sensor that measures its own position using a Global Navigation Satellite System (GNSS). The higher the positioning accuracy of the position sensor 5, the better. It is desirable to use a D (Differential)-GNSS with a positioning error of 1 m or less, or an RTK (Real Time Kinematic)-GNSS with a positioning error of a few centimeters. In the example of FIG. 1, the position sensor 5 has a positioning error of a few centimeters. The position sensor 5 is also provided in the vibration sensor 4, and measures a position that is approximately the same as the vibration detection position. The position sensor 5 also has a wireless communication function, and wirelessly transmits position data (data indicating latitude, longitude, etc.) indicating the measured position to the worker terminal 10.

[0020] The worker terminal 10 is a terminal for which the worker U1 is the user. The worker terminal 10 is a portable terminal, such as a smartphone, tablet terminal, or laptop computer. The worker terminal 10 transmits the vibration data transmitted from the vibration surveyor 3 and the position data transmitted from the position sensor 5 to the expert terminal 20 via the communication line 2.

[0021] The expert terminal 20 is a terminal for the expert U2 as a user, and is, for example, a personal computer or a tablet. The expert terminal 20 outputs, by sound or image, the underground vibrations indicated by the vibration data transmitted from the worker terminal 10. The expert terminal 20 also outputs the detection position indicated by the transmitted position data. Based on the output sound or image, the expert U2 determines whether or not there is a break in the pipe P1, and if there is a break, the location of the break. The expert U2 also instructs the worker U1 on the position where the vibration should be detected so that it will be easier to determine whether there is a break. The expert U2 gives instructions by voice, for example.

[0022] The expert terminal 20 transmits instruction data indicating instructions from the expert U2 to the worker terminal 10 via the communication line 2. The worker terminal 10 outputs the instructions indicated by the transmitted instruction data. The instructions are output by voice, image, or the like. Based on the output instructions, the worker U1, for example, places the vibration sensor 4 at the instructed position to detect vibrations. By repeating the above operations, the expert U2 determines whether or not the pipe P1 is damaged and the location of the damage from the vibrations detected by the work of the worker U1.

[0023] In the example of Figure 1, both the worker terminal 10 and the expert terminal 20 have installed an application program (hereinafter referred to as the "support app") for using the piping inspection support system 1, and the functions of the support app perform information processing such as output related to the piping inspection support system 1 and data exchange between terminals.

[0024] 2. Hardware Configuration The hardware configuration according to the embodiment will be described below. 2 is a diagram showing the hardware configuration of worker terminal 10. Worker terminal 10 includes control unit 11, storage unit 12, communication unit 13, input unit 14, output unit 15, and bus 16. Bus 16 electrically connects the various units included in worker terminal 10.

[0025] (Control unit 11) The control unit 11 is, for example, a central processing unit (CPU) not shown. The control unit 11 realizes various functions related to the piping inspection support system 1 by reading out predetermined programs stored in the memory unit 12. In other words, information processing by software stored in the memory unit 12 is specifically realized by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11. These will be described in further detail in the next section. Note that the control unit 11 is not limited to being single, and it may be implemented by having multiple control units 11 for each function. It may also be a combination of these.

[0026] (Storage unit 12) The memory unit 12 stores various pieces of information defined above. This can be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs and the like related to the piping inspection support system 1 executed by the control unit 11, or as a memory such as a random access memory (RAM) that stores temporarily required information (arguments, arrays, etc.) related to the program calculations. The memory unit 12 stores various programs, variables, etc. related to the piping inspection support system 1 executed by the control unit 11.

[0027] (Communications Department 13) The communication unit 13 is configured to be able to transmit various electrical signals from the worker terminal 10 to external components. The communication unit 13 is also configured to be able to receive various electrical signals from the external components to the worker terminal 10. More preferably, the communication unit 13 has a network communication function, which may enable communication of various information between the worker terminal 10 and external devices via the communication line 2.

[0028] (Input section 14) The input unit 14 has keys, buttons, a touch screen, a mouse, etc., and receives input from the user. The input unit 14 may also have a microphone and have the function of receiving voice input from the user.

[0029] (Output section 15) The output unit 15 has a display, a speaker, etc., and displays visual information generated in a manner that is visible to the user, such as a screen, an image, an icon, text, etc., on the display surface of the display, and outputs sounds including voice. The output unit 15 also has various sensors and outputs measurement results of these sensors to the control unit 11. The output unit 15 has, for example, a positioning sensor and outputs position data indicating the position of the terminal itself. The output unit 15 also has a three-axis angle sensor and outputs angle data indicating a three-dimensional orientation. The output unit 15 also has imaging means such as a digital camera and outputs video data indicating a video of the surrounding scenery, etc.

[0030] 2 has the same hardware configuration as the worker terminal 10. In the expert terminal 20, the control unit 21 and output unit 25 are denoted by different reference numerals from those of the control unit 11 and output unit 15 of the worker terminal 10. The output unit 25 has a display, a speaker, etc., but does not need to have the various sensors that the output unit 15 has.

[0031] 3. Information Processing The information processing according to the embodiment will be described below. In the following description, the worker terminal 10 and the expert terminal 20 will be described as the subjects of each information processing, but the information processing is executed by at least one processor included in the piping inspection support system 1, that is, the processor included in the control unit of each device (control units 11 and 21). The piping inspection support processing executed when inspecting damage to the piping P1 will be described below with reference to FIG. 3 etc.

[0032] FIG. 3 is an activity diagram showing an example of the piping inspection support process. The piping inspection support process is initiated when the expert U2 activates the expert terminal 20 and waits in a responsive state, and when the worker U1 puts on the vibration inspection device 3, picks up the worker terminal 10, and starts work in the inspection area R1. In FIG. 3, activities performed by people are represented by dotted lines. For example, first, the worker U1 grounds the vibration sensor 4 of the vibration inspection device 3 (activity A1).

[0033] Next, the vibration surveying machine 3 detects vibrations transmitted through the underground G1 using the vibration sensor 4 (activity A11). Hereinafter, the vibrations detected by the vibration surveying machine 3 will be referred to as "detected vibrations." Next, the vibration surveying machine 3 amplifies the detected vibrations (activity A12) and transmits vibration data indicating the amplified detected vibrations to the worker terminal 10. The vibration surveying machine 3 also measures the detected position using the position sensor 5 (activity A13) and transmits position data indicating the measured detected position to the worker terminal 10. Although the operations of A11 and A12 and A13 are shown aligned in a row in FIG. 3, in reality, these operations are performed in parallel and are continuously repeated until the operation of the vibration surveying machine 3 is stopped.

[0034] Next, a description will be given of the operations performed by the worker terminal 10 and the expert terminal 20 in parallel with A11 to A13. First, the expert terminal 20 displays a remote support screen in response to an operation by the expert U2 (activity A31). Fig. 4 is a diagram showing an example of a remote assistance screen. The remote assistance screen D1 shown in Fig. 4 displays a video display field E11, a map display field E12, and a vibration display field E13. The expert terminal 20 displays a map M12 including the investigation area R1 in the map display field E12 (activity A32).

[0035] The map M12 can be displayed in various ways. For example, the expert terminal 20 may store map data for all parts of the country in advance, and the expert U2 may specify a map including the survey area R1 based on the address of the survey area, etc., and display it as the map M12. Alternatively, the worker terminal 10 may transmit position data indicating the terminal position measured by a positioning sensor to the expert terminal 20 at the start of shooting. The expert terminal 20 may then display a map including the terminal position indicated by the transmitted position data as the map M12.

[0036] Next, the worker terminal 10 starts capturing images using the imaging means in response to an operation by the worker U1, and transmits the captured images to the expert terminal 20 in real time (activity A21). The expert terminal 20 displays the image L11 transmitted from the worker terminal 10 in the image display field E11 (activity A33). The image L11 shows the investigation area R1 as seen by the worker U1 and the vibration sensor 4 grounded at the detection position. The transmission and display of the images may be performed using the functions of a so-called video conference service, or a similar function may be implemented in the assistance app using well-known streaming technology.

[0037] Next, the worker terminal 10 generates on-site data indicating data obtained at the site based on the vibration data and position data transmitted from the vibration inspection device 3 (activity A22). The on-site data is, for example, data indicating the detected vibration indicated by the vibration data in association with the detected position indicated by the position data. The worker terminal 10 transmits the generated on-site data to the expert terminal 20. The expert terminal 20 outputs the detected vibration and detected position indicated by the transmitted on-site data (activity A34).

[0038] For example, as shown in FIG. 4, the expert terminal 20 displays a position image F11 representing the detection position indicated by the site data, superimposed on a map displayed in the map display field E12. The expert terminal 20 also outputs a sound (hereinafter also referred to as "detected sound") representing the detected vibration indicated by the site data from a speaker. The expert terminal 20 also outputs a waveform image N13 representing the waveform of the detected sound in the vibration display field E13. While the detected sound is output as a sound in the audible range, the waveform image N13 may also represent the waveform of a sound including sounds outside the audible range. Such a waveform image N13 can represent the characteristics of the sound even if the fluid W1 leaking from the damaged location C1 emits a sound outside the audible range. Based on the output detected sound and waveform image N13, the expert U2 determines whether the pipe P1 is damaged and, if so, the location of the damage.

[0039] The expert terminal 20 displays an operation image for controlling the output of the detected sound in the vibration display field E13. The expert terminal 20 adjusts the volume of the detected sound by operating the operation image. Furthermore, by saving the output site data, the expert terminal 20 outputs the detected sound in the following ways: pausing, fast-rewinding, fast-forwarding, rewinding a predetermined time ago (five seconds ago in the example of FIG. 4), and advancing a predetermined time later (five seconds later in the example of FIG. 4). This allows the user to listen to the detected sound again or return the output sound to the currently detected sound.

[0040] Next, the expert terminal 20 accepts input of instructions from the expert U2 (activity A35). The instructions from the expert U2 are given, for example, by voice. The content of the instructions is, for example, an instruction on the position where the vibration sensor 4 should be grounded. The expert U2 looks at the map to determine the direction and movement distance of the next position where vibration should be detected, and gives an instruction such as, for example, "Measure the position 30 cm eastward." Furthermore, the expert U2 can determine the direction the worker U1 is facing by looking at the image L11, so he can also give an instruction such as, for example, "Measure the position 30 cm diagonally forward to the right."

[0041] When the expert terminal 20 receives an instruction, it generates instruction data indicating the received instruction (activity A36). The expert terminal 20 generates, for example, voice data indicating the voice of the instruction as the instruction data. The expert terminal 20 transmits the generated instruction data to the worker terminal 10. The worker terminal 10 outputs the instruction indicated by the transmitted instruction data (activity A23). The worker terminal 10 outputs, for example, the voice of the instruction indicated by the instruction data.

[0042] The worker U1 performs the work in accordance with the output instructions. For example, the worker U1 determines the position where vibration should be detected next from the output voice instruction (activity A2). Then, the worker U1 returns to A1 and places the vibration sensor 4 on the determined position. Thereafter, the operations of A1, A11, A12, A13, A21, A22, A33, A34, A35, A36, A23, and A2 are repeated. When the detection position moves, the expert terminal 20 displays a position image as follows:

[0043] FIG. 5 is a diagram showing an example of a position image. In the map display field E12 shown in FIG. 5, a position image F11, position images F21 and F22, etc. are displayed. The position image F11 indicates the position where underground G1 vibrations are currently detected. The position images F21 and F22, etc. indicate positions where underground G1 vibrations have been detected in the past. In this way, by displaying position images showing past detection positions, it is easier to perform the task of detecting underground G1 vibrations more comprehensively than when only a position image showing the current detection position is displayed.

[0044] The expert U2 identifies the location of the damage in the pipe P1 through the above work. The expert U2 inputs the identified location of the damage into the expert terminal 20. The expert terminal 20 accepts the input of the identified location of the damage (activity A37) and notifies a predetermined destination of the input location of the damage (activity A38). The predetermined destination is, for example, a construction company that repairs the damage in the pipe P1 in the investigation area R1. When the construction company that received the notification checks for the presence or absence of a damage at the notified location of the damage in the investigation area R1 and repairs it, the damage disappears and the leakage of the fluid W1 stops.

[0045] As described above, the worker terminal 10 functions as an example of a vibration acquisition unit that acquires vibration data indicating vibrations traveling underground. These vibrations are detected by the vibration survey machine 3 operated by the worker U1 in an area where damage to buried pipes is being investigated. The worker terminal 10 also functions as an example of a vibration transmission unit that transmits the acquired vibration data to the expert terminal 20. The expert terminal 20 is a terminal used by the expert U2 who determines the location of the damage from the vibrations traveling underground. In the example of FIG. 1 etc., the worker terminal 10 acquires vibration data indicating vibrations detected by the vibration survey machine 3 in the investigation area R1 and transmits field data indicating the detected vibrations to the expert terminal 20.

[0046] The expert terminal 20 has a function of outputting the detected vibration. In the example of FIG. 4, the expert terminal 20 outputs the detected sound and a waveform image N13. The worker terminal 10 also functions as an example of an instruction acquisition unit that acquires instruction data indicating instructions from the expert U2 based on the detected vibration output by the expert terminal 20. The worker terminal 10 also functions as an example of an instruction output unit that causes the worker terminal 10 (the worker terminal 10 used by the worker U1) to output instructions indicated by the acquired instruction data. In the example of FIG. 3 etc., the worker terminal 10 acquires data indicating instruction voice from the expert U2 as instruction data and outputs the instruction voice indicated by the instruction data. This aspect makes it possible for the expert U2 to remotely assist the worker U1 in investigating a pipe breakage.

[0047] The expert terminal 20 also functions as an example of a map acquisition unit that acquires map data showing a map of the survey area. The expert terminal 20 acquires the map data, for example, from a storage means of the expert terminal. The expert terminal 20 also functions as an example of a map display unit that displays the map shown by the acquired map data on the expert terminal 20. According to this aspect, the expert U2 can grasp the surrounding environment of the site shown on the displayed map (environment such as the layout of roads and buildings) and give instructions.

[0048] The worker terminal 10 also functions as an example of a position acquisition unit that acquires position information indicating the detected position of vibrations traveling underground. The worker terminal 10 also functions as an example of a position display unit that displays the detected position indicated by the acquired position information on a map on the expert terminal 20. In the example of FIG. 1 etc., the worker terminal 10 acquires position data indicating the detected position detected by the position sensor 5 and transmits site data indicating the detected position to the expert terminal 20, thereby displaying a position image F11 indicating the detected position on the expert terminal 20 as shown in FIG. 4 etc. According to this aspect, the expert U2 can more accurately grasp the detected position of vibrations compared to when the detected position is not displayed.

[0049] Furthermore, the expert terminal 20 displays the history of vibration detection positions superimposed on a map, as shown in Fig. 5. According to this embodiment, the expert U2 can more accurately determine the position where the next vibration should be detected, compared to when the history of detection positions is not displayed.

[0050] The worker terminal 10 also functions as an example of a video acquisition unit that acquires video being captured in the investigation area. The worker terminal 10 also functions as an example of a video display unit that displays the acquired video on the expert terminal. The worker terminal 10 acquires video data showing the video being captured by the worker terminal and transmits the acquired video data to the expert terminal 20, thereby displaying the video L11 captured of the investigation area R1 on the expert terminal 20 in real time, as shown in FIG. 4 etc. According to this embodiment, the expert U2 can give instructions while understanding the situation on site.

[0051] <Variation: Vibration Regeneration> The expert terminal 20 may record the detected vibration (detected sound and waveform image) that it has output. Specifically, the expert terminal 20 generates and stores record data that indicates the detected vibration in association with the detection position where the detected vibration was detected. Then, when one of the position images F21 and F22 shown in FIG. 5 is selected, for example, the expert terminal 20 reproduces the stored detected vibration by outputting the detected vibration associated with the detection position indicated by the selected position image.

[0052] In this way, when a history of detection positions displayed superimposed on the map is selected, the expert terminal 20 outputs (plays) the vibrations (detected sound and waveform image) detected at the selected detection position. According to this embodiment, the expert U2 can determine whether there is damage and the location of the damage by comparing the vibrations detected at each detection position.

[0053] <Variation: Range image> Information to be displayed on the map may be added. For example, the worker terminal 10 may function as an example of a range display unit that displays, on the expert terminal 20, a range image indicating the range of vibration caused by underground fluid, based on the detected vibration indicated by the acquired vibration data.

[0054] Fig. 6 is a diagram showing an example of a displayed range image. In the map display field E12 shown in Fig. 6, position images F21 showing past detection positions and the like are displayed in greater numbers than in the example of Fig. 5. Since the position of the pipe in the survey area R1 may be known in advance from construction drawings or the like, the example of Fig. 6 shows the results of detection performed while moving little by little along the pipe. The worker terminal 10 stores sample data showing, for example, vibrations generated by underground fluid and transmitted to the ground surface.

[0055] Sample data can be generated, for example, by detecting vibrations that are generated by fluid flowing through pipes and transmitted to the ground surface (for example, the sound of water flowing through pipes), or by detecting vibrations that are generated when fluid leaks from an intentionally created breach and transmitted to the ground surface (for example, the sound of water spurting out from the breach or the sound of the spurting water hitting the ground). It is desirable to generate such sample data in an environment with little noise.

[0056] Next, if the detected vibrations include vibrations similar to those indicated by the sample data, the worker terminal 10 stores the detected positions. If multiple detected positions have been stored, the worker terminal 10 generates a range image that indicates the range including those positions as the range in which vibrations caused by underground fluids extend. The worker terminal 10 then transmits range data indicating the positional relationship between the generated range image and the original detected positions to the expert terminal 20.

[0057] The expert terminal 20 displays a range image indicated by the transmitted range data. At locations where no fluid leakage occurs, the range image shows the shape of the pipe, as in range image J31 shown in FIG. 6. However, at locations where fluid leakage occurs, the vibrations caused by the leaking fluid spread outside the pipe, and a different shape from the shape of the pipe is displayed, as in range image J32 shown in FIG. 6. This embodiment makes it possible to determine the location of the damage by comparing the area with normal areas of the pipe.

[0058] Artificial intelligence (AI) may be used to generate the range image. In this case, machine learning is performed on the AI ​​using the detected vibrations and their locations in the survey area as example data and the ranges of leaking pipes and fluids shown in accordance with their real-world locations as correct answer data, thereby realizing the function of generating a range image based on the detected vibrations and their locations.

[0059] Furthermore, when the detected vibrations include vibrations similar to those indicated by the sample data, the worker terminal 10 stores the amplitude of the similar vibrations (indicating, for example, the volume of the detected sound) in addition to the detected position. The worker terminal 10 then generates an image as a range image with shading according to the amplitude (for example, the greater the amplitude, the darker the color). As a result, the range image indicates, for example, that the darker the color, the greater the vibration that is occurring. Fluid leaking from a damaged location is more likely to cause greater vibrations than fluid inside a pipe, so by representing the range image with shading, it is possible to make it easier to determine the location of the damaged location compared to when the shading is uniform.

[0060] <Variation: Instruction Method> The method of giving instructions by the expert U2 is not limited to voice. For example, the expert U2 may input a character string indicating the content of the instruction into the expert terminal 20, and the expert terminal 20 may transmit instruction data indicating the input character string to the worker terminal 10. The worker terminal 10 may give instructions by displaying the character string indicated by the transmitted instruction data. Alternatively, the worker terminal 10 may give instructions by displaying a map, a position image, or an area image similar to that of the expert terminal 20.

[0061] FIG. 7 is a diagram showing an example of a screen displayed on the worker terminal 10. The on-site work screen D2 shown in FIG. 7 displays a video display field E21 and a map display field E22. The worker terminal 10 displays the video captured by its own terminal, i.e., the video L11 displayed on the expert terminal 20, in the video display field E21. This allows the worker U1 to understand what video the expert U2 is viewing while giving instructions. The worker terminal 10 also displays a map M12 including the investigation area R1 in the map display field E22. The map M12 is a map indicated by the instruction data and is the same map as the map displayed on the expert terminal 20.

[0062] The expert U2 indicates the position where vibration should be detected next on the map M12 of the expert terminal 20 by clicking, tapping, or other operations. The expert terminal 20 then transmits instruction data indicating the indicated position (hereinafter referred to as the "instructed position") to the worker terminal 10. The worker terminal 10 displays, superimposed on the map M12, a position image F11 indicating the current detection position and an instruction image H41 at the indicated position indicated by the transmitted instruction data. The worker U1 can grasp the position indicated by the displayed instruction image H41 based on the positional relationship between the current detection position and road boundaries and buildings displayed on the map M12, and move the vibration sensor 4.

[0063] Furthermore, an Augmented Reality (AR) technique may be used for instructions from the expert U2. For example, the worker terminal 10 may function as an example of a position display unit that displays on the worker terminal 10 a position image indicating the position indicated by the acquired position information overlaid on the acquired video of the investigation area.

[0064] Fig. 8 is a diagram showing another example of a screen displayed on the worker terminal 10. In the map display field E22 shown in Fig. 8, a position image F11 is displayed superimposed on a map M12, and the position image F21 etc. shown in Fig. 5 and the instruction image H41 shown in Fig. 7 are also displayed. Furthermore, in the video display field E21, in addition to the video L11 captured by the worker terminal 10, a position image F21a is displayed superimposed on the video L11. According to this aspect, the position image is displayed on the same video as the scenery that the worker U1 is viewing, and therefore the worker U1 can more intuitively grasp the detected position compared to when only a map is displayed.

[0065] Furthermore, the worker terminal 10 (an example of an instruction acquisition unit) acquires, as instruction data, data indicating the content of instructions given by the expert U2 in the image displayed on the expert terminal 20 from the expert terminal 20. Then, the worker terminal 10 (an example of an instruction output unit) may display on its own terminal (worker terminal 10) an image indicating the content of instructions in the image indicated by the acquired instruction data superimposed on the acquired image of the investigation area. In the example of FIG. 8, an instruction image H41a is displayed superimposed on the image L11. The position where the instruction image H41a is displayed represents the position in the real space displayed as the image L11 that the expert U2 has designated as the next detection position.

[0066] The worker terminal 10 calculates the position indicated by the instruction position in the image L11 based on, for example, the instruction position indicated by the transmitted instruction data, the position of the terminal itself, the direction of the optical axis of the imaging means (the direction of the terminal itself), the angle of view of the imaging means, and the height of the terminal itself (a preset height or a height measured by a positioning sensor). By displaying the instruction image H41a at the calculated position, the worker terminal 10 can convey the instruction content to the worker U1 by representing the real space as a virtual space, like so-called augmented reality.

[0067] Note that the instruction image is not limited to an image indicating the detected position. For example, an image of text indicating the content of the instruction (such as text such as "move 30 cm to the right") may be displayed as the instruction image. Furthermore, if the expert U2 wants the worker U1 to look at surrounding buildings, vehicles, etc., an arrow pointing to those buildings or vehicles may be displayed as the instruction image. In short, any image indicating an instruction from the expert U2 may be superimposed on the video L11 as the instruction image.

[0068] <Example of change: Previously taken images> In the above example, the video being captured was displayed to inform the expert U2 of the situation at the site, but for example, images captured in the past may also be displayed. In this case, for example, the expert terminal 20 functions as an example of an image acquisition unit that acquires past images captured in the survey area R1 in the past. The shooting locations of the past images are associated with positions on the map.

[0069] The association of the past images with the map is performed in advance by, for example, the provider of the support app described above, and the associated data is stored in the expert terminal 20 as data of the support app. Then, when a position associated with the shooting position is specified on the displayed map, the expert terminal 20 functions as an example of an image display unit that displays the past images associated with the shooting position on its own terminal (the expert terminal 20). For example, the expert terminal 20 displays shooting position images indicating the shooting positions on the map, and when one of the shooting position images is selected by the expert U2, the position where the shooting position image is displayed is regarded as having been specified, and displays the past images associated with that position.

[0070] When the above-mentioned video being captured is displayed, the situation at the site being investigated is displayed in real time, but visibility may be poor, for example, in rainy weather, etc. In contrast, if past images are captured when the weather conditions are good, it is possible to understand the situation at the site under good visibility conditions without being affected by the weather on the day.

[0071] <Example of change: Processing by server, etc.> In FIG. 1 and other figures, the piping inspection support process is executed by the worker terminal 10 and the expert terminal 20, but a server device may be added to these terminals.

[0072] FIG. 9 is a diagram showing the overall configuration of the piping inspection support system 1a. The piping inspection support system 1a includes a server device 30 in addition to the terminals shown in FIG. 1. The server device 30 includes hardware configurations corresponding to the control unit 11, storage unit 12, and communication unit 13 shown in FIG. 2. The server device 30 will be described with the control unit 31 being assigned a different reference numeral from the control unit 11 of the worker terminal 10. For example, the piping inspection support process shown in FIG. 3 and the like is executed by at least one processor included in the piping inspection support system 1a, i.e., the processors included in the control units (control units 11, 21, and 31) of the worker terminal 10, the expert terminal 20, and the server device 30.

[0073] The server device 30 may instead execute information processing that was performed by the worker terminal 10 and the expert terminal 20 in the example of Fig. 3 etc. The server device 30, for example, acquires vibration data generated by the vibration surveyor 3 and transmits it to the expert terminal 20 to output detected vibrations. In this case, the server device 30 may store the vibration data in association with the detection position, thereby outputting detected vibrations at past detection positions to the expert terminal 20, as described in the example of Fig. 5.

[0074] The server device 30 also stores map data and causes the worker terminal 10 and the expert terminal 20 to display a map including the survey area R1. The server device 30 also causes a position image to be superimposed on the map as shown in FIG. 4 and other figures. The server device 30 also acquires video captured by the worker terminal 10 and transmits it to the worker terminal 10 and the expert terminal 20 for display. The server device 30 may also cause the expert terminal 20 to display the range image shown in FIG. 6 and the AR display shown in FIG. 8.

[0075] Furthermore, in the above example, the support app was installed on the worker terminal 10 and the expert terminal 20, but the worker terminal 10 and the expert terminal 20 may log in to the server device 30 using the browser function, and the server device 30 may control the screen display by the browsers on both terminals and the exchange of data between the terminals.

[0076] <Example of variation: Variation of composition> The configuration (overall configuration, hardware configuration, functional configuration, etc.) shown in Fig. 1 etc. is an example, and other configurations may be used as long as there is no inconvenience in implementation. For example, the worker terminal 10, the expert terminal 20, and the server device 30 may each be distributed across two or more devices. Furthermore, the server device 30 may be provided in the form of SaaS (Software as a Service) or a cloud computing system, etc.

[0077] Furthermore, the information processing performed by each information processing device may be performed by or controlled by another information processing device. For example, the worker terminal 10 and the expert terminal 20 log in to the server device 30 and display a system screen provided by the server device 30. The worker terminal 10 functions as a UI (User Interface) for the worker U1, and the expert terminal 20 functions as a UI for the expert U2, but the displayed screen, information, and data exchange are all controlled by the server device 30. Furthermore, instead of the server device 30, either the worker terminal 10 or the expert terminal 20 may control the information processing of the entire piping inspection support system 1.

[0078] Furthermore, some of the processing that was previously performed by the worker terminal 10 (for example, sending vibration data and position data to the expert terminal 20 or server device 30) may be performed by the vibration surveyor 3 or the position sensor 5. Also, a device that integrates the vibration surveyor 3, the position sensor 5, and the worker terminal 10 may be used. Furthermore, video may be captured not by the worker terminal 10 but by a separate digital camera or a wearable camera, etc. In short, as long as the necessary information processing is performed by the entire piping inspection support system 1, the devices that perform this information processing may have any configuration.

[0079] The output destination of information or data (hereinafter referred to as "information, etc.") may be another device, a display, a memory unit (including an internal memory unit and an external memory unit), an email address, an account of another system, etc. Acquisition of information, etc. includes not only acquisition of information, etc. transmitted from another device, but also acquisition of information, etc. generated by one's own device.

[0080] The above-described embodiments are information processing devices such as the worker terminal 10, the expert terminal 20, and the server device 30, and information processing systems such as the piping inspection support system 1 that include these devices and terminals (including those configured in a single housing as well as those configured in multiple housings as long as they include one or more processors), but they may also be information processing methods. The information processing method includes the same steps as those executed by the information processing system. The above-described embodiments may also be programs. The program causes a computer to execute the same steps as those executed by the information processing system.

[0081] <Additional Notes> Furthermore, it may be provided in the following aspects.

[0082] (1) An information processing system having one or more processors, wherein the processor acquires vibration data indicating vibrations traveling through the ground detected by a vibration surveying device operated by a worker in an area to be investigated for damage to buried pipes in a vibration acquisition step, transmits the acquired vibration data to an expert terminal in a vibration transmission step, the expert terminal being a terminal used by an expert who determines whether the pipes are damaged from the vibrations and having a function to output the vibrations, acquires instruction data indicating instructions from the expert based on the vibrations output by the expert terminal in an instruction acquisition step, and causes the instruction indicated by the acquired instruction data to be output from a worker terminal used by the worker in an instruction output step.

[0083] According to this aspect, it is possible to provide remote support for the investigation of pipe damage.

[0084] (2) In the information processing system described in (1) above, the processor acquires map data indicating a map of the survey area in the map acquisition step, and displays the map indicated by the acquired map data on the expert terminal in the map display step.

[0085] According to this embodiment, it is possible to grasp the surrounding environment of the site and give instructions.

[0086] (3) In the information processing system described in (2) above, in the position acquisition step, the processor acquires position information indicating the detected position of the vibration, and in the position display step, the position indicated by the acquired position information is superimposed on the map and displayed on the expert terminal.

[0087] According to this aspect, the detection position of the vibration can be grasped more accurately.

[0088] (4) In the information processing system described in (2) or (3) above, in the range display step, the processor displays on the expert terminal a range image indicating the range over which the vibrations caused by the fluid underground extend, based on the vibrations indicated by the acquired vibration data.

[0089] According to this aspect, it is possible to determine the damaged portion by comparing with a normal portion.

[0090] (5) In the information processing system described in any one of (2) to (4) above, in the image acquisition step, the processor acquires past images taken in the survey area in the past, and the past images have their shooting locations associated with positions on the map.In the image display step, when a position associated with the shooting location is specified on the displayed map, the processor displays the past image associated with the shooting location on the expert terminal.

[0091] According to this aspect, the situation at the site can be grasped without being affected by the weather on the day.

[0092] (6) In the information processing system described in any one of (1) to (5) above, the processor acquires video being shot in the investigation area in the video acquisition step, and displays the acquired video on the expert terminal in the video display step.

[0093] According to this embodiment, it is possible to give instructions while grasping the current situation at the site.

[0094] (7) In the information processing system described in (6) above, in the position acquisition step, the processor acquires position information indicating the detected position of the vibration, and in the position display step, a position image indicating the position indicated by the acquired position information is superimposed on the acquired image of the investigation area and displayed on the worker terminal.

[0095] According to this aspect, the detected position can be grasped more intuitively.

[0096] (8) In the information processing system described in (6) or (7) above, in the instruction acquisition step, the processor acquires data from the expert terminal as the instruction data indicating the content of the instructions given by the expert in the video displayed on the expert terminal, and in the instruction output step, overlays an image indicating the content in the video indicated by the acquired instruction data onto the acquired video of the investigation area and displays it on the worker terminal.

[0097] According to this embodiment, the real space can be displayed as a virtual space and instructions can be conveyed to the worker.

[0098] (9) An information processing method, in which a processor included in an information processing system executes each step of the information processing system described in any one of (1) to (8) above.

[0099] According to this aspect, it is possible to provide remote support for the investigation of pipe damage.

[0100] (10) A program that causes a computer to execute each step of the information processing system according to any one of (1) to (8) above.

[0101] According to this aspect, it is possible to provide remote support for the investigation of pipe damage. Of course, this is not the case. Furthermore, the above-described embodiments and modifications may be combined in any desired manner.

[0102] Finally, while various embodiments of the present invention have been described, these are presented by way of example only and are not intended to limit the scope of the invention. The novel embodiments may be embodied in various other forms, and various omissions, substitutions, and modifications may be made without departing from the spirit of the invention. The embodiments and their modifications are intended to be included within the scope and spirit of the invention, as well as within the scope of the inventions and their equivalents as defined in the appended claims. [Explanation of symbols]

[0103] 1: Piping inspection support system 2: Communication line 3: Vibration survey machine 4: Vibration sensor 5: Position sensor 10: Worker terminal 11: Control section 20: Expert terminal 21: Control unit 30: Server device 31: Control unit

Claims

1. An information processing system comprising one or more processors, the processor, In the vibration acquisition step, vibration data indicating vibrations transmitted through the ground detected by a vibration surveying device operated by a worker in an area to be investigated for damage to the buried pipe is acquired; In the vibration transmission step, the acquired vibration data is transmitted to an expert terminal, and the expert terminal is a terminal used by an expert who determines whether the pipe is damaged based on the vibration, and has a function of outputting the vibration; In the instruction acquisition step, instruction data indicating an instruction from the expert based on the vibration output by the expert terminal is acquired; In the instruction output step, an instruction indicated by the acquired instruction data is output from a worker terminal used by the worker. Information processing system.

2. 2. The information processing system according to claim 1, the processor: In the map acquisition step, map data showing a map of the survey area is acquired; In the map display step, a map indicated by the acquired map data is displayed on the expert terminal. Information processing system.

3. 3. The information processing system according to claim 2, the processor: In the position acquisition step, position information indicating a detection position of the vibration is acquired; In the position display step, the position indicated by the acquired position information is displayed on the expert terminal in a manner superimposed on the map. Information processing system.

4. 3. The information processing system according to claim 2, the processor: In the range display step, a range image indicating a range in which vibrations caused by fluid underground spread based on the vibrations indicated by the acquired vibration data is displayed on the expert terminal. Information processing system.

5. 3. The information processing system according to claim 2, the processor: In the image acquisition step, a past image captured in the past in the survey area is acquired, and a capture position of the past image is associated with a position on the map; In the image display step, when a position associated with the photographing position is specified on the displayed map, the past image associated with the photographing position is displayed on the expert terminal. Information processing system.

6. 2. The information processing system according to claim 1, the processor: In the image acquisition step, an image being captured in the investigation area is acquired; In the video display step, the acquired video is displayed on the expert terminal. Information processing system.

7. 7. The information processing system according to claim 6, the processor: In the position acquisition step, position information indicating a detection position of the vibration is acquired; In the position display step, a position image showing the position indicated by the acquired position information is superimposed on the acquired image of the investigation area and displayed on the worker terminal. Information processing system.

8. 7. The information processing system according to claim 6, the processor: In the instruction acquisition step, data indicating content of an instruction given by the expert in the video displayed on the expert terminal is acquired from the expert terminal as the instruction data; In the instruction output step, an image showing the content of the image indicated by the acquired instruction data is superimposed on the acquired image of the investigation area and displayed on the worker terminal. Information processing system.

9. An information processing method, comprising: The processor of the information processing system Executing each step of the information processing system according to any one of claims 1 to 8. Information processing methods.

10. A program, A computer is caused to execute each step of the information processing system according to any one of claims 1 to 8. program.

Images