Inspection system and program

Abstract

We provide an inspection system that allows for easy recording of inspection results and reliable storage of those records. [Solution] The inspection system 1 includes a storage unit 13 that stores inspection map data 13a including the map 100 to be inspected, a screen generation unit 12a that generates a screen that displays on the display unit 25 of the information processing terminal, which includes the map 100 and a 3D image of the inspection target linked to the map 100, an inspection processing unit 12c that stores the inspection results input from the information processing terminal 2 in the storage unit 13, linked to the map 100, and an inspection result output unit 12d that outputs the inspection results to the information processing terminal 2.

Description

Technical Field

[0005]

[0001] The present invention relates to an inspection system and a program.

Background Art

[0002] As the environment surrounding the construction industry, the shortage of human resources, the change in lifestyle, the magnification of disasters, and the countermeasures against the aging of infrastructure have become apparent, and the response to these issues has become a challenge for the next generation. In particular, the inspection of infrastructure structures (hereinafter referred to as "infrastructure structures") is important as basic information for the maintenance design plan, so it is necessary to continue efficient implementation.

[0003] As inspection methods in recent years, there is a quantitative evaluation by measurement using new technologies (drones and sensing), but there are still many items that require visual confirmation by human senses such as visual inspection and percussion sound, as well as on-site inspection. In addition, since the deterioration and deformation of infrastructure structures often progress over time, detailed inspection records by fixed-point observation are required to evaluate the state of the structures. Under such conditions, it is necessary to improve the efficiency of inspection work in consideration of the current shortage of manpower.

[0004] As a technology for predicting the damage degree of the beam structure of a pier or a bridge, Patent Document 1 discloses a technology in which "a learned model includes an image AI that outputs first damage state data corresponding to the damage state of a beam whose damage degree is to be predicted obtained according to an input by a first input means, and a data AI that inputs the first damage state data and outputs second damage state data obtained according to the first damage state data and an input by a second input means to an output means".

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] Incidentally, traditional inspections were conducted using paper documents, which had various drawbacks. For example, inspection items and methods were standardized. However, inspection items could vary depending on the installation environment of the infrastructure structure. Furthermore, inspection items could be changed or increased or decreased depending on the degree of deterioration of the infrastructure structure. In addition, standard inspection record-keeping methods often involve recording the appearance with images such as photographs or sketches, and attaching these images to checklists. However, there were many different formats used for inspection records, making recording and organization cumbersome.

[0007] Furthermore, the standard method of record-keeping involved organizing notes and photographs, such as checklists, after the work was completed, which often resulted in errors such as transcription mistakes from notes and loss of photographic data. Therefore, there was a need for a way to easily record inspection results and reliably save those records. In the technology disclosed in Patent Document 1, although the damage status of the beam to be predicted can be determined, it was necessary to painstakingly search afterward to find where the damaged part corresponds to within the inspection target.

[0008] To utilize the inspection system, a communication environment for data transmission is necessary. Actual inspection work is often carried out not only in open-air locations such as river embankments, but also in underground spaces such as dam bodies, tunnels, and sewers. Furthermore, infrastructure structures can be multi-story buildings, making it difficult to accurately determine which floor was inspected.

[0009] This invention has been made in view of these circumstances, and its objective is to facilitate the inspection and recording of the object to be inspected. [Means for solving the problem]

[0010] The inspection system according to the present invention comprises a storage unit that stores inspection map data including a map of the object to be inspected; a screen generation unit that generates a screen including a map displayed on the display unit of an information processing terminal and a 3D image of the object to be inspected linked to the map; an inspection processing unit that stores inspection results input from the information processing terminal in the storage unit linked to the map; and an inspection result output unit that outputs the inspection results to the information processing terminal. The inspection system described above is one aspect of the present invention, and a program reflecting one aspect of the present invention is configured in the same manner as the inspection system described above. [Effects of the Invention]

[0011] According to the present invention, a screen including a 3D image of the object to be inspected is displayed on the display unit, making it easy to inspect and record the object to be inspected. Other issues, configurations, and effects not mentioned above will be clarified by the following description of the embodiments. [Brief explanation of the drawing]

[0012] [Figure 1] This is an overall configuration diagram showing the outline of an inspection system according to one embodiment of the present invention. [Figure 2] This is a block diagram showing an example of the hardware configuration of a management server and an information processing terminal according to one embodiment of the present invention. [Figure 3] This figure shows an example of a map display according to one embodiment of the present invention. [Figure 4] This flowchart shows an example of the process for creating a map related to one embodiment of a particular invention. [Figure 5] This figure shows an example of the display of the area setting screen according to one embodiment of the present invention. [Figure 6] This figure shows an example of the display of the design drawing layout screen according to one embodiment of the present invention. [Figure 7] This figure shows an example of the display of the inspection period selection screen according to one embodiment of the present invention. [Figure 8] This flowchart shows an example of the inspection process related to one embodiment of the present invention. [Figure 9]It is a diagram showing an example of a display of an inspection area selectable from map information according to an embodiment of the present invention. [Figure 10] It is a flowchart showing an example of an input process of inspection records according to an embodiment of the present invention. [Figure 11] It is a diagram showing an example of a display of an inspection record input screen according to an embodiment of the present invention. [Figure 12] It is a diagram showing an example of a transition of each screen on an inspection record input screen according to an embodiment of the present invention. [Figure 13] It is a diagram showing an example of a display of an inspection result display screen according to an embodiment of the present invention. [Figure 14] It is a diagram showing an example of a display of a detailed display section of inspection results according to an embodiment of the present invention. [Figure 15] It is a diagram showing an example of the configuration of inspection map data according to an embodiment of the present invention.

Embodiments for Carrying Out the Invention

[0013] Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same function or configuration are denoted by the same reference numerals, and redundant explanations are omitted.

[0014] [First Embodiment] <Overall Configuration Example of the Inspection System> First, a configuration example of an inspection system according to an embodiment of the present invention will be described. This inspection system is configured by combining a management server that manages inspection results of infrastructure, and an information processing terminal.

[0015] <Overview of the Inspection System> FIG. 1 is an overall configuration diagram showing an overview of an inspection system 10 according to an embodiment of the present invention. The inspection system 10 includes a management server 1 and an information processing terminal 2. First, a functional configuration example of the management server 1 will be described.

[0016] (Management Server) The management server 1 comprises a communication unit 11, a control unit 12, and a storage unit 13. The communication unit 11 can communicate with the communication unit 21 of the information processing terminal 2 via a secure wireless or wired connection.

[0017] The control unit 12 comprises a screen generation unit 12a, a map creation unit 12b, an inspection processing unit 12c, and an inspection result output unit 12d, and controls the functions of each part within the management server 1. For example, the control unit 12 identifies the user ID entered from the input unit 24 of the information processing terminal 2, confirms whether the access was made by an inspection manager or an inspector, and performs control processing according to the inspection manager or inspector who accessed it.

[0018] The screen generation unit 12a generates a screen for use by inspection managers and inspectors. This screen includes a map 100 (see Figure 3) displayed on the display unit 25 of the information processing terminal 2, and a 3D image associated with the map 100. Specifically, the screen generation unit 12a generates a screen for the map 100 displayed on the information processing terminal 2 that includes management points indicating areas requiring detailed inspection, and inspection pins (an example of an inspection icon) indicating areas scheduled for inspection by inspectors or areas that have been inspected by inspectors. In addition to inspection pins, inspection icons may be displayed in various shapes, such as speech bubbles.

[0019] When an inspection manager accesses the system, the screen generation unit 12a generates the screens necessary for the inspection manager to create the map 100. These screens include the area setting screen 120 (described later in Figure 5), the design drawing placement screen 130 (described later in Figure 6), and the inspection period selection screen 140 (described later in Figure 7). Furthermore, when an inspector accesses the system, the screen generation unit 12a generates an inspection input screen for the inspector. This inspection input screen includes the map information display screen 150 (described later in Figure 9) and the inspection record input screen 200 (described later in Figures 11 and 12). The screen generation unit 12a can also generate the inspection result display screen 300 (described later in Figure 13) when accessed by an inspection manager or inspector.

[0020] The map creation unit 12b places management points and inspection pins in the designated area of ​​the map 100. The map creation unit 12b also places 2D or 3D images in the area. Then, when the communication unit 11 receives input information from the information processing terminal 2, the map creation unit 12b creates the map 100 based on the operation of the inspection manager. The map 100 created by the map creation unit 12b is an area that includes one or more areas where inspections are conducted at the construction site, construction area, etc.

[0021] When creating the map 100, the map creation unit 12b refers to the map data 13b, design data 13c, and 3D (3-dimension) data 13d stored in the storage unit 13, and creates the map 100 by incorporating each of the data. The map 100 created by the map creation unit 12b is updated as inspection map data 13a and stored in the storage unit 13.

[0022] The inspection processing unit 12c processes the inspection work performed by the inspector based on the input information received by the communication unit 11 from the information processing terminal 2 used by the inspector. In this process, the inspection processing unit 12c reads inspection map data 13a from the storage unit 13 in which the current date and time are included in the inspection period. The inspection processing unit 12c then saves the inspection map data 13a, which reflects the area to be inspected on the map 100, to the storage unit 13.

[0023] For example, the inspection processing unit 12c stores the inspection pins added by the inspector to the map 100, along with the comments and photos added to the inspection pins, in the inspection map data 13a, linking them to the inspection pins. Furthermore, when the inspection processing unit 12c detects that the current location of the information processing terminal 2 is approaching the management point, it can display information indicating that the management point is nearby on the display unit 25 and sound an alert on the information processing terminal 2. Furthermore, the inspection processing unit 12c stores the information of the inspection pins that have been inspected, which has been transmitted from the information processing terminal 2, in the storage unit 13 as the inspection result.

[0024] The inspection result output unit 12d outputs the inspection results processed by the inspection processing unit 12c to the information processing terminal 2. At this time, the inspection result output unit 12d outputs information as an inspection result, including information on the management points and information indicating whether the locations indicated by the inspection pins have been inspected or are scheduled for inspection. For example, based on the input information received from the information processing terminal 2 used by the inspection manager, the inspection result output unit 12d sends an inspection result display screen 300 (see Figure 13) showing the inspection results to the information processing terminal 2 via the communication unit 11. The information processing terminal 2 used by the inspection manager displays the inspection result display screen 300 sent from the communication unit 11 on the display unit 25. Note that the inspection result display screen 300 may also be displayed on the display unit 25 of the information processing terminal 2 used by the inspector, in addition to the information processing terminal 2 used by the inspection manager.

[0025] The storage unit 13 records various types of data used by the control unit 12. The storage unit 13 stores inspection map data 13a, including the map 100 to be inspected, map data 13b, design data 13c, and 3D data 13d.

[0026] The inspection map data 13a includes information such as the area of ​​map 100 used in inspection work, management points, patrol routes, design drawings 60 (see Figure 6) placed within the area, inspection period, and inspection results. An area represents the inspection range set within map 100.

[0027] The screen generation unit 12a can generate the above-described screens by reading the inspection map data 13a. The inspection processing unit 12c can also read the map 100 containing the area to be inspected from the inspection map data 13a.

[0028] Map data 13b is general map data. Map data 13b shows the shapes of roads, rivers, buildings, and plots of land as 2D data. Note that map data 13b may also be imported from external map information services (not shown).

[0029] Design data 13c is data related to the building's design drawings, etc., that is not publicly available. This design data 13c includes information for each floor of the building, as well as information on the building's slope and height. In addition, design data 13c also includes 2D data such as aerial photographs of the building.

[0030] 3D data 13d is point cloud data obtained by measuring the inspection target using light rays, or 3D model data that models the inspection target. Point cloud data is obtained by measuring existing buildings with LiDAR (Light Detection and Ranging), etc., while 3D model data is created during the building design phase.

[0031] (Information processing terminal) The information processing terminal 2 comprises a communication unit 21, a control unit 22, a storage unit 23, an input unit 24, and a display unit 25. The communication unit 21 is able to communicate with the communication unit 11 of the management server 1 via a secure wireless or wired connection. The control unit 22 includes a screen generation unit 22a, a processing switching unit 22b, an inspection processing unit 22c, a position information acquisition unit 22d, and an inspection result output unit 22e.

[0032] The control unit 22 controls the functions of each part within the information processing terminal 2. For example, if the information processing terminal 2 is online, it updates the area according to its current location. The information processing terminal 2 then controls the communication unit 21 to send the information input from the input unit 24 to the management server 1 in real time. If the information processing terminal 2 is in an offline environment, the information processing terminal 2 will temporarily store the information input from the input unit 24 in the storage unit 23, and when it moves to an online environment, it will control the communication unit 21 to read the information from the storage unit 23 and send it to the management server 1.

[0033] When the information processing terminal 2 is online, both the process of the inspection manager creating a map and the process of the inspector checking the map while conducting an inspection are performed by displaying the data processed by the control unit 12 of the management server 1 on the display unit 25 of the information processing terminal 2. However, the process of the inspection manager creating a map is always performed in an online environment.

[0034] When the information processing terminal 2 is in an online environment capable of communicating with the management server 1, it displays the screen generated by the screen generation unit 12a of the management server 1 on the display unit 25. Information input through the input unit 24 is transmitted online to the management server 1 in real time and used for processing by the inspection processing unit 12c.

[0035] On the other hand, if the information processing terminal 2 is in an offline environment, the inspector performs the inspection by operating the inspection application installed on the information processing terminal 2. For this reason, the processing switching unit 22b of the control unit 22 determines whether the terminal 2 is in an online environment where it can communicate with the management server 1, or in an offline environment where it cannot communicate with the management server 1, and switches the processing between the management server 1 and the information processing terminal 2. In other words, when the processing switching unit 22b determines that the information processing terminal 2 has changed from an online environment to an offline environment, it switches to processing using the screen generation unit 22a, the inspection processing unit 22c, and the inspection result output unit 22e.

[0036] Since the screen generation unit 22a of the information processing terminal 2 performs the same processing as the screen generation unit 12a of the management server 1, the explanation of the processing of the screen generation unit 22a will be omitted here. The processing switching unit 22b displays the screen generated by the screen generation unit 22a of the information processing terminal 2 on the display unit 25 when the information processing terminal 2 is in an offline environment. Furthermore, the processing switching unit 22b, based on the location information of the information processing terminal 2, causes the inspection processing unit 22c to detect that the information processing terminal 2 is approaching the management point, and stores the inspection pin information entered by the inspector as an inspection result in the storage unit 23.

[0037] Furthermore, when the processing switching unit 22b determines that the information processing terminal 2 has switched from an offline environment to an online environment, it controls the communication unit 21 to send the inspection results, including the inspection map data 23a read from the storage unit 23, to the management server 1. As a result, the inspection map data 13a stored in the storage unit 13 of the management server 1 is updated by the inspection map data 23a from the information terminal device 2. Subsequently, the processing switching unit 22b switches to processing using the screen generation unit 12a, inspection processing unit 12c, and inspection result output unit 12d of the management server 1.

[0038] The inspection processing unit 22c performs the same processing as the inspection processing unit 12c of the management server 1. If the information processing terminal 2 is online, the inspection processing unit 22c controls the communication unit 21 to send the inspection results to the management server 1 online. If the information processing terminal 2 is offline, the inspection processing unit 22c saves the inspection results to the inspection map data 23a in the storage unit 23.

[0039] The location information acquisition unit 22d acquires location information indicating the current location of the information processing terminal 2 based on the location signal received from a GPS signal or a beacon signal (both are examples of location signals). If the environment is online, the location information acquired by the location information acquisition unit 22d is transmitted in real time to the management server 1 by the communication unit 21. The location information is then taken in by the inspection processing unit 12c of the management server 1 and used to determine the current location of the information processing terminal 2. In an offline environment, the location information acquired by the location information acquisition unit 22d is taken into the inspection processing unit 22c of the information processing terminal 2 and used to determine the current location of the information processing terminal 2. The inspection result output unit 22e performs the same processing as the inspection result output unit 12d of the management server 1.

[0040] The storage unit 23 stores various types of information processed by the information processing terminal 2. The storage unit 23 also stores inspection map data 23a that has been pre-downloaded from the management server 1. The inspection map data 23a concerns maps of areas inspected by inspectors. From the perspective of preventing information leakage, map data for areas not inspected by inspectors is not downloaded. Also, from the perspective of preventing information leakage, the storage unit 23 may be configured to automatically delete the inspection map data 23a after a certain period of time (for example, one week) has elapsed since the inspection.

[0041] The input unit 24 inputs the necessary information based on the screen displayed on the display unit 25. The input information entered from the input unit 24 is transmitted to the management server 1 via the communication unit 21. The display unit 25 displays various information, screens, etc., received by the communication unit 21 from the management server 1.

[0042] Next, we will describe an example of the hardware configuration of the management server 1 and the information processing terminal 2 that constitute the inspection system 10. Figure 2 is a block diagram showing an example of the hardware configuration of the management server 1 and the information processing terminal 2.

[0043] (Example hardware configuration for the management server) Management Server 1 manages programs and data used for inspecting and recording infrastructure structures. Management Server 1 is an example of a computer that operates as a computer capable of executing various programs. This Management Server 1 comprises a processing unit 31, a storage device 32, and a network interface 33, each connected to a bus 34.

[0044] The processing unit 31 is composed of at least one of the following: a CPU (Central Processing Unit), an MPU (Microprocessor Unit), a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The processing unit 31 reads the program code of the software that implements each function according to this embodiment from the storage device 32, loads it into a temporary storage unit (not shown) provided in the storage device 32, and executes the program code. The processing unit 31 performs, for example, calculations for the program and processing necessary to draw objects on the screen of the information processing terminal 2.

[0045] The storage device 32 is composed of, for example, ROM (Read Only Memory) and RAM (Random Access Memory). ROM can include optical discs, magneto-optical discs, DVD (Digital Versatile Disc)-ROMs, CD-ROMs, Blu-ray® discs, etc. RAM can include SRAM (Static Random Access Memory) and DRAM (Dynamic Random Access Memory), etc. Variables and parameters generated during the processing of the processing unit 31 are temporarily written to the storage device 32. These variables and parameters are read out by the processing unit 31 as needed.

[0046] Furthermore, the storage device 32 is composed of at least one of the following: an HDD (Hard Disk Drive), an SSD (Solid State Drive), and flash memory, and is used as an example of a computer-readable, non-transient storage medium that stores programs executed by the management server 1. In other words, the storage device 32 stores the OS (Operating System) and various parameters of the management server 1, as well as programs and data necessary for the processing unit 31 of the management server 1 to function.

[0047] For example, a NIC (Network Interface Card) can be used for the network interface 33. The network interface 33 can send and receive various types of data to and from the information processing terminal 2 via the network N through a dedicated line connected to the terminals of the NIC.

[0048] (Example of hardware configuration for an information processing terminal) Next, we will describe an example of the hardware configuration of information processing terminal 2. Information processing terminal 2 is an example of a computer that operates as a computer capable of executing various programs. Information processing terminal 2 can be a smartphone, tablet, or PC (Personal Computer), and can connect to management server 1 via a network N such as the Internet.

[0049] The information processing terminal 2 processes programs and data received from the management server 1 that are used for inspecting and recording infrastructure structures. The program according to this embodiment is used as an inspection application that controls the display format of text, images, etc., displayed on the screen based on instructions input via the touch panel display 44. The information processing terminal 2 displays the processing results from the management server 1, for example, using a web browser.

[0050] The information processing terminal 2 comprises a processing unit 41, a storage device 42, a network interface 43, a touch panel display 44, a microphone 45, a camera 46, a speaker 47, and a position signal receiver 48, all connected to each other by a bus 49.

[0051] The processing unit 41 is composed of at least one of the following: a CPU, an MPU, a GPU, and an FPGA. The processing unit 41 reads the program code of the software that implements each function according to this embodiment from the storage device 42, loads it into a temporary storage unit (not shown) provided in the storage device 42, and executes the program code. The processing unit 41 performs calculations for the inspection program, and performs the processing necessary to draw objects on the screen of the information processing terminal 2. The processing unit 41 also performs processing such as the OS processing of the information processing terminal 2 and the management of data input and output performed in each part of the information processing terminal 2.

[0052] The storage device 42 is composed of, for example, ROM and RAM. ROM can be an optical disc, magneto-optical disc, DVD-ROM, CD-ROM, Blu-ray® disc, etc. RAM can be SRAM, DRAM, etc. Variables and parameters generated during the processing of the processing unit 41 are temporarily written to the storage device 42, and these variables and parameters are read out by the processing unit 41 as needed.

[0053] Furthermore, the storage device 42 is composed of at least one of the following: an HDD, an SSD, and flash memory. The storage device 42 stores the OS of the information processing terminal 2, various parameters, and programs necessary for the information processing terminal 2 to function. As described above, the storage device 42 stores programs and data necessary for the operation of the processing device 41 and is used as an example of a computer-readable, non-transient storage medium that stores programs executed by the information processing terminal 2.

[0054] For example, a network interface (NIC) can be used for the network interface 43. The network interface 43 can send and receive various types of data to and from the management server 1, and communicate with other information processing terminals 2, via a dedicated line connected to the terminals of the NIC and through the network N.

[0055] When the information processing terminal 2 is a smartphone or tablet, a touch panel display 44 with an integrated input and output device is used. When the information processing terminal 2 is a PC, the input and output devices are separate. The input device is a device that receives input instructions from the inspector or various types of information. As an input device, for example, there is a pointing device that can input coordinate information of a location specified by the inspector.

[0056] The pointing device may be a mouse, touch panel, etc. The input device may be a device or various sensors. Examples of various sensors include acceleration sensors (six-axis sensors, gyroscopes, etc.) and optical sensors (cameras, etc.). The output device is a device that outputs the information processed by the processing unit 41. If the output device is a display device, the image based on the video signal received from the screen generation unit 22a is displayed on the display device.

[0057] Microphone 45 captures the voice of the inspector. The captured voice is converted into text by the inspection processing unit 22c. Camera 46 photographs the inspection points or the details of the inspection performed by the inspector, and generates images.

[0058] Speaker 47 controls the inspection processing unit 22c and sounds an alert indicating that an inspector is approaching a management point. Management points are operational points that require particular attention during inspection. The position signal receiver 48 receives GPS (Global Positioning System) signals or beacon signals transmitted from beacon devices installed on structures. The GPS signals or beacon signals are acquired as position information by the position information acquisition unit 22d.

[0059] The information processing terminal 2 selects a program based on the operation signals input from the touch panel display 44 by the inspector's operation, and outputs a video signal that matches the screen of the touch panel display 44. The touch panel display 44 displays an image based on the video signal. An example of an operation performed from the touch panel display 44 is a tap operation, such as touching the screen of the output device with a finger or pen.

[0060] Next, the map used in this embodiment will be described. Figure 3 shows an example of the display of the inspection input screen 50 shown on the display unit 25. The inspection input screen 50 displays the map 100, a comment input field 51, a photo addition field 52, and a send button 53.

[0061] Map 100 is a map that visualizes the construction site and is displayed on the display unit 25 of the information processing terminal 2. Map 100 includes inspection areas 101 where inspections are performed and non-inspection areas 102 where inspections are not performed. In Figure 3, inspection areas 101 are enclosed by solid lines, and non-inspection areas 102 are enclosed by dashed lines. This allows inspectors to distinguish between inspection areas 101 and non-inspection areas 102.

[0062] In addition, inspection pins P1-P7, indicated by human-shaped icons, and management points F1-F3, indicated by flag icons, are displayed along the patrol route 105, which is shown by a thick line in the inspection area 101. The patrol route 105 is information that recommends the order of inspections to the inspector. The patrol route 105 is an inspection route that has been pre-set by an experienced person. Inspection pins P1 and P2, indicated by black human-shaped icons, represent inspection locations that were inspected by the previous day. Inspection pins P3-P5, indicated by white human-shaped icons, represent inspection locations that were inspected on the current day. Inspection pins P6 and P7, indicated by diagonal human-shaped icons, represent inspection locations that have been set by the inspection manager but have not yet been inspected.

[0063] Furthermore, inspectors can add inspection pins to locations they deem necessary to inspect during the inspection process. Also, even if an inspection was completed on the previous day (for example, at the location of inspection pin P1), if the inspector inspects it again on the same day, inspection pin P1 and the inspection pins set for that day will be displayed overlaid on top of each other.

[0064] Management points F1 to F3 represent areas requiring particularly detailed inspection. Since management points F1 to F3 are linked to inspection data (inspection manuals, etc.), inspectors can view the inspection data and confirm inspection methods when approaching these points. The materials displayed near management points F1 to F3 also include observations from experienced inspectors from past inspection operations. Therefore, inspectors can perform the prescribed inspections at the inspection points located on map 100 while referring to map 100. Furthermore, when an inspector approaches management points F1 to F3, a message is displayed on the display unit 25 to inform the inspector that they are approaching management points F1 to F3, and an alert sounds from the speaker 47.

[0065] The inspector can provide verbal comments upon completion of the inspection. These comments are picked up by the microphone 45, and the inspection processing unit 22c of the information processing terminal 2 converts the audio information into text information for recording. The converted text information is then displayed as a comment in the comment input field 51. However, in noisy environments, the inspector can also input comments using the software keyboard displayed on the display unit 25.

[0066] Furthermore, photographs of inspection locations taken by the inspector using the camera 46 built into the information processing terminal 2 can be added using the photo addition field 52. After the inspector enters comments and photographs as inspection results, they can send the inspection results to the management server 1 by pressing the send button 53. These inspection results are recorded on the management server 1 for each inspection location. However, sending photographs is not mandatory, and it is also possible to send only comments as inspection results to the management server 1.

[0067] <Map creation process> Next, we will explain the process for creating map 100. Figure 4 is a flowchart illustrating an example of the process for creating map 100. Map 100 is created, for example, by the inspection manager before the start of inspection work. Subsequent processing is performed by the map creation unit 12b in conjunction with the operations performed by the inspection manager on the information processing terminal 2. Here, the processing performed by the map creation unit 12b will be explained with reference to map 100 shown in Figure 3 and the screens shown in Figures 5 to 7.

[0068] First, the inspection manager operates the dedicated map creation software and enters the map name from the map creation start screen 110 shown in Figure 5 (S1). The entered map name is sent to the communication unit 11 of the management server 1 via the communication unit 21 of the information processing terminal 2 and is taken up by the map creation unit 12b.

[0069] Next, the inspection manager sets the area information (S2). The area information is used to identify the area to be inspected, and corresponds to the inspection area 101 and non-inspection area 102 shown in Figure 3. Now, with reference to Figure 5, an example of the configuration of the area setting screen 120 will be explained.

[0070] Figure 5 shows an example of the display of the area setting screen 120. The area setting screen 120 includes a map display unit 121, an area list display unit 122, an area name display unit 123, and a delete button 124.

[0071] The map display unit 121 displays the map 100 in which the area is defined. The area list display unit 122 displays a list of area names. In the map display unit 121 of Figure 5, the area of ​​construction site C is displayed as inspection area 101. The area name display unit 123 displays the name of the area selected by the inspection manager. The delete button 124 is used to delete the area selected by the inspection manager.

[0072] When the Back button shown in the lower left of the area setting screen 120 is pressed, the system returns to the map creation start screen 110, allowing the inspection manager to restart the map creation process. When the Next button shown in the lower right of the area setting screen 120 is pressed, the system proceeds to the display process of the design drawing placement screen 130 shown in Figure 6.

[0073] The inspection manager selects a polygonal frame from the map 100 displayed on the area setting screen 120 by clicking with the mouse, etc., and sets it as the inspection area 101. The setting information for the inspection area 101 is sent to the communication unit 11 of the management server 1 via the communication unit 21 of the information processing terminal 2, and is saved in the inspection map data 13a by the map creation unit 12b.

[0074] Returning to the explanation of Figure 4. After step S2, the map creation unit 12b determines whether or not area information has been set (S3). If area information has not been set (NO in S3), it returns to step S2 and waits until the area information is set by the inspection manager.

[0075] If area information is set (YES in S3), the inspection manager sets management points F1 to F3 in inspection area 101 (S4). The setting of management points F1 to F3 is done through a management point setting screen (not shown). The management point setting screen is a screen in which the inspection manager can set management points F1 to F3 by clicking with a mouse or other means for inspection area 101 displayed in the map display section 121 of the area setting screen 120.

[0076] Next, the inspection manager sets a patrol route 105 in the inspection area 101 (S5). The patrol route 105 is set through a patrol route setting screen (not shown). The patrol route setting screen is a screen in which the inspection manager can set the patrol route 105 by dragging and dropping the inspection area 101, which is displayed on the map display section 121 of the area setting screen 120, with a mouse or the like. The patrol route 105 indicates the destinations for the inspection by the inspector, but the inspector may start the inspection from any of the management points included in the patrol route 105.

[0077] Next, the inspection manager displays the design drawing layout screen 130 shown in Figure 6 and places the design drawing 60 shown in Figure 6 to match the inspection area 101 (S6). Now, the design drawing layout screen 130 will be explained.

[0078] Figure 6 shows an example of the display of the design drawing layout screen 130. Conventionally, simply using a general map to display inspection locations often fails to reflect information about the construction area. Therefore, in this embodiment, the design drawing 60 shown in the upper part of Figure 6 is overlaid on the existing map to ensure efficiency during inspections and accuracy of records. The design drawing 60 is at the same scale as map 100 and can be displayed overlaid on the inspection area 101. The map displayed on map 100 is general map information, but by overlaying the design drawing 60, it becomes possible to show the current state of the construction site that is not reflected in the map information. The design drawing 60 may be an aerial photograph, a design drawing (plan view), or an inspection location diagram.

[0079] The design drawing placement screen 130 includes a map display unit 131, a placement adjustment unit 132, a drawing add button 133, and a delete button 134. The process of placing the design drawings 60 on map 100 is achieved by having the map creation unit 12b of the management server 1 place the information acquired by the inspection manager operating the information processing terminal 2 onto the design drawing placement screen 130.

[0080] As a result, the map display unit 131 displays the map 100, which has the inspection area 101 and non-inspection area 102 set. The design drawing 60 contains various information, such as columns, walls, equipment, floors, stairs, doors, air conditioning, pipes, etc., in the inspection area 101. Although the management points F1 to F3 set in the area setting screen 120 are hidden on the map display unit 131, the management points F1 to F3 may be displayed.

[0081] The placement adjustment unit 132 is used to adjust the position, angle, enlargement, or reduction of the design drawing 60 placed in the inspection area 101. The design drawing 60 can be moved up, down, left, and right by the inspection manager pressing the arrow buttons. In addition, the design drawing 60 can be enlarged or reduced, and rotated left or right by pressing the button on the design drawing 60 that displays the corresponding operation. The design drawing 60 shown in Figure 6 is placed in the inspection area 101 rotated slightly counterclockwise.

[0082] The "Add Drawing" button 133 is used when placing multiple design drawings 60 in the inspection area 101. Note that the design drawings 60 may also be placed in the non-inspection area 102. The delete button 134 is used to delete a design drawing 60 or area already placed in the inspection area 101. Alternatively, the inspection manager can select a management point or inspection pin and then press the delete button 134 to delete the selected management point or inspection pin.

[0083] When the Back button shown in the lower left of the design drawing layout screen 130 is pressed, the user returns to the area setting screen 120 shown in Figure 5, allowing the inspection manager to redo the area settings. When the Next button shown in the lower right of the design drawing layout screen 130 is pressed, the user proceeds to the display process of the inspection period selection screen 140 shown in Figure 7.

[0084] Let's return to the explanation of Figure 4. After step S6, the inspection manager places the 3D data 13d according to the inspection area 101 (S7). The 3D data 13d is point cloud data or a 3D model and can be displayed as a 3D image. The placement of the 3D data 13d is done through the design drawing placement screen 130.

[0085] The inspector presses the drawing addition button 133 shown in Figure 6 to create inspection map data 13a by inserting 3D data 13d, consisting of a 3D model or point cloud model, into the inspection area 101. Below Figure 6, a 7-story building displayed overlaid on the inspection area 101 is shown as an example of a 3D image. The inspector can also set management points on each floor of the building. For example, management point F11 can be set on the 3rd floor of the building. When the inspector performs an inspection, they can select a specific floor from the 3D-displayed building and inspect the structure of that floor while viewing it in 3D. In addition to buildings, it is also possible to insert 3D data 13d into locations that were previously difficult to map, such as tunnels and the interior of dams, and display them as 3D images.

[0086] The point cloud data and 3D model are sent to the communication unit 11 of the management server 1 via the communication unit 21 of the information processing terminal 2. Then, the map creation unit 12b of the management server 1 saves the inspection map data 13a linked to the map 100 on the 3D data 13d.

[0087] In recent years, the use of AR (Augmented Reality) technology for mapping 3D data has become increasingly common. AR systems project a separately created 3D model into the real world using special glasses. This allows inspectors to visualize the model in the real world and confirm the inspection target. However, because the model's position is set and projected based on the location information of the relevant area, inspection errors are likely to occur in repetitive daily tasks such as inspection work, or in long inspection sections. Furthermore, since inspectors need to set the location information each time they inspect, if the error differs from inspection to inspection, it is predicted that it will become impossible to track changes in inspection records over time.

[0088] On the other hand, in the inspection system 10 according to this embodiment, the point cloud data itself is used as a checklist, so the inspector can record the inspection results while walking and turning the pages of the checklist to ensure consistency with the current location. As a result, the inspector can record the inspection results at the same location each time. For example, by recording the inspection location in the 3D image displayed on the information processing terminal 2, the inspector can accurately identify the inspection location even if it is part of a multi-story structure.

[0089] Furthermore, since point cloud data contains actual shape dimensions and colors as electronic information, it can be used in a wide range of applications, such as reproducing the actual object using a 3D printer, creating external models, and extracting cross-sectional shapes. For this reason, point cloud data can be used in a wide range of fields, such as detailed repair plans for deteriorated parts recorded through inspection and design for maintenance management.

[0090] Furthermore, since point cloud data allows for the setting of location information (coordinate values: latitude, longitude, and height), it can be linked with map information. Deterioration information recorded as point cloud data with accurate shape and dimensions can be verified in conjunction with the surrounding environment of the infrastructure, such as topography. Therefore, inspectors can predict in advance the expansion of cascading effects, such as the widening of ground subsidence due to water leakage from cracks in concrete.

[0091] Let's return to Figure 4 for further explanation. After completing the placement of the 3D data in step S7, the inspection manager sets the inspection period (S8). The inspection manager displays the inspection period selection screen 140, which will be described later in Figure 7, and sets the inspection period by selecting the start and end dates from the calendar. The inspection period information is sent to the communication unit 11 of the management server 1 via the communication unit 21 of the information processing terminal 2, and saved to the inspection map data 13a by the map creation unit 12b.

[0092] Figure 7 shows an example of the display on the inspection period selection screen 140. The inspection period selection screen 140 includes an inspection target display section 141, an inspection period display section 142, a legend display section 143, and an inspection period addition button 144.

[0093] The inspection target display unit 141 displays the map name of the map 100 that is selected for inspection period, and the number of inspection periods set for map 100. The inspection period display unit 142 displays a calendar and the set inspection period.

[0094] The legend display section 143 displays a legend for the inspection periods set for the calendar dates. Past inspection periods (October 15th-18th), the current inspection period (October 29th), and future scheduled inspection periods (October 31st) are displayed on the calendar in different colors. The locations inspected during each inspection period are the same area, but they may also be different areas.

[0095] The "Add Inspection Period" button 144 is used by the inspection manager to add an inspection period. When the "Add Inspection Period" button 144 is pressed, the "Add Inspection Period" confirmation screen 145 is displayed, as shown in the middle of Figure 7. If the inspection manager presses "Cancel," the addition of the inspection period is canceled. If the inspection manager presses "OK," the "Inspection Period Setting" screen 146 is displayed, as shown on the right side of Figure 7.

[0096] The inspection period setting screen 146 includes an additional period selection unit 147 and an inspection period addition instruction unit 148. The additional period selection section 147 is provided with input fields that allow the user to select the start and end dates of the inspection period using a calendar or by direct input. The inspection period extension instruction unit 148 is used by the inspection manager to instruct the extension of the inspection period.

[0097] Let's return to the explanation of Figure 4. Next, the inspection manager decides whether or not to save the data related to the configured map 100 (S9). If the inspection manager decides not to save the data (NO in S9), the decision in step S9 is repeated. The processes in steps S1 to S8 may be performed until it becomes possible to save the data.

[0098] On the other hand, if the data is to be saved (YES in S9), the inspection manager terminates the map creation process. Information instructing the data to be saved is sent to the communication unit 11 of the management server 1 via the communication unit 21 of the information processing terminal 2, and the map creation unit 12b saves the data to the inspection map data 13a (S10), terminating this process.

[0099] <Inspection process> Next, we will explain the inspection process carried out by the inspectors. Figure 8 is a flowchart showing an example of the inspection process. Subsequent processes are carried out by the inspection processing unit 22c and the inspection result output unit 22d in conjunction with the inspector's operations on the information processing terminal 2. The process will be explained here with reference to the screens shown in Figures 9 to 14.

[0100] First, the inspector operates the information processing terminal 2 to select a map containing the inspection locations and then selects an inspection date (S11). Map selection can be done, for example, by selecting one map from a list of multiple map selection screens (not shown), or by entering the map name in the search input field. The inspection date can be selected from the inspection dates included in the current inspection period, as shown on the inspection period selection screen 140 on the left side of Figure 7. For example, let's say October 29th, the day of the inspection, is selected. The inspector can also add and set inspection periods from the inspection period selection screen 140.

[0101] The information processing terminal 2 displays the map information read from the inspection map data 13a on the display unit 25 (S12). Here, if the information processing terminal 2 is online, the map information is the information downloaded from the inspection map data 13a stored on the management server 1. It is assumed that the process up to this point is performed in an online environment.

[0102] Next, the processing switching unit 22b determines whether the communication environment is an offline environment (S13). Since the environment may change from online to offline when the inspector moves, the process in step S13 is performed. If the processing switching unit 22b determines that the communication environment is an offline environment (YES in S13), it sets the offline communication process (S14). Once the offline communication process is set, subsequent processing is performed by the inspection application installed on the information processing terminal 2.

[0103] If the processing switching unit 22b determines that the communication environment is not an offline environment (NO in S13), it will remain in online communication processing mode. When online communication processing is set, the inspection record is transmitted in real time to the management server 1 which is connected online.

[0104] After step S13 (NO) or S14, the inspector inspects the infrastructure structure to be inspected (S15). Here, the inspection in step S15 can be performed using the map 100 displayed in 2D on the display unit 25, or using the 3D model displayed in 3D on the display unit 25. Below, an example of the inspector selecting an inspection area will be explained with reference to Figure 9.

[0105] Figure 9 shows an example of the map information display screen 150. The map information display screen 150 shows inspection areas where the inspector can select between 2D or 3D display based on the map information.

[0106] The screen generation unit 22a of the information processing terminal 2 generates a screen in which a first indicator is placed in the area where only 2D images are placed, and a second indicator is placed in the area where 3D images are placed. The map information display screen 150 shown in Figure 9 displays a callout bubble 151 (example of the first indicator) labeled "2D" and a callout bubble 152 (example of the second indicator) labeled "3D" on the map, which are attached to the inspection target. By looking at the callout bubbles 151 and 152, the inspector can determine whether the inspection target can be displayed as a 2D or 3D image on the display unit 25.

[0107] When the inspector selects the callout 151 labeled "2D", the 2D image of the design drawing 60 is displayed overlaid on the area indicated by the callout 151. When the inspector selects the callout 152 labeled "3D", the 3D image of the design drawing 60 is displayed overlaid on the area indicated by the callout 152.

[0108] When the method of inspection using the 2D-displayed map 100 is selected, the inspector begins recording the inspection items on the 2D-displayed map 100 (S16).

[0109] Furthermore, when the method of inspection using a 3D-displayed 3D model is selected, the inspector clicks on the 3D image of the inspection target displayed on the 3D-displayed map 100 (S17). Next, the inspector previews the 3D image created by the 3D model (S18). The 3D model is displayed as a 3D image as shown in the lower part of Figure 6. Then, the inspector starts recording the inspection on the 3D model (S19).

[0110] After step S16 or S19, the inspector performs the inspection record input process (S20). After the input process is completed, the inspector determines whether the inspection is complete (S21). The inspector repeats steps S15 to S20 until the inspection is complete. Once the inspection by the inspector is complete, the inspection process ends.

[0111] If offline communication processing is set in step S14, the processing switching unit 22b determines whether the communication environment has come online or not (S22). If the communication environment remains offline (NO in S22), the processing switching unit 22b waits until the communication environment comes online.

[0112] On the other hand, when the communication environment comes online (YES in S22), the processing switching unit 22b controls the communication unit 21 to send the inspection results read from the storage unit 23 of the information processing terminal 2 to the management server 1 (S23), and terminates the map inspection process.

[0113] Now, let's explain the input process for the inspection record in step S20. Figure 10 is a flowchart showing an example of the input process for inspection records. Figure 11 shows an example of the display of the inspection record input screen 200. Figure 12 shows an example of the transitions between each screen in the inspection record input screen 200.

[0114] Before starting the inspection, the inspector displays the inspection record input screen 200 on the display unit 25 of the information processing terminal 2. The inspection record input screen 200 shown in Figure 11 displays the inspection area 101, inspection pins P1 and P2 (black human-shaped icons) indicating that the area has been inspected in the past, and management points F1 to F3 (flag icons). In subsequent drawings, the map displayed on the inspection record input screen 200 may become cluttered, so not all reference numerals may be used in the explanation.

[0115] Furthermore, the inspection record input screen 200 shown in Figure 11 displays the map type change unit 201, the display setting unit 202, the patrol route selection unit 205, the current location switching unit 203, the inspection pin setting unit 204, the patrol route selection unit 205, and the detailed display unit 206. The map type change unit 201 is used to change the map type displayed on the inspection record input screen 200. For example, the inspector can change the display from a general map to an aerial photograph map.

[0116] The display setting unit 202 is used to set whether to display or hide the patrol route 105, management points, inspection area 101, and diagrams. Inspectors can also patrol with only the management points or only the patrol route 105 displayed.

[0117] The current location switching unit 203 is used to switch the current location of the information processing terminal 2. The current location switching unit 203 is used, for example, to understand the positional relationship between the current location and the inspection area 101 when an inspector moves from their current location to the inspection area 101. The initial display of the inspection record input screen 200 is the range in which the inspection area 101 is set, so the current location of the information processing terminal 2 may not be shown in the initially displayed range. In this case, by selecting the current location switching unit 203, the current location of the information processing terminal 2 can be displayed, and the positional relationship between the current location of the information processing terminal 2 and the inspection area 101 can be understood.

[0118] The inspection pin setting unit 204 is used to instruct the inspector to set an inspection pin at a location inspected near a management point. When the inspector presses the inspection pin setting unit 204, the system transitions to the transition diagram for registering a new pin shown in Figure 12, and the inspection pin for the day can be set in the inspection area 101.

[0119] The patrol route selection unit 205 is used to select one patrol route from several patrol routes set in the inspection area 101. If there is heavy machinery or other equipment at the inspection site, the inspector can set a different patrol route from the original one to avoid the equipment.

[0120] The detailed display unit 206 is used to display the selection unit 207 for entering details about the inspection. When the inspector presses the detailed display unit 206, the selection unit 207 is displayed overlaid on the inspection record input screen 200.

[0121] The selection section 207 displays buttons that allow the inspector to select "Inspection Information," "Inspection Complete," and "Recommendations." When the "Inspection Information" button is pressed, the necessary documents and other information for the inspection are displayed. When the "Inspection Complete" button is pressed, the inspection ends. When the "Recommendations" button is pressed, recommended settings and other information for the inspection are displayed.

[0122] As shown in Figure 10, the inspector places inspection pins at the locations that have been inspected within the inspection area 101 (S31). From here, the explanation will be given with reference to the transition diagram in Figure 12. Note that, in order to avoid making the diagrams too complex, the map type change unit 201, display setting unit 202, patrol route selection unit 205, and some of the symbols for inspection pins and management points in Figure 12 (1) to (5) have been omitted. Also, transition diagram (1) is a simplified display of the inspection record input screen 200 shown in Figure 11.

[0123] When the inspection pin setting unit 204 in transition diagram (1) is pressed, transition diagram (2) is displayed. In the inspection record input screen 200 shown in transition diagram (2), inspection pins P3 (white human-shaped icons) that will be placed at the locations inspected by the inspector on that day are placed near management point F1. At this point, the new pin registration screen 210 for registering new inspection pins (referred to as new pins) is displayed overlaid on the inspection record input screen 200. The new pin registration screen 210 also displays selection buttons for the item to which the new pin belongs (for example, survey / design). After the inspector selects the item to which the new pin belongs, they press the next button 211, and transition diagram (3) in Figure 12 is displayed.

[0124] Next, the inspector inputs the inspection record to the transition diagram (3) (S32). The inspection record is recorded, for example, as the scale of the inspection and comments entered via voice input. Next, the inspector adds photographs of the inspection area taken with camera 46 (S33). Then, the inspector saves the inspection record (S24). After saving the inspection record, the inspector proceeds to step S21 in Figure 8.

[0125] The inspection record input screen 200 shown in the transition diagram (3) of Figure 12 displays an inspection scale recording section 212, a detailed recording section 213, a photo addition section 214, and a data transmission instruction button 215. The inspection scale recording section 212 is used by the inspector to input the size of the inspection at the inspection location where a new pin has been set. The detailed recording section 213 is used by the inspector to input details of the symptoms during the inspection via voice input. The content of the voice input is displayed as text in the detailed recording section 213.

[0126] The photo addition section 214 is used to add photos of inspection locations taken by the inspector with the camera 46. When the inspector presses the data transmission instruction button 215, the inspection record entered by the inspector is sent to the management server 1, and the inspection record is saved in the inspection map data 13a of the management server 1. The inspection record may also be recorded through the inspection input screen 50 shown in Figure 3.

[0127] After data transmission, the inspection record input screen 200 shown in the transition diagram (4) of Figure 12 is displayed. Inspection pin P3 is displayed on this inspection record input screen 200. While performing the inspection, the inspector can input detailed inspection records by displaying the transition diagrams (1) to (4) of Figure 12.

[0128] The transition diagram (4) shows an alert that appears when an inspector approaches, for example, management point F2. The alert is, for example, a message such as "Approaching Management Point!", displayed in a speech bubble, and an alert sound is emitted from speaker 47. Access information (link information with an embedded URL) to documents associated with the management point (inspection manual, etc.) is also included in the alert. The inspector can recognize when they are approaching management point F2 by the sound of an alert. The inspector can also obtain detailed inspection information by displaying documents linked to the management point on information processing terminal 2.

[0129] The inspection record input screen 200 shown in the transition diagram (5) of Figure 12 is used when an inspector enters additional comments at the location where an inspection pin has been installed. For example, suppose that inspection pins P3 to P5 were installed as a result of the inspection on that day. In this case, the inspector can select a specific inspection pin (for example, inspection pin P4) to display the additional comment input field 216. The additional comment is displayed in the comment field 217, which is converted into text information via voice input. When the inspector presses the processed button 218, the additional comment is reflected in the specific inspection pin.

[0130] Figure 13 shows an example of the display on the inspection result display screen 300. The inspection result display screen 300 is displayed, for example, on an information processing terminal 2 used by the inspection manager. The inspection manager selects a map and inspection period using an unillustrated selection screen, which displays the inspection result display screen 300 showing the inspection results for the selected map and inspection period. The inspection results include an area containing at least one of the management points and inspection pins, the inspection period for which the inspection pins were set, and comments associated with the inspection pins.

[0131] The inspection result display screen 300 includes a map display unit 301, a management point list display unit 302, an inspection period display unit 303, a current inspection pin display unit 304, and an unprocessed and processed inspection pin display unit 305.

[0132] The map display unit 301 displays a map selected by the inspection manager. This map shows the inspection area 101. The management points and inspection pins displayed on the map display unit 301 are numbered, allowing the inspection manager to easily identify the management points and inspection pins.

[0133] The management point list display unit 302 displays a list of management points set on the map displayed on the map display unit 301, along with their item numbers. The inspection period display unit 303 displays the inspection period selected by the inspection manager. This inspection period is the same as the inspection period for which the inspection pins are set. The inspection pin display unit 304 will now display the item number of the inspection pin assigned to the inspection location that was inspected on this day (October 29th) (for example, 1-1 to 1-3), along with the details of the inspection.

[0134] The unprocessed and processed inspection pin display unit 305 displays the item numbers of inspection pins that have not yet been inspected (e.g., 3-1, 3-2), the item numbers of inspection pins that have been inspected (e.g., 2-1, 2-2), and the details of the inspection.

[0135] The inspection manager can confirm which areas were inspected and what the inspections entailed during the inspection period by checking the information displayed on the inspection results screen 300. The inspection results screen 300 may also be displayed on the information processing terminal 2 used by the inspector.

[0136] Figure 14 shows an example of the display of the detailed inspection results display unit 306. The detailed inspection unit 306 represents, for example, pin data in which information recorded for inspection pins is output in CSV (Comma Separated Values) format. The pin data includes the item number set for each inspection pin, as well as user space, service space, presence or absence of problems, points of concern, additional comments, etc. The items of user space, service space, presence or absence of problems, points of concern, and additional comments are set according to the status of the construction work and are customized according to the type of construction work and the response to the client. In addition, since the pin data is output in CSV format, it is also possible to output the inspection results as a medical record in any format.

[0137] Furthermore, inspection managers can obtain detailed information about the inspection points based on the information displayed in the detailed display unit 306. They can also obtain information such as which areas are prone to malfunctions by loading the pin data into analysis software (not shown).

[0138] Figure 15 shows an example of the configuration of inspection map data 13a. Inspection map data 13a includes the following items: map, area, additional data, inspection date, inspection location, comments, and photographs.

[0139] The map item stores a map identifier that identifies the map used for inspection. The area item stores an area identifier used to identify the area set on the area setting screen 120 shown in Figure 5. The additional data item stores the data name of the design data 13c or 3D data 13d, which is the design drawing 60 that is placed overlaid on the area in the design drawing placement screen 130 shown in Figure 6. Note that multiple design drawings 60 may be placed in a single area.

[0140] The inspection date field stores the date on which an inspection was performed on inspection area 101. The inspection item stores the inspection points set in inspection area 101 as inspection pin item numbers. As shown in Figure 13, each inspection pin is assigned an item number. The comments section stores comments entered by the inspector regarding the inspection points indicated by the inspection pins. The photo item stores photographs taken by the inspector of the inspection points indicated by the inspection pins.

[0141] Since the inspection map data 13a is digital data, the contents of the inspections can be easily searched. Furthermore, because various types of information are stored in the inspection map data 13a, both inspection managers and inspectors can check the detailed contents of past inspections.

[0142] The inspection system 10 described above can electronically record the contents that were previously written on paper during inspections into the inspection map data 13a on the management server 1 via the information processing terminal 2. This makes it easier for inspection managers and inspectors to confirm inspection results, and reduces the likelihood of missed inspections.

[0143] Furthermore, conventionally, inspectors had to return to the office and then transcribe the inspection records they had written on paper into the management system. In contrast, with the inspection system 10 according to this embodiment, inspectors can input inspection records at the site where the inspection was conducted and complete the recording process. In addition, since various checklists are displayed on the information processing terminal 2 used by the inspector according to the area or management point, inspectors can input inspection records on-site even if there are multiple different record formats for different locations and construction projects, thereby streamlining the inspection work.

[0144] Furthermore, the images captured during the inspection work may be still images or videos captured in real time. It is also possible to register images (previously captured images) that have been recorded in the information processing terminal 2 to the management server 1. Therefore, a wide range of information can be registered to the management server 1 in large quantities for a single inspection work, making it possible to improve the accuracy of the inspection results.

[0145] Furthermore, the processing switching unit 22b automatically determines whether the information processing terminal 2 is in an online or offline environment. For example, even in offline environments such as inside a tunnel, inside a large structure, or on a mountain road, inspectors can perform inspection work in the correct location based on the inspection map data 23a that has been pre-downloaded to the information processing terminal 2. In addition, photographs of inspection locations can be linked to inspection pins, making it clear where the photographs were taken.

[0146] Inspection locations are displayed as management points and inspection pins within the area. This allows inspectors to grasp the relative locations of inspection sites over a wide area. Furthermore, inspection managers can use map information of the surrounding terrain and infrastructure structures to estimate the factors causing changes in the site's condition, thereby facilitating decision-making and enabling the rapid development of emergency response plans.

[0147] Currently, inspection results are typically stored in a designated storage location via filing. Furthermore, feedback on these records relies solely on manually searching files based on an index recorded in the management file. This has resulted in significant time constraints for information sharing between inspectors in the office and inspection managers located elsewhere, sometimes leading to delays in inspection planning.

[0148] On the other hand, in the inspection system 10 according to this embodiment, inspection records transmitted from the information processing terminal 2 to the management server 1 can be shared with other information processing terminals 2 on the management server 1's cloud. Therefore, by displaying the inspection date on the inspection period selection screen 140, inspectors can easily search for the inspection date.

[0149] Furthermore, inspection managers can easily check the inspection results displayed on the inspection results display screen 300. Inspection managers and inspectors can also view the same information and share inspection details in real time. Adding comments from the manager helps prevent errors caused by overlooking inspection points or misjudging, thus facilitating risk communication. Additionally, inspected areas are indicated by a change in the color of the inspection pin, eliminating the waste of double-checking the same area.

[0150] Furthermore, 3D images of infrastructure structures are displayed using point cloud data or 3D models. As a result, inspectors can visually inspect infrastructure structures on-site while viewing the 3D display on the information processing terminal 2, reducing the likelihood of misidentifying inspection targets.

[0151] Furthermore, even in offline environments such as underground structures like tunnels, inspection points can be clearly identified based on the location information of the information processing terminal 2, allowing inspectors to improve the efficiency and safety of their inspection work. In addition, since the point cloud data includes color information as well as the shape of the structure, inspectors can use it as a threshold (color-based limit sample) for evaluating the appearance of quality. Therefore, it is possible to perform highly accurate recording as evidence for evaluating changes over time, which is expected to lead to improvements in deterioration countermeasures.

[0152] Furthermore, inspectors can conduct inspections while moving along the patrol route 105, which is displayed along with the area. This allows for the standardization (unification) of inspection routes, enabling inspectors to efficiently master inspection methods. In addition, since inspections can be conducted using the same patrol route 105 even during different inspection periods, the method of setting the patrol route 105 does not become dependent on individual inspectors. Therefore, by sharing the patrol route 105 even among different inspectors, it is possible to prevent bias in inspection methods.

[0153] Furthermore, an alert is triggered when an inspector approaches a management point, preventing them from forgetting inspection locations. Additionally, a link to inspection information set at the management point allows inspectors on-site to confirm inspection procedures. This improves the efficiency and accuracy of inspections.

[0154] Inspection points for civil engineering infrastructure are diverse and have unique characteristics depending on the structure being inspected. As a result, the number of inspection items at each inspection point is large, making it time-consuming for new inspectors (inexperienced personnel) to become proficient. Furthermore, inspections often involve working on scaffolding or in underground spaces, increasing the safety risks for inexperienced personnel. Therefore, measures are needed to ensure efficient recognition (proficiency) of inspection points and their sequence.

[0155] However, due to a shortage of personnel, it has become difficult to continuously assign dedicated inspectors. As a result, in the past, it was not possible to conduct observations over time by the same person, and the standardization of inspection results could not be maintained. On the other hand, in the inspection system 10 according to this embodiment, management points can be set in advance according to the structure of the infrastructure structure to be inspected, so that the areas to be inspected intensively become clear. Furthermore, inspectors can check the condition of the inspection points while looking at the diagram and management points displayed on the information processing terminal 2. In addition, even if the inspector changes, it becomes clear what kind of inspection was performed, so the inspection results can be standardized.

[0156] Furthermore, in multi-story structures, inspectors may lose track of their own position during inspections. This is especially true in enclosed underground spaces such as tunnels, where maintaining a fixed position is difficult. Inexperienced inspectors, such as newcomers, may be unable to confirm their position, leading to decreased efficiency in inspection work and increased risk of safety issues such as oxygen depletion.

[0157] To address such issues, the screen generation unit 22a of the information processing terminal 2 generates a screen for placing markers (mediums from which information such as 2D codes can be read) in the inspection space. On this screen, the location information acquisition unit 22d displays the acquired location information as the current location in a 3D-displayed point cloud, based on the information such as 2D codes. Therefore, inspectors can confirm their own position at any time. In addition, inspectors can confirm their own position by displaying markers within the point cloud. Furthermore, in an online environment, by using electronic tags for the markers, inspectors can not only display their own position but also share inspection information on the cloud in real time.

[0158] It should be noted that the present invention is not limited to the embodiments described above, and various other applications and modifications can be taken as long as they do not deviate from the gist of the present invention as described in the claims. For example, the embodiments described above are detailed and specific explanations of the system configuration in order to clearly illustrate the present invention, and are not necessarily limited to having all the configurations described. Furthermore, it is possible to add, delete, or replace some of the configurations in these embodiments with other configurations. Furthermore, the control lines and information lines shown are those deemed necessary for explanatory purposes, and not all control lines and information lines are necessarily shown in the actual product. In reality, it is safe to assume that almost all components are interconnected. [Explanation of Symbols]

[0159] 1...Management Server, 2...Information Processing Terminal, 10...Inspection System, 12...Control Unit, 12a...Screen Generation Unit, 12b...Map Creation Unit, 12c...Inspection Processing Unit, 12d...Inspection Result Output Unit, 13...Storage Unit, 13a...Inspection Map Data, 21...Communication Unit, 22...Control Unit, 22a...Screen Generation Unit, 22b...Processing Switching Unit, 22c...Inspection Processing Unit, 22d...Location Information Acquisition Unit, 22e...Inspection Result Output Unit, 23...Storage Unit, 23a...Inspection Map Data, 24...Input Unit, 25...Display Unit, 50...Inspection Input Screen, 60...Design Drawing, 100...Map, 101...Inspection Area, 102...Non-Inspection Area, 105...Patrol Route, 110...Map Creation Start Screen, 120...Area Setting Screen, 130...Design Drawing Placement Screen, 150...Map Information Display Screen, 200...Inspection Record Input Screen, 300...Inspection Result Display Screen

Claims

1. A storage unit that stores inspection map data, including the map to be inspected, A screen generation unit that generates a screen including the map displayed on the display unit of an information processing terminal and the 3D image of the object to be inspected linked to the map, An inspection processing unit that stores inspection results input from the information processing terminal in the storage unit, linked to the map, The system includes an inspection result output unit that outputs the inspection results to the information processing terminal. Inspection system.

2. The screen generation unit generates a screen for the map displayed on the information processing terminal that includes management points representing locations requiring detailed inspection, and inspection icons representing locations scheduled for inspection by an inspector, or locations that have been inspected by an inspector. The inspection system according to claim 1.

3. The inspection processing unit reads from the storage unit the inspection map data input from the information processing terminal, the current date and time, which is included in the inspection period, and stores the inspection map data, which reflects the area to be inspected as set by the information processing terminal, in the storage unit. The inspection system according to claim 2.

4. When the inspection processing unit detects that the current location of the information processing terminal is approaching the management point, it causes the display unit to display information indicating that the management point is nearby. The inspection system according to claim 3.

5. Furthermore, when the inspection processing unit detects that the current location of the information processing terminal is approaching the management point, it sounds an alert on the information processing terminal. The inspection system according to claim 3.

6. The inspection result output unit outputs the information of the management point and information indicating whether the location indicated by the inspection icon has been inspected or is scheduled for inspection as the inspection result. The inspection system according to claim 4.

7. The area includes a map creation unit that creates the map in which the management points and inspection icons are placed. The inspection system according to claim 6.

8. The map creation unit creates the map in which 2D images or 3D images are placed in the area. The screen generation unit generates a screen in which a first indicator is placed in the area where only the 2D image is placed, and a second indicator is placed in the area where the 3D image is placed. The inspection system according to claim 7.

9. The 3D image is formed from point cloud data obtained by measuring the inspection target with light rays emitted by a measuring instrument, or from 3D model data that models the inspection target. The inspection system according to claim 7.

10. The inspection results include the management point, the area containing at least one of the inspection icons, the inspection period for which the inspection icon is set, and a comment associated with the inspection icon. The inspection system according to claim 3.

11. When the information processing terminal is in an online environment capable of communicating with the management server, it causes the screen generated by the screen generation unit of the management server to be displayed on the display unit. The inspection processing unit in the management server detects when the information processing terminal approaches the management point based on the location information transmitted from the information processing terminal, and stores the information of the inspection icon indicating that the inspection has been completed, transmitted from the information processing terminal, in the storage unit as the inspection result. The inspection system according to claim 10.

12. The information processing terminal includes a processing switching unit that determines whether it is in an online environment where it can communicate with the management server, or in an offline environment where it cannot communicate with the management server, and switches the processing accordingly. The processing switching unit, when the information processing terminal is in the offline environment, The screen generated by the screen generation unit of the information processing terminal is displayed on the display unit. The inspection processing unit of the information processing terminal is instructed to detect that the information processing terminal has approached the management point based on the location information, and to store the information of the inspection icon input from the input unit of the information processing terminal in the storage unit as the inspection result. When the information processing terminal transitions from the offline environment to the online environment, it transmits the inspection results read from the storage unit to the management server. The inspection system according to claim 11.

13. A procedure for generating a screen that includes a map of the inspection targets and a 3D image of the inspection targets linked to the map, which is displayed on the display unit of an information processing terminal. A procedure for linking the inspection results input from the information processing terminal to the map and saving them in the storage unit as inspection map data including the map of the subject to inspection, The procedure for outputting the inspection results to the information processing terminal, A program designed to be executed by a computer.

Images