Equipment inspection method and equipment inspection system

Abstract

To provide a facility inspection method for appropriately inspecting a facility.SOLUTION: A method includes: a matching step (step S103) in which three-dimensional point group data of a whole building of an inspection target facility acquired in advance is displayed on a display unit 11 of an HMD 10 (head-mounted display), and in which a wearer superimposes the three-dimensional point group data on a real space that the wearer sees through display unit 11; a tag display step (step S105) in which the HMD 10 displays a tag indicating an inspection point set in advance in the three-dimensional point group data on the display unit 11; and an inspection step (step S106) in which the wearer inspects the inspection point according to the tag.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an equipment inspection method for performing equipment inspection and the technology of an equipment inspection system.

Background Art

[0002] Conventionally, technologies related to equipment inspection methods for performing equipment inspection are known. For example, it is as described in Patent Document 1.

[0003] Patent Document 1 describes a technology of an inspection method that uses an RFID tag attached to an equipment to be inspected, a portable information terminal capable of transmitting and receiving data to and from the RFID tag in a non-contact manner, and a management PC capable of storing inspection data of the portable information terminal. In the technology described in Patent Document 1, when the RFID data is read by the portable information terminal, an inspection value input screen corresponding to the equipment to be inspected to which the RFID tag is attached is displayed on the portable information terminal. An operator performing the inspection work can input the inspection value of the equipment to be inspected read visually from the inspection value input screen. By configuring in this way, in the technology described in Patent Document 1, it is possible to prevent the occurrence of entry mistakes such as inputting into the input screen of other equipment when writing the inspection value.

[0004] However, in the technology described in Patent Document 1, since the RFID tag is attached to the equipment to be inspected, although the equipment to be inspected can be grasped, it is not possible to grasp up to more detailed inspection locations (such as which part of the equipment should be inspected, etc.). Also, when there are a large number of equipment to be inspected in the same facility, it is necessary to grasp in advance where in the facility the equipment to be inspected is installed. Therefore, in the technology described in Patent Document 1, there is no problem when an operator with a certain degree of proficiency who understands the inspection locations in advance performs the inspection, but when an operator who is not familiar with the inspection work performs the inspection, there may be mistakes in the inspection locations and a decrease in the efficiency of the inspection work. Therefore, there is a need for a technology of an equipment inspection method and an equipment inspection system that can easily recognize the inspection locations and can perform the inspection more preferably even for an operator who is not a skilled worker.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] One aspect of the present disclosure has been made in view of the above circumstances, and the problem to be solved is to provide an equipment inspection method and an equipment inspection system capable of suitably performing equipment inspection even when there are a large number of inspection target locations.

Means for Solving the Problems

[0007] The problem to be solved by one aspect of the present disclosure is as described above. Next, means for solving this problem will be described.

[0008] That is, an equipment inspection method according to one aspect of the present disclosure includes a matching step of superimposing three-dimensional point cloud data of an entire building, which has been acquired in advance, on a real space that is viewed by a wearer through a display unit of a head-mounted display worn by the wearer; a tag display step of the head-mounted display displaying, on the display unit, a tag indicating an inspection location preset in the three-dimensional point cloud data; and an inspection step of the wearer inspecting the inspection location according to the tag. including The three-dimensional point cloud data of the entire building is displayed on the display unit of the head-mounted display worn by the wearer, and the wearer visually recognizes it through the display unit. any in the real space, the wearer movement operation superimposes After fixing the three-dimensional point cloud data with respect to the real space, erase the display of the three-dimensional point cloud data on the display unit thereon.

[0009] Also, in one aspect of the present disclosure, in the inspection step, when the wearer selects the tag, a management ledger of the inspection location corresponding to the selected tag is displayed on the display unit, and the wearer inputs an inspection result to the management ledger.

[0010] Also, in one aspect of the present disclosure, when it is determined that there is an abnormality in the inspection result input in the inspection step, the head-mounted display further includes a notification step of performing notification for prompting the inspection of other inspection points associated with the inspection point where the abnormality exists to be preferentially performed.

[0012] Also, in one aspect of the present disclosure, in the tag display step, the tag is displayed so as to be able to identify the inspection order and / or the presence or absence of inspection completion.

[0013] Also, in one aspect of the present disclosure, in the matching step, an operation image for moving the three-dimensional point cloud data to the display unit is displayed, and the three-dimensional point cloud data is moved to a position corresponding to the real space when the wearer operates the operation image.

[0014] Also, the facility inspection system according to one aspect of the present disclosure is a facility to be inspected acquired in advance including A storage unit that stores the three-dimensional point cloud data of the entire building and the inspection points of the three-dimensional point cloud data, and is provided on a head-mounted display and can display the three-dimensional point cloud data and the inspection points superimposed on the real space Yes, it is possible to perform a movement operation on the three-dimensional point cloud data, fix the three-dimensional point cloud data with respect to the real space, and erase the display of the three-dimensional point cloud data And a display unit, and the display unit can display a tag indicating an inspection point preset in the three-dimensional point cloud data.

Advantages of the Invention

[0015] According to one aspect of the present disclosure, it is possible to suitably inspect facilities even when there are a large number of inspection target locations.

Brief Description of the Drawings

[0016]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Mode for Carrying Out the Invention

[0017] First, with reference to FIGS. 1 and 2, the overall configuration of the equipment inspection system 1 according to an embodiment of the present invention will be described.

[0018] The equipment inspection system 1 is for inspecting various equipment. The equipment to be inspected by the equipment inspection system 1 is not particularly limited, and any equipment (various infrastructure equipment, factory equipment, etc.) can be the inspection target. In this embodiment, as an example, it is assumed that the pumping station A is inspected. The equipment inspection system 1 mainly includes a head-mounted display 10 and a management server 20.

[0019] The head-mounted display 10 (hereinafter simply referred to as HMD 10) is worn on the head of the operator who performs the inspection and provides augmented reality to the operator. The HMD 10 is composed of a glasses-type wearable device. The HMD 10 mainly includes a display unit 11, a sensor unit 12, a communication unit 13, etc.

[0020] The display unit 11 is arranged in front of the inspector's field of vision and provides appropriate images to the inspector. The display unit 11 is composed of, for example, a transparent liquid crystal display or the like. The inspector can visually recognize by superimposing the image displayed on the display unit 11 on the real space visible through the display unit 11.

[0021] The sensor unit 12 is capable of detecting various kinds of information. The sensor unit 12 is composed of at least one sensor capable of detecting various kinds of information. The type of sensor used is arbitrarily selected according to the use of the HMD 10. Examples of the sensors used in the sensor unit 12 include a depth sensor, an acceleration sensor, a gyro sensor, various cameras, and the like. The sensor unit 12 can detect the position, orientation, movement of the body (such as hands) of the operator wearing the HMD 10, the three-dimensional shape of the surrounding (real space), and the like. The HMD 10 can detect the movement of the operator's hand by the sensor unit 12 and perform an operation according to the movement. Also, by using the sensor unit 12, the HMD 10 can recognize the surrounding space. Thereby, the HMD 10 can move the image displayed on the display unit 11, for example, following the change or movement of the viewpoint of the person wearing the HMD 10.

[0022] The communication unit 13 communicates with external devices by an appropriate communication method (for example, the Internet, a mobile communication network, etc.). In the present embodiment, the communication unit 13 can communicate with the communication unit 25 of the management server 20 described later and perform transmission and reception of various kinds of information.

[0023] The user of the HMD 10 can switch the power on / off, adjust the volume, etc. by operating various switches provided on the HMD 10. Also, the user of the HMD 10 can display various icons and operation screens on the display unit 11 according to a predetermined operation and perform various operations related to the HMD 10 by operating the icons and the like.

[0024] Note that although detailed description is omitted, the HMD 10 is also appropriately provided with an arithmetic processing device such as a CPU necessary for various processes, a storage device such as a RAM and a ROM, etc. other than the above.

[0025] The management server 20 manages various types of information related to inspections. As the management server 20, any server such as a physical server or a virtual server can be used. The management server 20 can be installed, for example, in management office B where the administrator of the inspection work works. The management server 20 mainly includes a three-dimensional point cloud database 21, a management ledger database 22, a tag database 23, an inspection order database 24, a communication unit 25, and the like.

[0026] The three-dimensional point cloud database 21 stores the three-dimensional point cloud data of the facility to be inspected (inspection target facility). The three-dimensional point cloud data of the inspection target facility is measured in advance and stored in the three-dimensional point cloud database 21. At this time, in the three-dimensional point cloud database 21, information for identifying the inspection target facility (for example, number, name of the facility, address of the facility, etc.) and the three-dimensional point cloud data of the inspection target facility are stored in an associated manner.

[0027] For example, the three-dimensional point cloud database 21 stores the three-dimensional point cloud data of the entire building of the pumping station A, which is the inspection target facility of this embodiment. The three-dimensional point cloud data includes the three-dimensional point cloud data of the building of the pumping station A and various devices (pump P, engine, control panel, etc.) installed in this building. The three-dimensional point cloud data can be measured using an appropriate measuring device (such as a three-dimensional laser scanner). FIG. 4 shows, as an example, the three-dimensional point cloud data P' of the pump P installed in the pumping station A.

[0028] The management ledger database 22 stores information (management ledger) related to the inspection content of the inspection target facility. In the management ledger database 22, information for identifying the inspection item (for example, number, name of the inspection target facility, name of the device to be inspected, name of the inspection item, etc.) and information related to the content of the inspection item (standard value, measured value, unit of the measured value, etc.) are stored in an associated manner. FIG. 7 shows, as an example, a management ledger D related to a predetermined inspection item (in the illustrated example, "discharge pressure") called up on the display unit 11 of the HMD 10.

[0029] The tag database 23 stores tags (tag data) set at inspection points on the three-dimensional point group data stored in the three-dimensional point group database 21. Here, a tag is information regarding an inspection point. In the present embodiment, the tag includes an inspection item name, information (such as coordinates) indicating the inspection point on the three-dimensional point group data, and information (such as a URL) for calling a management ledger corresponding to the inspection point. FIG. 4 shows, as an example, tags T1 and T2 displayed on the display unit 11 (more specifically, on the three-dimensional point group data P' of the pump P called by the display unit 11). As shown in FIG. 4, the tags T1 and T2 called by the display unit 11 are described with, for example, an inspection item name and are displayed so as to indicate the inspection point.

[0030] The inspection order database 24 stores information regarding the order in which a plurality of inspection items (inspection points) should be inspected. In the inspection order database 24, a predetermined inspection order is stored for each facility to be inspected.

[0031] The communication unit 25 communicates with external devices by an appropriate communication method (for example, the Internet, a mobile communication network, etc.). In the present embodiment, the communication unit 25 can communicate with the communication unit 13 of the HMD 10 and transmit and receive various information.

[0032] Note that although detailed description is omitted, the management server 20 is appropriately provided with arithmetic processing devices such as a CPU necessary for various processes, and storage devices such as a RAM and a ROM in addition to the above. Further, the management server 20 is appropriately provided with a display device such as a liquid crystal monitor used by an administrator who manages, for example, inspection work, and an input device such as a keyboard.

[0033] Next, an equipment inspection method using the above-described equipment inspection system 1 will be described.

[0034] As a preliminary preparation for inspection, three-dimensional point cloud data of the entire building including the exterior and interior of the pumping station A, which is the facility to be inspected in this embodiment, is measured and stored in the three-dimensional point cloud database 21 of the management server 20. In addition, tags are set at the inspection points of the three-dimensional point cloud data, and information related to the tags is stored in the tag database 23 of the management server 20.

[0035] In step S101 shown in FIG. 3, the operator performing the inspection operates the HMD 10 to read the three-dimensional point cloud data stored in the three-dimensional point cloud database 21 of the management server 20 and the tags stored in the tag database 23 into the HMD 10. At this time, the operator operates the HMD 10 and selects the facility (pumping station A) to be inspected this time from among the data related to a plurality of facilities to be inspected stored in the management server 20. The management server 20 transmits the three-dimensional point cloud data of the selected facility, etc. to the HMD 10. After the process of step S101 is performed, the process proceeds to step S102.

[0036] In step S102, the operator operates the HMD 10 to display the three-dimensional point cloud data and the tags on the display unit 11. FIG. 4 shows an example in which the three-dimensional point cloud data P' of the pump P and the tags T1 and T2 set at the inspection points on the three-dimensional point cloud data P' are displayed on the display unit 11. In this embodiment, for the sake of convenience, only the tags T1 and T2 are illustrated, but actually, tags are displayed not only for these two tags but also for all the inspection points of the pumping station A to be inspected this time.

[0037] As shown in FIG. 4, by displaying the three-dimensional point cloud data P' on the transparent display unit 11, the operator can simultaneously visually recognize the pump P in the real space visible through the display unit 11 and the three-dimensional point cloud data P'. Note that the three-dimensional point cloud data and the tags displayed on the display unit 11 can also be arbitrarily switched to non-display. After the process of step S102 is performed, the process proceeds to step S103.

[0038] In step S103, the operator operates the HMD 10 to perform alignment (matching) between the real space and the three-dimensional point cloud data. For example, when the three-dimensional point cloud data is displayed on the display unit 11 in step S102, as shown in FIG. 4, it is assumed that the position of the pump P in the real space and the three-dimensional point cloud data P' of the pump P are misaligned. Therefore, in step S103, an operation is performed to align the positions of the two.

[0039] Specifically, the operator operates the HMD 10 to display a three-dimensional figure M as shown in FIG. 5 on the display unit 11. The three-dimensional figure M is composed of an arrow figure M1 indicating three mutually orthogonal directions (X direction, Y direction, and Z direction) and a spherical figure M2 with scales.

[0040] The three-dimensional figure M is for adjusting the position of the three-dimensional point cloud data displayed on the display unit 11. The operator can grasp and move (change the position in the X direction, Y direction, and Z direction, and rotation) the three-dimensional figure M on the display unit 11 by hand. When the three-dimensional figure M is moved, as shown in FIG. 6, the three-dimensional point cloud data also moves so as to follow the three-dimensional figure M. The operator moves the three-dimensional figure M so that the three-dimensional point cloud data and the real space coincide. For example, the operator can make the three-dimensional point cloud data and the real space coincide by moving the three-dimensional figure M so that the position of the pump P and the three-dimensional point cloud data P' of the pump P coincide, using the pump P as a landmark.

[0041] Although not shown in the figure, in addition to the three-dimensional figure M, it is also possible to display an operation menu (operation panel, numerical input unit, icon, etc.) for moving the three-dimensional point cloud data on the display unit 11. For example, precise alignment can be performed by enabling numerical input of the movement amount (displacement amount in the X, Y, and Z directions and rotation amount) of the three-dimensional point cloud data using the numerical input unit. Also, for example, the size of the three-dimensional point cloud data can be adjusted using an operation panel capable of changing the scale of the three-dimensional point cloud data.

[0042] For example, it is also possible to instantaneously move to an arbitrary location on the three-dimensional point cloud data (in other words, instantaneously display an arbitrary location on the three-dimensional point cloud data) using the operation panel. As a result, even for three-dimensional point cloud data of relatively large-scale equipment, alignment can be efficiently performed.

[0043] After aligning the real space and the three-dimensional point cloud data in step S103, when the operator performs a predetermined operation, the three-dimensional point cloud data on the display unit 11 is erased (changed to non-display). As a result, on the display unit 11, an image with tags attached to the inspection points in the real space (see FIG. 7) will be provided.

[0044] When the operator wearing the HMD 10 moves, the HMD 10 internally follows the movement of the operator and moves the three-dimensional point cloud data. Therefore, the real space and the position of the tag indicating the inspection point do not deviate. In this way, the HMD 10 provides a composite reality in which the real space and the three-dimensional point cloud data are combined. After the process of step S103 is performed, the process proceeds to step S104.

[0045] In step S104, the operator operates the HMD 10 to start the inspection work. For example, the operator uses the operation menu displayed on the display unit 11 of the HMD 10 to input to the HMD 10 that the inspection work is to be started. After the process of step S104 is performed, the process proceeds to step S105.

[0046] In step S105, the HMD 10 displays tags on the display unit 11 according to the inspection order stored in the inspection order database 24 of the management server 20. Specifically, the HMD 10 refers to the inspection order stored in the inspection order database 24 and displays only the tag corresponding to the earliest inspection item among them on the display unit 11, and makes the tags corresponding to other inspection items non-display. FIG. 7 shows an example in which only the tag T1 corresponding to the "discharge pressure", which has an earlier inspection order, among the two inspection items "discharge pressure" and "vibration" of the pump P is displayed.

[0047] Since the inspection points are thus indicated by tags, the operator can easily grasp the inspection points. With this function, for example, not only skilled operators but also operators who are not yet familiar with the inspection work can perform the inspection smoothly. Also, in the present embodiment, since only the tag with the earliest inspection order is displayed, the operator can easily grasp the inspection order (the inspection point to be inspected next). In addition to the tag, it is also possible to display an arrow or the like indicating the position of the tag on the display unit 11. Thereby, for example, even when the tag is displayed relatively far away (the position of the tag is difficult to grasp), the tag can be easily searched for and moved, and the work efficiency can be improved. After the process of step S105 is performed, the process proceeds to step S106.

[0048] In step S106, the operator inspects the inspection point and inputs the measured value using the HMD 10. Specifically, the operator inspects the inspection point indicated by the tag displayed on the display unit 11 in step S105. For example, in the example shown in FIG. 7, the operator measures the "discharge pressure" of the pump P using the instrument indicated by the tag T1. Then, the operator selects the tag T1 using the HMD 10 (for example, a touch operation in mixed reality). The HMD 10 communicates with the management server 20, calls the management ledger D corresponding to the inspection point indicated by the selected tag T1, and displays it on the display unit 11. Also, the HMD 10 displays a keyboard K used for inputting numerical values and the like on the display unit 11 together with the management ledger D. The operator operates the keyboard K displayed on the display unit 11 and inputs the measured value into the management ledger D. The measured value input into the management ledger D is transmitted to the management server 20 and stored in the management ledger database 22. Note that the measured value input into the management ledger D may be configured to be stored in the HMD 10 itself. When the input of the measured value is completed (confirmed), the operator inputs to that effect using the keyboard K.

[0049] In addition, if there is any abnormality regarding the input of the measurement value in step S106, it is also possible to notify the operator of the abnormality (such as error display). Examples of abnormalities include cases where the measurement value deviates from the standard value by a predetermined threshold or more, or cases where the inspection order is incorrect. After the measurement value in step S106 is input, the HMD 10 or the management server 20 determines whether there is an abnormality. If an abnormality is detected, an error display can be performed on the display unit 11 of the HMD 10 to notify the operator that there is an abnormality. In addition to the HMD 10, by performing an error display on the liquid crystal monitor of the management server 20, the administrator can also be notified of the abnormality at the same time. Note that the notification method is not particularly limited, and for example, it is also possible to perform notification by voice or the like. After the process of step S106 is performed, the process proceeds to step S107.

[0050] In step S107, the HMD 10 determines whether all the inspections of the equipment to be inspected this time have been completed. If there are uninspected inspection points, the process proceeds to step S105. In this way, the processes of step S105 and step S106 are repeated until all the inspections of the pre-scheduled inspection points are completed.

[0051] For example, in step S105 that has shifted from step S107, the HMD 10 causes the display unit 11 to display a tag corresponding to the next inspection item. As a result, as shown in FIG. 8, for example, a tag T2 indicating the next inspection item (inspection point) is displayed, and a tag T1 indicating that the inspection has been completed is made non-displayed. In the subsequent step S106, the operator performs an inspection on the inspection point indicated by the tag T2 and inputs the measurement value.

[0052] In this way, the processes of step S105 and step S106 are repeated until all the inspections of the pre-scheduled inspection points are completed. When all the inspections of the pre-scheduled inspection points are completed, the process proceeds from step S107 to step S108.

[0053] In step S108, the operator operates the HMD 10 to finish the inspection work. For example, the operator uses the operation menu displayed on the display unit 11 of the HMD 10 to input to the HMD 10 that the inspection work is to be finished. Thereby, the HMD 10 finishes the processes related to the inspection work (for example, communication with the management server 20, display of tags, etc.).

[0054] Note that when it is input in step S108 that the inspection work is to be finished and there is an inspection omission, it is also possible to notify that fact (error display, etc.). For example, after it is input in step S108 that the inspection work is to be finished, the HMD 10 or the management server 20 determines whether there is an inspection omission. When an inspection omission is found, an error display can be made on the display unit 11 of the HMD 10 to notify the operator that there is an inspection omission. When there is an inspection omission, for example, the process returns to step S105, and the HMD 10 can guide the location where the inspection omission occurred.

[0055] As described above, in this embodiment, by overlapping the three-dimensional point cloud data on the real space using the HMD 10, the inspection locations can be easily grasped. Thereby, not only skilled workers but also operators who are not accustomed to the inspection work can easily perform the inspection. Also, since the measured values can be directly input to the management server 20 (management ledger) using the HMD 10, for example, there is no need to transfer the measured values written on paper, improving the work efficiency and preventing transfer errors.

[0056] As described above, the facility inspection method according to this embodiment a matching step (step S103) in which the three-dimensional point cloud data of the facility to be inspected acquired in advance is displayed on the display unit 11 of the HMD 10 (head-mounted display) and the three-dimensional point cloud data is overlapped on the real space visually recognized through the display unit 11; a tag display step (step S105) in which a tag indicating an inspection location in the three-dimensional point cloud data is displayed on the display unit 11; An inspection step (step S106) in which the inspection point is inspected according to the tag is included. By configuring in this way, even when there are a large number of inspection target locations, the equipment can be suitably inspected. That is, since the inspection location can be grasped by the tag, not only skilled workers but also workers who are not used to the inspection work can perform the inspection work smoothly.

[0057] In addition, the equipment inspection method according to this embodiment In the inspection step (step S106), When the tag is selected, the management ledger D of the inspection location corresponding to the selected tag is displayed on the display unit 11, and the inspection result is input into the management ledger D. By configuring in this way, the inspection result (measurement value) can be easily recorded. In particular, in this embodiment, since the measurement value input by the operator using the HMD 10 is directly input into the management ledger database 22 of the management server 20, the posting work is unnecessary, and the work efficiency can be improved and the occurrence of posting errors can be prevented.

[0058] In addition, the equipment inspection method according to this embodiment In the matching step (step S103), After the alignment between the real space and the three-dimensional point cloud data is performed, the display of the three-dimensional point cloud data on the display unit 11 is erased. By configuring in this way, the real space becomes easier to recognize. Also, by making the three-dimensional point cloud data non-displayable, the processing load on the HMD 10 can be reduced.

[0059] In addition, the equipment inspection method according to this embodiment In the tag display step (step S105), The tag is displayed so as to be able to identify the inspection order and / or the presence or absence of inspection completion. By configuring in this way, it is possible to easily grasp the order of inspections and the presence or absence of completion.

[0060] In addition, the facility inspection method according to this embodiment In the tag display step (step S105), the tag is switched between display and non-display according to the order of inspections. By configuring in this way, the number of tags displayed on the display unit 11 can be reduced, and the visibility of the real space can be improved.

[0061] In addition, the facility inspection method according to this embodiment In the matching step (step S103), a three-dimensional figure M (operation image) for moving the three-dimensional point cloud data to the display unit 11 is displayed, and the three-dimensional point cloud data is moved to a position corresponding to the real space by the wearer (operator) of the HMD10 operating the three-dimensional figure M. By configuring in this way, since the operator can align the positions of the real space and the three-dimensional point cloud data while confirming the positions of both, the alignment can be performed efficiently.

[0062] In addition, the facility inspection system 1 according to this embodiment includes a storage unit (three-dimensional point cloud database 21 and tag database 23) that stores the three-dimensional point cloud data of the facility to be inspected acquired in advance and the inspection locations of the three-dimensional point cloud data, a display unit 11 provided on an HMD10 (head-mounted display) that can display the three-dimensional point cloud data and the inspection locations superimposed on the real space, and is configured to include. By configuring in this way, the facility can be suitably inspected. That is, since the inspection locations displayed on the display unit 11 can be grasped, not only skilled operators but also operators who are unfamiliar with the inspection work can perform the inspection work smoothly.

[0063] The above describes an embodiment of the present invention. However, the present invention is not limited to the above configuration, and various modifications are possible within the scope of the invention described in the claims. Hereinafter, modifications of the above embodiment will be described.

[0064] In the above embodiment, an example was shown in which the operator is made to identify the inspection order by switching the display and non-display of tags and displaying only the tags of the inspection points to be inspected next. However, the present invention is not limited to this, and the method of identifying the inspection order can be arbitrarily changed. For example, it is also possible to display the inspection order on the tags displayed at each inspection point by an appropriate method (for example, numbers, color coding, etc.).

[0065] Also, in the above embodiment, an example was shown in which the inspection order is identified by tags, but it is also possible to configure to be able to identify other information using tags. For example, by providing a difference (for example, a difference in color, a difference in display message, etc.) in the display between the tags of the inspection points where the inspection has been completed and the tags of the inspection points where the inspection has not been completed yet, it is also possible to configure to be able to identify the presence or absence of completion of the inspection (whether it has been inspected or not inspected).

[0066] Also, in the above embodiment, the predetermined inspection order is stored in the inspection order database 24, and the inspection is performed according to this inspection order. However, the inspection order stored in the inspection order database 24 can be determined by an arbitrary method. For example, it is also possible to configure to store the order of a series of inspections performed by the operator wearing the HMD 10 in the inspection order database 24 via the HMD 10, and to guide the inspection in this inspection order after the next inspection. According to such a configuration, for example, first, a skilled person performs the inspection in the correct (efficient) inspection order, and by using that order from the next time onwards, even an operator who is not familiar with the inspection work can perform the inspection work efficiently. Also, it is possible to configure to store a plurality of patterns of inspection orders in the inspection order database 24 and allow the operator to select the desired order.

[0067] In addition, in the above-described embodiment, one HMD 10 has been exemplified and described. However, for example, it is also possible to perform inspection work by a plurality of workers using a plurality of HMDs 10. For example, by storing in the inspection order database 24 the inspection order of each HMD 10 (each worker) when using a plurality of HMDs 10, it is possible to guide an appropriate inspection order for a plurality of workers. In this case, by storing the inspection order so that the inspection locations of a plurality of workers do not overlap with each other and there is no omission, the inspection work can be efficiently performed.

[0068] Also, when there is an abnormality in the measured value input in step S106 of the above-described embodiment (the measured value deviates from the standard value by a predetermined threshold or more), it is also possible to instruct the worker to preferentially perform the inspection of other inspection locations correlated with the inspection location. Here, the inspection locations being correlated means a state in which the measured values of a plurality of inspection locations are related to each other, and when an abnormality occurs in one, it is considered highly likely that an abnormality will also occur in the other. For example, in the management server 20, the inspection locations correlated with each other are associated and stored in advance. When an abnormality occurs in the measured value at any one of the inspection locations, an instruction is issued to prompt the worker to preferentially perform the inspection of other correlated inspection locations using the HMD 10. Thereby, it is possible to quickly confirm that an abnormality has occurred in a specific facility.

[0069] Furthermore, when there is an abnormality in the measured value, it is also possible to estimate the location causing the abnormality and notify it using the HMD 10 or the management server 20. For example, the cause of the abnormality at each inspection location can be estimated by using a cause investigation flowchart or the like prepared by the manufacturer of each facility. Therefore, when there is an abnormality in the measured value, the cause location can be quickly estimated using the cause investigation flowchart or the like, and the abnormality can be quickly resolved.

[0070] Also, when there is an abnormality in the measured value, it may be notified to that effect during inspections after the next time. For example, store the inspection location where there is an abnormality in the measured value in the management server 20, and during inspections after the next time, display a message indicating that there was an abnormality on the tag of the inspection location. By looking at the display of the tag, the operator can recognize that the inspection location is an important inspection location.

[0071] In the above-described embodiment, an example was shown in which an operator wearing the HMD 10 performs an inspection operation using mixed reality, but it may be configured so that the management server 20 can also simultaneously confirm the state of the inspection operation. For example, by displaying the mixed reality provided by the HMD 10 in real time on the liquid crystal monitor of the management server 20, related parties (such as managers) other than the operator can also confirm the state of the inspection operation. Also, by using the communication between the HMD 10 and the management server 20, it becomes possible to perform the inspection operation while consulting between the operator and the manager.

[0072] In the above-described embodiment, an example was shown in which an inspection operation is performed using the facility inspection system 1, but the usage method of the facility inspection system 1 is not limited to this. For example, it is also possible to use it to share various information between the person wearing the HMD 10 and the person operating the management server 20. For example, by sharing a three-dimensional virtual space (metaverse) configured using the three-dimensional point cloud data of the facility to be inspected stored in the three-dimensional point cloud database 21 with the person wearing the HMD 10 and the person operating the management server 20, it is possible to hold meetings regarding the inspection of the facility to be inspected, conduct training on inspection methods, etc. As a result, it is possible to intuitively grasp on-site information using three-dimensional point cloud data without actually going to the site.

[0073] In addition, in the above-described embodiment, an example in which the facility inspection system 1 includes the HMD 10 and the management server 20 has been shown. However, the present invention is not limited to this, and the configuration of the facility inspection system 1 can be arbitrarily changed. For example, it is also possible to incorporate the functions of the management server 20 into the HMD 10 and configure the facility inspection system 1 with the HMD 10 alone. Further, it is also possible to configure the management server 20 with a plurality of servers and distribute the functions of the management server 20 among the plurality of servers.

[0074] In addition, the facility inspection method (see FIG. 3) exemplified in the above-described embodiment is an example, and its content can be arbitrarily changed. For example, it is possible to arbitrarily change the order, omission, addition, etc. of the steps (processes) in the above-described embodiment.

Explanation of Reference Numerals

[0075] 1 Facility inspection system 10 Head-mounted display 11 Display unit 12 Sensor unit 20 Management server 21 Three-dimensional point cloud database 22 Management ledger database 23 Tag database 24 Inspection order database

Claims

1. Three-dimensional point cloud data of the entire building including the inspection target equipment acquired in advance is displayed on the display unit of the head-mounted display worn by the wearer, and the wearer moves and overlaps the three-dimensional point cloud data on an arbitrary real space corresponding to the three-dimensional point cloud data visually recognized by the wearer through the display unit, and after fixing the three-dimensional point cloud data to the real space, a matching step of erasing the display of the three-dimensional point cloud data on the display unit; A tag display step in which the head-mounted display displays a tag indicating an inspection location preset in the three-dimensional point cloud data on the display unit; An inspection step in which the wearer inspects the inspection location according to the tag; An equipment inspection method including the above.

2. In the inspection step, By the wearer selecting the tag, a management ledger of the inspection location corresponding to the selected tag is displayed on the display unit, and the wearer inputs an inspection result into the management ledger. The equipment inspection method according to Claim 1.

3. When it is determined that there is an abnormality in the inspection result input in the inspection step, the head-mounted display further includes a notification step of performing a notification for prompting the wearer to preferentially inspect other inspection locations associated with the inspection location with the abnormality. The equipment inspection method according to Claim 2.

4. In the tag display step, The tag is displayed so as to be able to identify the order of inspection and / or the presence or absence of inspection completion. The equipment inspection method according to Claim 1.

5. In the matching step, An operation image for moving the three-dimensional point cloud data is displayed on the display unit, and the three-dimensional point cloud data is moved to a position corresponding to the real space by the wearer operating the operation image. The equipment inspection method according to Claim 1.

6. A storage unit that stores three-dimensional point cloud data of the entire building including the inspection target equipment acquired in advance and inspection locations of the three-dimensional point cloud data; A display unit provided on the head-mounted display, capable of overlapping and displaying the three-dimensional point cloud data and the inspection location in the real space, and capable of moving the three-dimensional point cloud data, fixing the three-dimensional point cloud data to the real space, and erasing the display of the three-dimensional point cloud data; Comprising: The display unit is Capable of displaying a tag indicating an inspection location preset in the three-dimensional point cloud data. Equipment inspection system.

Images