Plant photo album creation system, plant photo album creation method and program

Abstract

To easily understand which plant equipment each photograph corresponds to in a plant photo album used in inspecting the plant equipment. [Solution] A plant photo album creation system that creates a plant photo album for inspecting plant equipment acquires a plant drawing of the plant equipment, places placement data at a predetermined position of the plant equipment shown in the plant drawing, associates a predetermined photo with the placement data, links attribute information of the photo to the photo, extracts a miniature diagram of the plant equipment from the plant drawing, places the miniature diagram in a miniature diagram area of ​​the plant photo album, associates the miniature diagram with the placement data, places a photo associated with the placement data associated with the miniature diagram in a photo area of ​​the plant photo album, and places the attribute information linked to the photo in an attribute information area of ​​the plant photo album.

Description

[Technical Field]

[0001] The present invention relates to a technique that is effective for inspecting plant equipment. [Background technology]

[0002] Technology that outputs images and other data for inspecting construction sites is attracting attention. For example, Patent Document 1 discloses a system that prompts a person to take evidence photographs at the scene while inputting the inspection results. Furthermore, Patent Document 2 discloses a technique for issuing instructions for improvement using photographs when problems are found during inspection of a construction site and instructions for improvement are required. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-277442 [Patent Document 2] Japanese Patent Application Publication No. 2023-154684 Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Documents 1 and 2 disclose a technique for utilizing photographs taken at a construction site as images to inspect check items of buildings and facilities using the images. On the other hand, when installing plant equipment and inspecting facilities, a plant photo album is used that records on-site photographs and links them to the inspection details. Therefore, there is a need for technology that makes it easy to understand which plant equipment a photograph in a plant photo book corresponds to. However, with the techniques described in Patent Documents 1 and 2, it is not possible to know at a glance which plant equipment a photograph in a plant photo album corresponds to. Therefore, the present inventors have focused on a system for linking information about plant equipment to photos when the photos are posted in a plant photo album.

[0005] In view of these problems, the present invention aims to provide a plant photo album creation system, a plant photo album creation method, and a program that make it easy to understand which plant equipment each photograph corresponds to in a plant photo album used for inspecting plant equipment. [Means for solving the problem]

[0006] The present invention provides a plant photo album creation system for creating a plant photo album for inspecting plant equipment, an acquisition unit that acquires a plant drawing of the plant equipment; By AI, preset placement positions, or input from the inspector, The predetermined positions of the plant equipment shown in the plant drawings and at the specified position, a placement data placement unit that places the placement data; The placement data includes: As detailed information of the placement data an association unit for associating predetermined photographs; a linking unit that links the attribute information of the photo to the photo; Through AI, pre-defined plant equipment drawings, or input from inspectors, A diagram of the plant equipment and from the plant drawing, a cutting section for cutting out the Through AI, pre-defined plant photo album bean plot areas, or input from the inspector, The plant photo album's miniature area and placing the map in the specified map area. A bean diagram placement unit to place the bean diagram; The bean diagram is added to the placement data. , as detailed information of the placement data an association unit for associating; Through AI, pre-defined photo areas in the plant photo book, or input from the inspector, Photo area of ​​the plant photo book and then, in the specified photo area, a photo associated with the placement data associated with the miniature image is placed. a photo placement unit for placing the photos; By AI, pre-defined attribute information fields in the plant photo book, or input from the inspector, Attribute information area of ​​the plant photo album and then, in the identified photo area, attribute information linked to the photo is an attribute information placement unit for placing the attribute information; The present invention provides a plant photo album creation system comprising:

[0007] According to the present invention, a plant photo album is created in which a miniature diagram is extracted from a plant drawing and photographs of plant equipment and attribute information of the photographs are arranged together with the miniature diagram. As a result, it becomes possible to easily understand which plant equipment each photograph corresponds to in a plant photo album used in inspecting the plant equipment.

[0008] Although the present invention is categorized as a system, the same effects and advantages can be obtained even when it is a method or a program. [Effects of the Invention]

[0009] According to the present invention, it is possible to easily understand which plant equipment each photograph corresponds to in a plant photo album used in inspecting plant equipment. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an overview of a plant photo album creation system 1. [Figure 2] FIG. 1 is a diagram showing a functional configuration of a plant photo album creation system 1. [Figure 3] FIG. 10 is a flowchart showing a placement data placement process executed by the computer 10. [Figure 4] 10 is a diagram schematically illustrating a state in which an inspector 2 has input an arrangement of arrangement data for a predetermined position of a plant device shown in a plant drawing displayed on an information terminal 3. FIG. [Figure 5] FIG. 10 is a diagram schematically illustrating a state in which the computer 10 has arranged placement data on a plant drawing. [Figure 6] FIG. 1 is a flowchart showing a photographic process executed by a computer 10. [Figure 7] FIG. 10 is a flowchart showing a plant photo album creation process executed by the computer 10. [Figure 8] FIG. 10 is a diagram showing a schematic diagram of a plant drawing cut out by the computer 10. [Figure 9]FIG. 2 is a diagram schematically illustrating a plant photo album created by the computer 10. [Figure 10] FIG. 10 is a flowchart showing an output process executed by the computer 10. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention (hereinafter referred to as "embodiments") will be described in detail with reference to the accompanying drawings. In the following drawings, the same elements are designated by the same numbers or symbols throughout the description of the embodiments.

[0012] [Outline of Plant Photo Album Creation System 1] 1 is a schematic diagram for explaining an overview of a plant photo album creation system 1. Components of the plant photo album creation system 1 will be described with reference to FIG. The plant photo album creation system 1 is a system for creating a plant photo album for inspecting plant equipment, and is made up of at least a computer 10 having server functionality. In this embodiment, the plant photo album creation system 1 includes, in addition to the computer 10, an information terminal 3 managed by an inspector 2 who inspects the plant equipment.

[0013] The information terminals 3 are terminal devices managed by the inspectors 2, and are, for example, terminal devices such as mobile phones, smartphones, tablet terminals, personal computers, and laptop computers, as well as wearable terminals such as smart watches, smart glasses, and HMDs (Head Mounted Displays). The number of information terminals 3 can be designed appropriately depending on the number of inspectors 2.

[0014] The computer 10 has a server function and may be realized, for example, by a single computer, or may be realized by multiple computers, such as a cloud computer. In this specification, a cloud computer may refer to either a computer that uses any computer in a scalable manner to perform a specific function, or a computer that includes multiple functional modules to realize a system and uses the functions in any combination.

[0015] In addition, the plant photo album creation system 1 may include external systems, other terminals and devices, etc. in addition to the information terminal 3 and computer 10 described above, and the number, type and functions thereof are not particularly limited and can be designed as appropriate.

[0016] An outline of the processing steps when the plant photo album creation system 1 creates a plant photo album for inspecting plant equipment will be described.

[0017] The computer 10 acquires a plant drawing of the plant equipment (step S1). The computer 10 acquires a plant drawing from the information terminal 3 or the like.

[0018] The computer 10 places the placement data at a predetermined position of the plant equipment shown in the plant drawing (step S2). The computer 10 displays a plant drawing on the information terminal 3. The information terminal 3 receives input from the inspector 2 of a predetermined position of the plant equipment shown in the displayed plant drawing, and transmits the received position to the computer 10. The computer 10 receives this position and places the placement data at the position where the input was accepted in the plant drawing based on the received position. The computer 10 may arrange the arrangement data based on AI (Artificial Intelligence), a preset position, or the like, without relying on input from the inspector 2.

[0019] The computer 10 associates the layout data with a predetermined photograph (step S3). The computer 10 acquires the photograph of the plant equipment taken by the information terminal 3 or the like. The computer 10 associates the acquired photograph with the layout data laid out on the plant drawing.

[0020] The computer 10 links the attribute information of the photo to the photo (step S4). The computer 10 receives, via the information terminal 3, input of attribute information of the photograph associated with the placement data. The computer 10 associates the received attribute information with the photograph. The computer 10 may associate the attribute information based on AI, preset content, or the like, without relying on input from the inspector 2.

[0021] The computer 10 extracts a miniature diagram of the plant equipment from the plant drawing (step S5). The computer 10 identifies the range of plant equipment present in the plant drawing based on AI, pre-set plant equipment drawings, input received from the inspector 2, etc., and cuts out the identified range as a miniature diagram of the plant equipment.

[0022] The computer 10 places the miniature drawings in the miniature drawing area of ​​the plant photo album (step S6). The computer 10 identifies the miniature diagram area in the plant photo album based on AI, a preset miniature diagram area in the plant photo album, and reception of input from the inspector 2, and places the cut-out miniature diagram in the identified miniature diagram area.

[0023] The computer 10 associates the miniature diagram with the placement data (step S7). The computer 10 identifies the placement data to be associated with the placed miniature diagram based on AI, pre-set placement data, and input received from the inspector 2, and associates the placed miniature diagram with the identified placement data.

[0024] The computer 10 places the photograph associated with the placement data associated with the miniature diagram in the photograph area of ​​the plant photo album (step S8). The computer 10 identifies a photo area in the plant photo album based on AI, a photo area in a pre-set plant photo album, input received from the inspector 2, etc., and places a photo associated with the placement data associated with the miniature diagram in the identified photo area.

[0025] The computer 10 arranges the attribute information linked to the photograph in the attribute information area of ​​the plant photo album (step S9). The computer 10 identifies the attribute information area of ​​the plant photo album based on AI, a pre-set attribute information area of ​​the plant photo album, and reception of input from the inspector 2, and places the attribute information linked to the placed photograph in the identified attribute information area.

[0026] The computer 10 arranges the miniature diagrams, photographs, and attribute information to create a plant photo album. The computer 10 outputs the created plant photo album to the information terminal 3, etc. In this plant photo album, photographs are associated with layout data in the plant drawing, and miniature drawings are also associated. Furthermore, in this plant photo album, attribute information is linked to the photographs associated with the layout data. Therefore, for example, when the information terminal 3 receives input for layout data of the plant drawing it displays, it can display the corresponding page or location of the plant photo album that is associated with and related to the layout data.

[0027] The above is an overview of the plant photo album creation system 1. According to the plant photo album creation system 1, it becomes possible to easily understand which plant equipment each photograph corresponds to in a plant photo album used for inspecting the plant equipment.

[0028] [Device configuration] 2 is a block diagram showing the configuration of the plant photo album creation system 1. The device configuration of the plant photo album creation system 1 will be described with reference to FIG. The plant photo album creation system 1 is a system for creating a plant photo album for inspecting plant equipment, and is configured with at least a computer 10. In this embodiment, the plant photo album creation system 1 is configured with an information terminal 3 in addition to the computer 10, as described above. The plant photo album creation system 1 is a system in which a computer 10 is connected to an information terminal 3 via a network 8 such as a public line network so as to be capable of data communication. The plant photo album creation system 1 may include external systems, other terminals, devices, etc. in addition to the information terminals 3 and the computer 10, and the number, types, and functions thereof can be designed as appropriate. The number of information terminals 3 can be designed as appropriate depending on the number of inspectors 2.

[0029] The information terminal 3 is the above-mentioned terminal device managed by the inspector 2 who inspects the plant equipment. The information terminal 3 has a CPU (Central Processing Unit), GPU (Graphics Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), etc. as a terminal control unit, and has devices, etc. that enable communication with other terminals, devices, etc. as a communication unit. The information terminal 3 includes, as an input / output unit, various devices for receiving predetermined inputs and executing input / output of various data.

[0030] The computer 10 has a server function and may be realized, for example, by a single computer, or may be realized by multiple computers, such as a cloud computer. The computer 10 includes a control unit such as a CPU, GPU, RAM, ROM, etc., and a communication unit such as a device that enables communication with other terminals and devices, and an acquisition unit that acquires plant drawings of plant equipment. The computer 10 includes a storage unit such as a hard disk, semiconductor memory, recording medium, or data storage unit such as a memory card. The computer 10 includes, as processing units, various devices for executing various processes, a placement data placement unit for placing placement data at a predetermined position of plant equipment shown in a plant drawing, a correspondence unit for associating a predetermined photograph with the placement data, a linking unit for linking attribute information of the photograph to the photograph, an extraction unit for extracting a miniature diagram of the plant equipment from the plant drawing, a miniature diagram placement unit for placing the miniature diagram in a miniature diagram area of ​​the plant photo book, an association unit for associating the miniature diagram with placement data, a photo placement unit for placing a photograph associated with the placement data associated with the miniature diagram in a photo area of ​​the plant photo book, and an attribute information placement unit for placing attribute information linked to the photograph in the attribute information area of ​​the plant photo book.

[0031] In the computer 10, the control unit loads a predetermined program and, in cooperation with the communication unit, realizes a drawing acquisition module, a placement data reception module, a photo acquisition module, an attribute information reception module, a preview module, an edit / non-edit reception module, and an output module. In addition, in the computer 10, the control unit reads a predetermined program, thereby realizing a storage module in cooperation with the storage unit. In addition, in computer 10, the control unit reads a specified program and works in cooperation with the processing unit to realize a placement data placement module, a correspondence module, a linking module, a cut-out module, a bean diagram placement module, an association module, a photo placement module, an attribute information placement module, a judgment module, and an editing module.

[0032] Hereinafter, each process executed by the plant photo album creation system 1 will be described together with the process executed by each of the modules described above. In this specification, each module may execute its processing content as its own function, or may execute its processing content via a predetermined application.

[0033] [Placement data placement process executed by computer 10] The placement data placement process executed by the computer 10 will be described with reference to Fig. 3. The figure is a flowchart of the placement data placement process executed by the computer 10. The placement data placement process shows details of an acquisition process (step S1) for acquiring a plant diagram of a plant device, and a placement data placement process (step S2) for placing placement data at a predetermined position of the plant device shown in the plant diagram.

[0034] The drawing acquisition module acquires a plant drawing of the plant equipment (step S10). The plant drawing is a drawing of the plant including the plant equipment that inspector 2 will inspect. The drawing acquisition module acquires a plant drawing from an information terminal 3 or the like. The information terminal 3 receives a selection input such as a tap from the inspector 2 for the plant drawing of the plant equipment to be inspected from among the plant drawings stored in advance by the inspector 2, and transmits the received plant drawing to the computer 10. The drawing acquisition module receives the plant drawing and acquires the plant drawing of the plant equipment. The drawing acquisition module may execute the process described below using a plant drawing stored in advance by itself, rather than acquiring the plant drawing from the information terminal 3. In this case, the drawing acquisition module may display a list of plant drawings stored in itself on the information terminal 3, receive selection input from the inspector 2 on this list, identify the plant drawing to be used this time, and acquire the identified plant drawing. The drawing acquisition module may also acquire the plant drawing by other methods (such as acquisition from an external system).

[0035] The placement data receiving module receives placement data for placement at a predetermined position of the plant equipment shown in the plant drawing (step S11). The placement data is predetermined data to be placed on a plant drawing, such as an icon, a leader line, or an arrow. In this embodiment, the placement data will be described as an example of an icon. It goes without saying that the present invention is also applicable to cases where the placement data is other than an icon. In cases where the placement data is other than an icon, for example, when the placement data has a start point and an end point, such as a leader line or an arrow, the process described below only requires that the start point and end point be input in addition to the input of any point. The placement data reception module transmits the acquired plant drawing to the information terminal 3, and causes the acquired plant drawing to be displayed on the information terminal 3. The information terminal 3 receives an input operation such as a tap on a predetermined position of the plant equipment shown in the displayed plant drawing, and receives input of the placement position of the placement data (see FIG. 4). The information terminal 3 may also accept input of the type of placement data when accepting input of the placement position of the placement data. For example, the information terminal 3 may accept input of the type of placement data (icon, leader line, arrow, etc.) before or after accepting input of the placement position of the placement data.

[0036] 4, a state in which the placement data receiving module receives placement data will be described. The figure is a diagram that schematically shows a state in which an inspector 2 has received input of placement data for a predetermined position of plant equipment shown in a plant diagram displayed on the information terminal 3. The figure shows a state in which the information terminal 3 displays a plant diagram 20. The inspector 2 inputs the desired placement position of the placement data by tapping or the like. FIG. 4 shows a state in which the inspector 2 taps on placement position 22 as a predetermined position (nearby, around, above, etc.) of the plant equipment 21 shown in the plant drawing 20. The information terminal 3 transmits the coordinates of this placement position 22 to the computer 10 as the placement position of the placement data. For example, the information terminal 3 sets a predetermined point on the plant drawing 20 as the origin, and sets the coordinates of the point input by the inspector 2 corresponding to this origin as the coordinates of the placement position 22. The information terminal 3 transmits the coordinates of the placement position 22 to the computer 10. At this time, if the information terminal 3 has received input of the type of placement data, it also transmits this type of placement data to the computer 10. The placement data receiving module receives the coordinates and receives the placement of the placement data at the predetermined position of the plant equipment 21 shown in the plant drawing 20. If the information terminal 3 transmits the type of placement data, the placement data receiving module receives this type and also receives the type of placement data.

[0037] Returning to FIG. 3, the rest of the placement data placement process will be explained. The placement data placement module places the placement data at a predetermined position of the plant equipment shown in the plant drawing (step S12). The placement data placement module places the placement data at the placement position 22 of the received placement data (see FIG. 5). The placement data placement module identifies the placement position 22 of the placement data in the plant drawing 20 based on the coordinates of the received placement position 22, and places the placement data at the identified placement position 22. At this time, if the type of placement data has been received, the placement data according to this type is placed. In this embodiment, as described above, the placement data is an icon, so the placement data placement module places the icon at the placement position of the placement data.

[0038] The placement data placed by the placement data placement module will be described with reference to Fig. 5. This figure is a diagram schematically showing a state in which the placement data placement module has placed the placement data on a plant drawing. The placement data placement module places an icon 23 as placement data at a predetermined position (accepted placement position 22) of the plant device 21 in the plant drawing 20. The placement data placement module places the icon 23 at a position based on the coordinates of the placement position 22 received in FIG.

[0039] When placing the placement data on the plant drawing, the computer 10 may determine the placement position and place the placement data at the determined placement position without relying on input from the inspector 2. When the computer 10 does not rely on input from the inspector 2, it may omit the processing of step S11. In this case, the computer 10 may determine the placement position using AI, may determine the placement position based on a preset placement position, or may determine the placement position by some other method. When AI is used, for example, the computer 10 may determine the placement position of the placement data (which may include the type of placement data) using a learning model or the like that has previously learned the plant equipment in the plant drawing and the placement positions of the placement data. Furthermore, in the case of a preset placement position, the position of the plant equipment in the plant drawing and the placement position of the placement data (which may include the type of placement data) may be set in advance, and this set placement position may be determined as the placement position of the placement data. Similarly, in the case of other methods, the placement position of the placement data may be determined appropriately. Note that, in these cases, the type of placement data may also be determined. The placement data placement module simply places the placement data based on the determined placement position.

[0040] The above is the placement data placement process.

[0041] [Photo processing performed by computer 10] The photo processing executed by the computer 10 will be described with reference to Fig. 6. This figure is a flowchart of the photo processing executed by the computer 10. The photo processing includes details of a photo association process (step S3) that associates a predetermined photo with placement data, and a linking process (step S4) that links attribute information of the photo to the photo.

[0042] The photo acquisition module acquires a predetermined photo to be associated with the placement data (step S20). The predetermined photograph is a photograph of actual plant equipment corresponding to the plant equipment in the plant drawing in which the placement data is arranged. This photograph may include a blackboard on which the photographing situation is described. Including a blackboard in the photograph may mean that when photographing the plant equipment, an actual blackboard is placed around the plant equipment and a photograph is taken, or may mean that a virtual blackboard (electronic small blackboard) is superimposed on a photograph of the plant equipment. The photo acquisition module acquires photos of plant equipment from the information terminal 3 or the like. The information terminal 3 receives a selection input, such as a tap, from the inspector 2 on a photo of the plant equipment that is to be associated with the placement data, and transmits the received photo to the computer 10. Alternatively, the information terminal 3 starts a photography application or the like, receives an input from the inspector 2 regarding photographing the plant equipment, photographs the plant equipment, and transmits the photograph to the computer 10. The photo acquisition module receives the photo and acquires a predetermined photo to be associated with the placement data. The number of photos acquired by the photo acquisition module is not particularly limited. Furthermore, the photo acquisition module may execute the process described below using photos stored in advance by itself, rather than acquiring photos from the information terminal 3. In this case, the photo acquisition module may display a list of photos stored in itself on the information terminal 3, accept selection input from the list from the inspector 2, identify the photo to be used this time, and acquire the identified photo. The photo acquisition module may also acquire photos by other methods.

[0043] The association module associates a predetermined photograph with the placement data (step S21). The association module associates the acquired photograph with the placement data arranged on the plant drawing. In the case of Figure 5, the association module associates the acquired photograph with an icon 23 arranged at a predetermined position of plant equipment 21 on the plant drawing 20. If multiple photographs have been acquired, the association module associates the multiple photographs with the icon 23.

[0044] The attribute information receiving module receives input of attribute information of the photo (step S22). The attribute information is information about the plant equipment shown in the photograph, such as the name, model, type, manufacturer, and installation location. Furthermore, this attribute information includes a link to a digital form. A digital form is an electronic form that is prepared separately from the plant photo album. A link means that the plant photo album is associated with the attribute information, such as a specified tag. Including a link means, for example, that a specified tag is included as attribute information. The attribute information receiving module transmits input data for the acquired attribute information of the photo to the information terminal 3. This input data includes an input form for the attribute information, a photo for inputting the attribute information, and the like. The information terminal 3 receives this input data and displays it via a predetermined UI (User Interface). The information terminal 3 accepts direct input of text into the displayed input form, etc., and selection input into options, etc. from the inspector 2. The information terminal 3 accepts input of attribute information of the photo, for example, by accepting direct input of text regarding the name, type, installation location, etc. via a virtual keyboard, etc., and accepting selection input such as tapping on each option for the name, type, installation location, etc. The information terminal 3 transmits the received attribute information to the computer 10. The attribute information receiving module receives this attribute information and accepts the attribute information of the photo.

[0045] The linking module links the attribute information to the photo (step S23). The linking module links the attribute information of the received photo to this photo. As a result, the linking module also links the attribute information to the placement data associated with the photo to which the attribute information is linked. In the case of Fig. 5, the linking module links the attribute information to the photo associated with the icon 23 placed at a predetermined position of the plant equipment 21 in the plant drawing 20.

[0046] Note that when linking attribute information to a photograph, the computer 10 may link the attribute information to the photograph without relying on input from the inspector 2. If the computer 10 does not rely on input from the inspector 2, it may omit the processing of step S22. In this case, the computer 10 may use AI to link the attribute information to the photograph, may link pre-set attribute information to the photograph, or may link the attribute information to the photograph by some other method. When using AI, for example, the computer 10 may determine attribute information for the acquired photograph using a learning model that has previously learned photos of plant equipment and attribute information of the plant equipment, and then link the determined attribute information to the acquired photograph. Alternatively, when the attribute information is preset, the plant equipment photo and attribute information may be set in advance, and the attribute information set for the acquired photograph may be linked to the acquired photograph. Similarly, when using other methods, attribute information may be linked to the photograph as appropriate.

[0047] This is the photo processing.

[0048] [Plant photo album creation process executed by computer 10] The plant photo album creation process executed by the computer 10 will be described with reference to Fig. 7. This figure is a diagram showing a flowchart of the plant photo album creation process executed by the computer 10. The plant photo album creation process includes details of an extraction process (step S5) for extracting a miniature diagram of plant equipment from a plant drawing, a miniature diagram placement process (step S6) for arranging the miniature diagram in a miniature diagram area of ​​the plant photo album, an association process (step S7) for associating the miniature diagram with placement data, a photo placement process (step S8) for arranging a photo associated with the placement data associated with the miniature diagram in a photo area of ​​the plant photo album, and an attribute information placement process (step S9) for arranging attribute information linked to the photo in an attribute information area of ​​the plant photo album.

[0049] The extraction module extracts a miniature diagram of the plant equipment from the plant drawing (step S30). The miniature drawings are drawings that provide additional explanations of the plant equipment shown in the acquired photographs. The extraction module identifies the extraction range of the plant equipment present in the plant drawing based on AI, pre-set plant equipment drawings, and input received from inspector 2, and extracts the identified extraction range as a miniature diagram of the plant equipment (see Figure 8). The method by which the cutout module cuts out the miniature diagram is not limited to the example described above, and can be designed as appropriate.

[0050] We will explain how the extraction module extracts small diagrams using AI. The cut-out module uses a learning model that has learned from drawings of plant equipment to identify the cut-out range of the plant equipment shown in the acquired plant drawing, and cuts out the identified cut-out range of the plant equipment as a miniature diagram.

[0051] A case where the cutting module cuts out a miniature diagram using a preset drawing of a plant device will be described. The cutout module refers to a preset drawing of the plant equipment, identifies the cutout range of the plant equipment shown in the acquired plant drawing, and cuts out the identified cutout range of the plant equipment as a miniature diagram.

[0052] A case where the cutting module cuts out a miniature diagram using input from the inspector 2 will be described. The computer 10 transmits the acquired plant drawing to the information terminal 3. The information terminal 3 receives this plant drawing and displays it via a predetermined UI. The information terminal 3 accepts input of an extraction range to be extracted from the plant drawing as a miniature diagram from the inspector 2. The information terminal 3 accepts this input, for example, by surrounding a predetermined range of the plant drawing with a predetermined shape (rectangle, circle, etc.). The information terminal 3 transmits the accepted cut-out range to the computer 10. The computer 10 receives this cutout range. The cutout module cuts out the range of the plant drawing that corresponds to the received cutout range as a miniature diagram.

[0053] The state in which the cutout module cuts out a miniature diagram will be described with reference to Fig. 8. This figure is a diagram that schematically shows the state in which the cutout module cuts out a miniature diagram from a plant diagram. The plant diagram 20 is the same as that shown in Fig. 5 above. The cutout module specifies a cutout range 24 based on AI, preset plant equipment drawings, input from the inspector 2, etc. The cutout module cuts out a miniature diagram 25 from the plant drawing 20 based on the specified cutout range 24. This miniature diagram 25 may cut out only the plant equipment 21 shown on the plant drawing 20, or may cut out the plant equipment 21 and its surroundings in addition to the plant equipment 21.

[0054] Returning to FIG. 7, the rest of the plant photo album creation process will be explained. The miniature diagram arrangement module arranges the miniature diagram in the miniature diagram area of ​​the plant photo album (step S31). The miniature diagram area is an area in the plant photo album where miniature diagrams are placed. The bean diagram placement module identifies a bean diagram area in the plant photo album based on AI, a pre-set bean diagram area in the plant photo album, and reception of input from inspector 2, and places the bean diagram in the identified bean diagram area. The method by which the miniature diagram placement module places miniature diagrams in the miniature diagram area of ​​the plant photo album is not limited to the example described above, and can be designed as appropriate.

[0055] This section explains how the miniature diagram placement module uses AI to place miniature diagrams in the miniature diagram area of ​​a plant photo album. The miniature diagram placement module uses a learning model that has learned about the miniature diagram areas in the plant photo album to identify the miniature diagram area in the plant photo album where the cut-out miniature diagram will be placed, and places the cut-out miniature diagram in the identified miniature diagram area.

[0056] A case will be described in which the miniature diagram arrangement module arranges miniature diagrams in the miniature diagram area of ​​the plant photo album using a preset miniature diagram area of ​​the plant photo album. The miniature diagram placement module refers to a miniature diagram area in a pre-set plant photo album, identifies a miniature diagram area in the plant photo album in which to place the cut-out miniature diagram, and places the cut-out miniature diagram in the identified miniature diagram area.

[0057] A case will be described in which the miniature diagram placement module uses input from inspector 2 to place miniature diagrams in the miniature diagram area of ​​the plant photo album. The computer 10 transmits the plant photo album to the information terminal 3. In this case, the plant photo album may be blank, or may have some information written in it. The information terminal 3 receives this plant photo album and displays it via a predetermined UI. The information terminal 3 accepts input of a miniature diagram area in which to place the miniature diagram in the plant photo album from the inspector 2. The information terminal 3 accepts this input, for example, by inputting an arbitrary point that surrounds a predetermined area in the plant photo album with a predetermined shape (rectangle, circle, etc.). The information terminal 3 transmits the received miniature area to the computer 10. The computer 10 receives this miniature diagram area. The miniature diagram arrangement module arranges the cut-out miniature diagram in an area of ​​the plant photo album that corresponds to the received miniature diagram area.

[0058] The association module associates the miniature diagram with the placement data (step S32). The association module associates the miniature drawings cut out from the plant drawings and arranged in the plant photo album with the placement data arranged on the plant drawings. The association module associates the miniature drawings with the placement data based on AI, preset placement data, input received from Inspector 2, etc. The method by which the association module associates the miniature diagram with the placement data is not limited to the example described above, and can be designed as appropriate. As a result, the association module associates the attribute information with the plant diagram and also associates the miniature diagram cut out from the plant diagram with the placement data associated with the photo to which the attribute information is linked. In the case of Figures 5 and 8, the miniature diagram 25 cut out from the plant diagram 20 and placed in the plant photo album is associated with the icon 23.

[0059] We will explain the case where the association module uses AI to associate a miniature diagram with placement data. The association module uses a learning model that has learned about the cut-out bean diagram and the placement data placed in the vicinity (surrounding, above, etc.) of the area where the bean diagram is cut out to identify the placement data placed in the plant drawing to which the cut-out bean diagram is associated, and associates the cut-out bean diagram with the identified placement data.

[0060] A case will be described in which the association module uses preset placement data to associate a miniature diagram with placement data. The association module identifies placement data that has been placed in advance in the vicinity (surrounding, above, etc.) of the area from which the miniature figure is cut out as pre-set placement data, and associates the cut-out miniature figure with the identified placement data.

[0061] A case will be described in which the association module uses input from inspector 2 to associate the miniature diagram with placement data. The computer 10 transmits the plant drawing on which the placement data is placed to the information terminal 3. The information terminal 3 receives the plant diagram and displays it via a predetermined UI. The information terminal 3 accepts input of placement data to associate the extracted miniature diagram from the inspector 2. The information terminal 3 accepts this input, for example, by tapping on the placement data. The information terminal 3 transmits the received placement data to the computer 10. The computer 10 receives this placement data. The association module associates the extracted miniature diagram with the placement data that has been placed on the plant drawing corresponding to the received placement data.

[0062] The photo arrangement module arranges the photos associated with the arrangement data associated with the miniature diagram in the photo area of ​​the plant photo album (step S33). The photo area is an area in the plant photo album where photos are placed. The photo placement module identifies a photo area in the plant photo book based on AI, a pre-set photo area in the plant photo book, and input received from inspector 2, and places a photo associated with placement data associated with the miniature diagram in the identified photo area. The method by which the photo placement module places photos associated with placement data associated with the miniature diagram in the photo area of ​​the plant photo book is not limited to the example described above, and can be designed as appropriate.

[0063] We will explain the case where the photo placement module uses AI to place photos associated with placement data associated with a miniature diagram in the photo area of ​​a plant photo book. The photo placement module uses a learning model or the like that has learned the photo areas in the plant photo book to identify the photo areas in the plant photo book where the photos associated with the placement data associated with the miniature diagram should be placed, and places the photos associated with the placement data associated with the miniature diagram in the identified photo area.

[0064] A case will be described in which the photo placement module uses a photo area in a plant photo album that has been set up in advance to place a photo associated with placement data associated with a miniature diagram in the photo area in the plant photo album. The photo placement module refers to a photo area in a pre-set plant photo album, identifies a photo area in the plant photo album in which to place a photo associated with placement data associated with the miniature diagram, and places the photo associated with the placement data associated with the miniature diagram in the identified photo area.

[0065] A case will be described in which the photo placement module uses input from the inspector 2 to place a photo associated with placement data associated with a miniature diagram in the photo area of ​​the plant photo album. The computer 10 transmits the plant photo album to the information terminal 3. In this case, the plant photo album may be blank, or may contain some information (such as a diagram of the layout). The information terminal 3 receives this plant photo album and displays it via a predetermined UI. The information terminal 3 accepts input from the inspector 2 of a photo area in which to place a photo associated with placement data associated with the miniature diagram in the plant photo album. The information terminal 3 accepts this input, for example, by inputting an arbitrary point that surrounds a predetermined area in the plant photo album with a predetermined shape (rectangle, circle, etc.). The information terminal 3 transmits the accepted photograph area to the computer 10. The computer 10 receives this photo area. The photo arrangement module arranges the photo associated with the arrangement data associated with the miniature diagram in the area of ​​the plant photo album that corresponds to the received photo area.

[0066] The attribute information arrangement module arranges the attribute information linked to the photograph in the attribute information area of ​​the plant photo album (step S34). The attribute information area is an area in the plant photo album where attribute information is arranged. The attribute information placement module identifies the attribute information area of ​​the plant photo album based on AI, a pre-set attribute information area of ​​the plant photo album, and input received from inspector 2, and places the attribute information linked to the photo placed in the photo area in the identified attribute information area. The method by which the attribute information placement module places attribute information linked to photographs placed in the photograph area in the attribute information area of ​​the plant photo album is not limited to the example described above, and can be designed as appropriate.

[0067] This section explains how the attribute information placement module uses AI to place attribute information linked to a photo in the attribute information area of ​​a plant photo album. The attribute information placement module uses a learning model that has learned the attribute information area of ​​the plant photo album to identify the attribute information photo area of ​​the plant photo album in which to place the attribute information linked to the photo placed in the photo area, and places the attribute information linked to the photo placed in the photo area in the identified attribute information area.

[0068] The following describes a case where the attribute information placement module uses a preset attribute information area of ​​a plant photo album to place attribute information linked to a photo placed in the photo area in the attribute information area of ​​the plant photo album. The attribute information placement module refers to the attribute information area of ​​a preset plant photo album, identifies the attribute information area of ​​the plant photo album in which to place the attribute information linked to the photograph placed in the photograph area, and places the attribute information linked to the photograph placed in the photograph area in the identified attribute information area.

[0069] A case will be described in which the attribute information placement module places attribute information linked to a photograph placed in the photograph area in the attribute information area of ​​the plant photo album using input from the inspector 2. The computer 10 transmits the plant photo album to the information terminal 3. In this case, the plant photo album may be blank, or may contain some information (such as a diagram of the layout, photos, etc.). The information terminal 3 receives this plant photo album and displays it via a predetermined UI. The information terminal 3 accepts input from the inspector 2 of an attribute information area in the plant photo album in which attribute information linked to the photos arranged in the photo area is arranged. The information terminal 3 accepts this input, for example, by inputting an arbitrary point that surrounds a predetermined area in the plant photo album with a predetermined shape (rectangle, circle, etc.). The information terminal 3 transmits the accepted attribute information area to the computer 10. The computer 10 receives this attribute information area. The attribute information placement module places the attribute information linked to the photo placed in the photo area in the area of ​​the plant photo album corresponding to the received attribute information area.

[0070] The above is the process for creating a plant photo album. The computer 10 arranges the miniature diagrams, photographs, and attribute information in a plant photo album to create a plant photo album (see FIG. 9). The computer 10 uses the plant photo album created in this way to execute the processing described below.

[0071] A plant photo album created by the computer 10 will be described with reference to Fig. 9. This figure is a diagram schematically showing a plant photo album created by the computer 10. In this figure, a plant photo album 30 is shown. The plant photo album 30 has a miniature diagram area 31 in which a miniature diagram 25 is placed by processing in step S31, a photo area 32 (32a, 32b) in which a photo associated with an icon 23 associated with the miniature diagram 25 is placed by processing in step S33, and an attribute information area 33 (33a, 33b) in which attribute information linked to the photo placed in the photo area 32 is placed by processing in step S34. The miniature diagram area 31 is a position determined by the processing of step S31, the photo area 32 is a position determined by the processing of step S33, and the attribute information area 33 is a position determined by the processing of step S34. The computer 10 outputs this plant photo album 30 to the information terminal 3. When the information terminal 3 receives an input such as a tap from the inspector 2 on an icon 23 present on the plant drawing 20, the computer 10 causes the information terminal 3 to display the page or relevant portion of the plant photo album 30 on which the photograph associated with this icon 23, the miniature diagram associated with this icon 23, and the attribute information linked to this photograph are arranged. Furthermore, when the computer 10 receives input from the information terminal 3 for a link to a digital form included in the attribute information in the plant photo album 30 to be output, the computer 10 outputs the linked digital form to the information terminal 3. In this case, the computer 10 transmits the linked digital form to the information terminal 3, displays it, and outputs this digital form to the information terminal 3.

[0072] [Output processing performed by computer 10] The output processing executed by the computer 10 will be described with reference to Fig. 10. The figure shows a flowchart of the output processing executed by the computer 10.

[0073] The preview module outputs a preview of the plant photo album (step S40). The preview is a process in which the computer 10 simulates the results of the plant photo album created by the plant photo album creation process and outputs the simulated results on the screen of the information terminal 3 before actually outputting the plant photo album. The preview module transmits a preview of the plant photo album created as a result of the plant photo album creation process to the information terminal 3. The information terminal 3 receives the preview of the plant photo album and displays the preview of the plant photo album via a predetermined UI. The preview module outputs a preview of the plant photo album by displaying a preview of the plant photo album created as a result of the plant photo album creation process on the information terminal 3. In the case of FIG. 9, the preview module outputs a preview of the plant photo album 30 by transmitting the preview of the plant photo album 30 to the information terminal 3 and displaying it.

[0074] The edit / non-edit reception module receives information on whether or not the plant photo album has been edited (step S41). The information terminal 3 accepts inputs such as input of a predetermined icon, change of the arrangement of each area, change of the input content of each area, etc. for the displayed preview of the plant photo album 30. For example, if editing is not required, the information terminal 3 accepts input such as tapping on an icon indicating that editing is not required from the inspector 2. Furthermore, for example, if changing the arrangement of each area, the information terminal 3 accepts input such as tapping or dragging on the area to be changed from the inspector 2 (e.g., dragging an area when changing the arrangement of an area). Furthermore, for example, if changing the content of each area, the information terminal 3 accepts input on the content to be changed (e.g., input into a predetermined input form for changing each content) from the inspector 2. The information terminal 3 transmits the received input content to the computer 10 as edited data. The edit / non-edit reception module receives this edit data and receives whether or not the plant photo album has been edited.

[0075] The determination module determines whether or not editing has occurred (step S42). The determination module makes this determination based on whether or not a predetermined icon has been input in the received edited data, whether or not there has been a change to the area, whether or not there has been a change to the content of the area, and so on.

[0076] If the determination module determines that editing has been performed (YES in step S42), the editing module edits at least one of the miniature diagram, the photo, and the attribute information while the preview is being output (step S43). The editing module edits the plant photo album based on the received editing data. The editing performed by the editing module includes rearranging, deleting, changing, etc., at least one of the miniature diagrams, photos, and attribute information. When a change to an area is accepted, the editing module changes the layout position of the area. For example, when the editing module accepts a change to the layout position of the miniature area, it changes the layout position of the miniature area to the changed layout position. Furthermore, when the editing module accepts a change to swap the layout positions of the miniature area and the photo area, it swaps the layout positions of the miniature area and the photo area. When a change to the content of an area is accepted, the editing module changes the content of the area. For example, when the editing module accepts a change to the content of the attribute information area, it changes the content of the attribute information area to the content of the changed attribute information. Furthermore, when the editing module accepts a change to a miniature diagram or photo, it changes the placed miniature diagram or photo to the changed miniature diagram or photo.

[0077] The computer 10 repeats the processes of steps S41 to S43 until the inspector 2 completes the editing, and when the editing is completed, executes the process of step S44, which will be described later. Completion of editing may be determined, for example, in the process of step S42, by the information terminal 3 receiving an input such as a tap on an icon indicating that editing is not required, and the editing presence / absence receiving module receiving this edited data, etc.

[0078] If the determination module determines that no editing has been performed (NO in step S42), the output module outputs the plant photo album (step S44). The output module may output the created plant photo album in a predetermined data format (document data, spreadsheet data, presentation data, PDF (Portable Document Format) data, CSV (Comma Separated Values) data, etc.), or may output to a printing device or external recording device connected to the computer 10 so that data communication is possible, or may output to the information terminal 3. When the output module outputs the plant photo album in a predetermined data format, the computer 10 converts the plant photo album into a preset data format or a data format accepted by the inspector 2. The conversion method is not particularly limited, and any known data conversion method may be used. The output module may store the converted plant photo album in a storage module, transmit it to the information terminal 3, print it on a printer, or store it in an external recording device. When the output module outputs to a printing device, the computer 10 may be configured to cause the printing device to print the plant photo album. The output module transmits the plant photo album and a command to print the plant photo album to the printing device. The printing device receives the plant photo album and the command and prints the plant photo album in accordance with the command. When the output module outputs to an external recording device, the computer 10 may store the plant photo album in the external recording device. The output module transmits the plant photo album and a command to store the plant photo album to the external recording device. The external recording device receives the plant photo album and the command and stores the plant photo album in accordance with the command. When the output module outputs the plant photo album to the information terminal 3, the computer 10 transmits the plant photo album to the information terminal 3. The information terminal 3 receives the plant photo album and displays the plant photo album via a predetermined UI. The output module may transmit the plant photo album to the information terminal 3 and display it. When the output module outputs the plant photo album, it may be based on input for the placement data placed on the plant drawing, or it may be based on other input. The output module performs this process for all pages of the plant photo book.

[0079] This completes the output process.

[0080] Although the above-described processes are described as separate processes, the computer 10 can be configured to execute a combination of some or all of the above-described processes. Also, the computer 10 can be configured to execute each process at a timing other than the timing described. Furthermore, although each of the above-mentioned processes is described as a process executed by the computer 10, it is also possible to configure some or all of them to be executed by the information terminal 3, or to configure them to be executed by a specified application installed on the information terminal 3.

[0081] The above-described means and functions are realized by a computer (including a CPU, an information processing device, and various terminals) reading and executing a predetermined program. The program may be provided, for example, from a computer via a network (Software as a Service (SaaS)) or as a cloud service. The program may also be provided in a form recorded on a computer-readable recording medium. In this case, the computer reads the program from the recording medium, transfers it to an internal or external recording device, records it, and executes it. The program may also be pre-recorded on a recording device (recording medium) and provided to the computer from the recording device via a communication line.

[0082] Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments. Furthermore, the effects described in the embodiments of the present invention are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments of the present invention.

[0083] A first aspect disclosed in this embodiment is a plant photo album creation system that creates a plant photo album for inspecting plant equipment, an acquisition unit that acquires a plant drawing of the plant equipment; a placement data placement unit that places placement data at predetermined positions of the plant equipment shown in the plant drawing; an association unit that associates a predetermined photograph with the layout data; a linking unit that links the attribute information of the photo to the photo; a cutting unit that cuts out a miniature diagram of the plant equipment from the plant drawing; a diagram placement unit that places the diagram in a diagram area of ​​the plant photo album; an associating unit that associates the diagram with the placement data; a photo layout unit that arranges a photo associated with the layout data associated with the miniature diagram in a photo area of ​​the plant photo album; an attribute information placement unit that places the attribute information linked to the photograph in an attribute information area of ​​the plant photo album; The present invention provides a plant photo album creation system comprising:

[0084] A second aspect disclosed in this embodiment includes a preview output unit that outputs a preview of the plant photo album; The plant photo album creation system according to the first aspect further comprises:

[0085] A third aspect disclosed in the present embodiment is an editing unit that edits at least one of the miniature map, the photo, and the attribute information while outputting the preview; The plant photo album creation system according to the second aspect further comprises:

[0086] A fourth aspect disclosed in this embodiment is a photograph of a blackboard. The present invention provides a plant photo album creation system according to a first aspect.

[0087] In a fifth aspect disclosed in this embodiment, the attribute information includes a link to a digital form. The present invention provides a plant photo album creation system according to a first aspect. [Explanation of symbols]

[0088] 1 Plant photo album creation system 2. Inspectors 3. Information terminals 8 Network 10. Computers 20 Plant drawings 21 Plant equipment 22 Placement position 23 Icons 24 Cutout range 25 Bean Map 30 Plant Photo Album 31 Small map area 32 Photography Area 33 Attribute information area

Claims

1. A plant photo album creation system that creates a plant photo album for inspecting plant equipment, an acquisition unit that acquires a plant drawing of the plant equipment; a placement data placement unit that specifies a predetermined position of the plant equipment shown in the plant drawing by AI, a preset placement position, or input from an inspector, and places placement data at the specified predetermined position; an associating unit that associates a predetermined photograph with the placement data as detailed information of the placement data; a linking unit that links the attribute information of the photo to the photo; An extraction unit that identifies a miniature diagram of the plant equipment by AI, a preset drawing of the plant equipment, or input from an inspector, and extracts the identified miniature diagram from the plant drawing; A miniature arrangement unit that identifies a miniature area in the plant photo album by AI, a preset miniature area in the plant photo album, or input from an inspector, and arranges the miniature in the identified miniature area; an associating unit that associates the diagram with the placement data as detailed information of the placement data; a photo arrangement unit that identifies a photo area in the plant photo album by AI, a photo area in a pre-defined plant photo album, or input from an inspector, and arranges a photo associated with arrangement data associated with the miniature diagram in the identified photo area; an attribute information placement unit that identifies an attribute information area in the plant photo album by AI, a preset attribute information area in the plant photo album, or input from an inspector, and places attribute information linked to the photo in the identified photo area; A plant photo album creation system equipped with:

2. a preview output unit that outputs a preview of the plant photo album; The plant photo album creation system according to claim 1, further comprising:

3. an editing unit that edits at least one of the miniature map, the photo, and the attribute information while the preview is being output; 3. The plant photo album creation system according to claim 2, further comprising:

4. The photographs arranged in the plant photo album in which the miniature diagrams are arranged include an electronic small blackboard.

2. The plant photo album creation system according to claim 1.

5. The attribute information includes a link to a digital form.

2. The plant photo album creation system according to claim 1.

6. A computer-generated photo album for inspecting plant equipment is executed. A method for creating a plant photo album, comprising: obtaining a plant drawing of the plant equipment; specifying a predetermined position of the plant equipment shown in the plant drawing by AI, a preset placement position, or input from an inspector, and placing placement data at the specified predetermined position; Associating a predetermined photograph with the placement data as detailed information of the placement data; linking the attribute information of the photo to the photo; Identifying a miniature diagram of the plant equipment by AI, a preset drawing of the plant equipment, or input from an inspector, and extracting the identified miniature diagram from the plant drawing; A step of specifying a map area in the plant photo album by AI, a preset map area in the plant photo album, or input from an inspector, and arranging the map in the specified map area; Associating the diagram with the placement data as detailed information of the placement data; A step of identifying a photo area in the plant photo book by AI, a photo area in a pre-defined plant photo book, or input from an inspector, and arranging a photo associated with the arrangement data associated with the miniature diagram in the identified photo area; Identifying an attribute information area in the plant photo album by AI, a preset attribute information area in the plant photo album, or input from an inspector, and arranging attribute information linked to the photo in the identified photo area; A method for creating a plant photo album.

7. A computer that creates a plant photo album for inspecting plant equipment. obtaining a plant drawing of the plant equipment; A step of specifying a predetermined position of the plant equipment shown in the plant drawing by AI, a preset placement position, or input from an inspector, and placing placement data at the specified predetermined position; a step of associating a predetermined photograph with the placement data as detailed information of the placement data; linking the attribute information of the photo to the photo; Identifying a miniature diagram of the plant equipment by AI, a preset drawing of the plant equipment, or input from an inspector, and extracting the identified miniature diagram from the plant drawing; A step of specifying a map area in the plant photo album by AI, a preset map area in the plant photo album, or input from an inspector, and arranging the map in the specified map area; a step of associating the diagram with the placement data as detailed information of the placement data; A step of identifying a photo area in the plant photo book by AI, a photo area in a pre-defined plant photo book, or input from an inspector, and arranging a photo associated with the arrangement data associated with the miniature diagram in the identified photo area; Identifying an attribute information area in the plant photo album by AI, a preset attribute information area in the plant photo album, or input from an inspector, and arranging attribute information linked to the photo in the identified photo area; A computer-readable program for executing the program.

Images