Plant photo album creation system, plant photo album creation method, and program

Abstract

This invention provides a plant photograph album creation system and method that allows for easy identification of which plant equipment each photograph corresponds to in a plant photograph album used for inspecting plant equipment. [Solution] The plant photo album creation system 1 for creating a plant photo album for inspecting plant equipment acquires a plant drawing of the plant equipment S1, associates a photograph of the plant equipment with a predetermined position of the plant equipment shown in the plant drawing S3, cuts out a miniature drawing of the plant equipment from the plant drawing S5, and associates the miniature drawing with a predetermined position of the plant equipment shown in the plant drawing S7.

Description

Technical Field

[0004] , , , , , , , , , , , ,

[0003] , , , , , , , ,

[0001] The present invention relates to a technology effective for the inspection of plant equipment.

Background Art

[0002] Techniques for outputting images and the like for on-site inspections at construction sites have been attracting attention. For example, Patent Document 1 discloses a system that prompts shooting along with the input of inspection results when taking on-site evidence photos. In addition, Patent Document 2 discloses a technique for giving improvement instructions using photos when there are problems and improvement instructions during the inspection of a construction site.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] Patent Documents 1 and 2 disclose techniques for utilizing photos taken at a construction site as images and inspecting check items of buildings and equipment using the images. On the other hand, when installing plant equipment and inspecting equipment and the like, a plant photo album in which on-site photos are linked to inspection contents is utilized. Therefore, there is a need for a technology that can easily grasp which plant equipment the photos published in the plant photo album correspond to. However, with the techniques described in Patent Documents 1 and 2, it was not possible to immediately grasp which plant equipment the photos published in the plant photo album corresponded to. Therefore, the inventor focused on a mechanism for linking information about plant equipment to photographs when they are included in a plant photo album.

[0005] In view of these problems, the present invention aims to provide a plant photo album creation system, a plant photo album creation method, and a program that make it easy to understand which plant equipment each photograph corresponds to in a plant photo album used for inspecting plant equipment. [Means for solving the problem]

[0006] The present invention provides a plant photo album creation system for creating a plant photo album for inspecting plant equipment, comprising: an acquisition unit for acquiring a plant drawing of the plant equipment; an assignment unit for associating photographs of the plant equipment with predetermined positions of the plant equipment shown in the plant drawing; an extraction unit for cutting out a miniature drawing of the plant equipment from the plant drawing; and an association unit for associating the miniature drawing with predetermined positions of the plant equipment shown in the plant drawing.

[0007] According to the present invention, a miniature diagram is cut out from a plant drawing, and a plant photo album is created by associating photographs of plant equipment with the miniature diagram. As a result, in plant photo albums used for inspecting plant equipment, it becomes easy to identify which plant equipment each photograph corresponds to.

[0008] Although this invention falls under the category of a system, similar effects and benefits can be achieved with methods and programs. [Effects of the Invention]

[0009] According to the present invention, in a plant photograph album used for inspecting plant equipment, it becomes possible to easily determine which plant equipment each photograph corresponds to. [Brief explanation of the drawing]

[0010] [Figure 1] This is a diagram illustrating the overview of the plant photo album creation system 1. [Figure 2] This diagram shows the functional configuration of the plant photo album creation system 1. [Figure 3] This diagram shows a flowchart of the data placement process performed by computer 10. [Figure 4] This diagram schematically shows the state in which inspector 2 has received input for placement data for the predetermined positions of plant equipment shown in the plant diagram displayed on information terminal 3. [Figure 5] This diagram schematically shows the state in which computer 10 has placed the layout data onto the plant drawing. [Figure 6] This diagram shows a flowchart of the photo processing performed by computer 10. [Figure 7] This diagram shows a flowchart of the plant photo album creation process performed by computer 10. [Figure 8] This diagram schematically shows the state in which computer 10 has extracted a small diagram from the plant drawing. [Figure 9] This diagram schematically shows a plant photo album created by computer 10. [Figure 10] This diagram shows a flowchart of the output processing performed by computer 10. [Modes for carrying out the invention]

[0011] Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the attached drawings. In the following drawings, the same elements are denoted by the same numbers or reference numerals throughout the description of the embodiments.

[0012] [Overview of Plant Photo Album Creation System 1] Figure 1 is a schematic diagram illustrating the overview of the plant photo album creation system 1. Based on Figure 1, the components of the plant photo album creation system 1 will be described. The plant photo album creation system 1 is a system for creating a plant photo album for inspecting plant equipment, which consists of at least a computer 10 having server functions. In this embodiment, the plant photo album creation system 1 includes, in addition to the computer 10, an information terminal 3 managed by an inspector 2 who conducts inspections of plant equipment.

[0013] The information terminal 3 is a terminal device managed by the inspector 2, and examples thereof include terminal devices such as mobile phones, smartphones, tablet terminals, personal computers, laptop computers, etc., and wearable terminals such as smartwatches, smart glasses, and HMDs (Head Mounted Displays). The number of information terminals 3 can be appropriately designed according to the number of inspectors 2.

[0014] The computer 10 has server functions and may be realized by, for example, one computer or may be realized by a plurality of computers like a cloud computer. The cloud computer in this specification refers to either a device that uses any computer in a scalable manner when performing a specific function or a device that includes a plurality of functional modules to realize a certain system and can freely combine and use those functions.

[0015] Note that the plant photo album creation system 1 may include an external system, other terminals and devices, etc. in addition to the above-described information terminal 3 and computer 10, and the number, type, and functions thereof are not particularly limited and can be appropriately designed.

[0016] An overview of the processing steps when the plant photo album creation system 1 creates a plant photo album for inspecting plant equipment will be described.

[0017] The computer 10 acquires a plant drawing of the plant equipment (step S1). The computer 10 acquires the plant drawing from the information terminal 3 or the like.

[0018] Computer 10 places placement data for the plant equipment shown in the plant drawing at the designated locations (step S2). Computer 10 displays the plant diagram on information terminal 3. Information terminal 3 receives input from inspector 2 regarding the designated locations of plant equipment shown in the displayed plant diagram, and transmits the received locations to computer 10. Computer 10 receives this location and places the placement data at the location in the plant drawing that received the input based on the received location. Furthermore, the computer 10 may place the placement data based on AI (Artificial Intelligence), pre-set positions, etc., without relying on input from the inspector 2.

[0019] Computer 10 associates the designated photograph with the placement data (step S3). Computer 10 acquires photographs of plant equipment taken by information terminal 3. Computer 10 associates the acquired photographs with the placement data placed on the plant drawing.

[0020] Computer 10 associates the attribute information of the photograph with the photograph (step S4). Computer 10 accepts input of photograph attribute information associated with placement data via information terminal 3. Computer 10 associates the received attribute information with the photograph. Furthermore, the computer 10 may link attribute information based on AI, pre-configured content, etc., without relying on input from the inspector 2.

[0021] Computer 10 extracts small diagrams of plant equipment from the plant drawings (step S5). Computer 10 identifies the extent of plant equipment present in the plant drawings based on AI, pre-configured plant equipment drawings, and input received from inspector 2, and extracts the identified extent as a miniature drawing of the plant equipment.

[0022] Computer 10 places the bean diagram in the bean diagram area of ​​the plant photo album (step S6). The computer 10 identifies the miniature diagram area in the plant photo album based on the AI, the pre-configured miniature diagram area in the plant photo album, and the input received from the inspector 2, and places the extracted miniature diagram in the identified miniature diagram area.

[0023] Computer 10 associates the bean diagram with the placement data (step S7). Computer 10 identifies placement data to associate with the placed bean diagrams based on AI, pre-configured placement data, and input received from inspector 2, and associates the placed bean diagrams with the identified placement data.

[0024] Computer 10 places the photographs associated with the layout data linked to the bean diagrams into the photograph area of ​​the plant photograph album (step S8). The computer 10 identifies the photo areas in the plant photo album based on the AI, the pre-configured photo areas in the plant photo album, and the input received from the inspector 2, and places the photos, which are associated with the placement data linked to the bean diagram, into the identified photo areas.

[0025] Computer 10 places the attribute information associated with the photograph into the attribute information area of ​​the plant photograph album (step S9). Computer 10 identifies the attribute information area of ​​the plant photo album based on the AI, the pre-configured attribute information area of ​​the plant photo album, and the input received from inspector 2, and places the attribute information linked to the placed photographs in the identified attribute information area.

[0026] Computer 10 arranges diagrams, photographs, and attribute information to create a plant photo album. Computer 10 then outputs the created plant photo album to the information terminal 3. This plant photo album associates photographs with layout data in plant drawings, and also links them with beacons. Furthermore, attribute information is linked to the photographs associated with the layout data in this plant photo album. Therefore, for example, when information terminal 3 receives input for layout data in the plant drawing it displays, it can also display the corresponding page or location in the plant photo album that has been associated with this layout data.

[0027] The above is an overview of the plant photo album creation system 1. According to the plant photo album creation system 1, it becomes easy to understand which plant equipment each photograph corresponds to in a plant photo album used for inspecting plant equipment.

[0028] [Device configuration] Figure 2 is a block diagram showing the configuration of the plant photo album creation system 1. Based on Figure 2, the device configuration of the plant photo album creation system 1 will be described. The plant photo album creation system 1 is a system for creating plant photo albums for inspecting plant equipment, and consists of at least a computer 10. In this embodiment, as described above, the plant photo album creation system 1 consists of an information terminal 3 in addition to the computer 10. The plant photo album creation system 1 is a system in which a computer 10 is connected to an information terminal 3 via a network 8 such as a public telephone network, enabling data communication. Furthermore, the plant photo album creation system 1 may include external systems, other terminals and devices, etc., in addition to the information terminal 3 and computer 10, and the number, types, and functions of these can be designed as appropriate. Also, the number of information terminals 3 can be designed as appropriate according to the number of inspectors 2.

[0029] Information terminal 3 is the aforementioned terminal device managed by inspector 2, who inspects plant equipment. The information terminal 3 includes a CPU (Central Processing Unit), GPU (Graphics Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), etc., as a terminal control unit, and a communication unit that includes devices for communicating with other terminals and devices. The information terminal 3 includes various devices as input / output units that receive predetermined inputs, input and output various types of data, etc.

[0030] Computer 10 has server functionality and may be implemented using a single computer, or it may be implemented using multiple computers, like a cloud computer. Computer 10 includes a control unit comprising a CPU, GPU, RAM, ROM, etc., and a communication unit comprising a device for enabling communication with other terminals and devices, an acquisition unit for acquiring plant drawings of plant equipment, etc. Computer 10 includes a data storage unit, such as a hard disk, semiconductor memory, recording media, or memory card, as its storage unit. The computer 10 includes, as a processing unit, various devices for executing various processes, a placement data placement unit for placing placement data at predetermined locations of plant equipment shown in the plant drawing, a matching unit for associating predetermined photographs with the placement data, a matching unit for linking attribute information of photographs to photographs, a cutting unit for cutting out miniature diagrams of plant equipment from the plant drawing, a miniature diagram placement unit for placing the miniature diagrams in the miniature diagram area of ​​the plant photo album, a matching unit for associating the miniature diagrams with placement data, a photograph placement unit for placing photographs associated with the placement data linked to the miniature diagrams in the photograph area of ​​the plant photo album, and an attribute information placement unit for placing attribute information linked to photographs in the attribute information area of ​​the plant photo album.

[0031] In computer 10, the control unit loads a predetermined program and, in cooperation with the communication unit, realizes a drawing acquisition module, a layout data reception module, a photo acquisition module, an attribute information reception module, a preview module, an editing status reception module, and an output module. Furthermore, in the computer 10, the control unit loads a predetermined program, which then works in cooperation with the memory unit to realize a memory module. Furthermore, in the computer 10, the control unit loads a predetermined program and, in cooperation with the processing unit, realizes a data placement module, a correspondence module, a linking module, a cropping module, a bean diagram placement module, a related module, a photograph placement module, an attribute information placement module, a judgment module, and an editing module.

[0032] The following describes each process performed by the plant photo album creation system 1, along with the processes performed by the modules mentioned above. In this specification, each module may perform its processing as a function of its own, or it may perform it through a predetermined application.

[0033] [Placement data placement process executed by computer 10] Based on Figure 3, the placement data placement process performed by the computer 10 will be described. This figure is a flowchart of the placement data placement process performed by the computer 10. The placement data placement process is a detailed process of acquiring a plant drawing of the plant equipment (step S1) and placing the placement data at the predetermined locations of the plant equipment shown in the plant drawing (step S2).

[0034] The drawing acquisition module acquires plant drawings of plant equipment (step S10). The plant drawing is a diagram of the plant, including the plant equipment that inspector 2 will inspect. The drawing acquisition module acquires plant drawings from information terminal 3, etc. The information terminal 3 receives input from the inspector 2, such as tapping on the plant diagram of the plant equipment to be inspected from among the plant diagrams that the inspector has stored in his / her memory, and transmits the received plant diagram to the computer 10. The drawing acquisition module receives this plant drawing and acquires the plant drawings of the plant equipment. The drawing acquisition module may, instead of acquiring plant drawings from the information terminal 3, use plant drawings it has already stored to perform the processing described later. In this case, the drawing acquisition module may display a list of plant drawings it has stored on the information terminal 3, receive selection input from the inspector 2 from this list, identify the plant drawing to be used, and then acquire the identified plant drawing. The drawing acquisition module may also acquire plant drawings by other means (such as acquiring them from an external system).

[0035] The placement data receiving module receives placement data for the designated locations of plant equipment shown in the plant drawing (step S11). Placement data is predetermined data for placement on a plant drawing, such as icons, leader lines, and arrows. In this embodiment, the case where the placement data is an icon will be described as an example. It goes without saying that the present invention is also applicable when the placement data is not an icon. In cases other than icons, for example, when leader lines or arrows have start and end points, in the processing described later, in addition to accepting input of an arbitrary point, it is sufficient to accept input of the start and end points. The placement data receiving module transmits the acquired plant diagram to the information terminal 3 and displays the acquired plant diagram on the information terminal 3. The information terminal 3 accepts input operations such as tapping on the designated positions of plant equipment shown in the displayed plant diagram and accepts input of the placement location for the placement data (see Figure 4). Furthermore, when the information terminal 3 accepts input of the placement location of the placement data, it may also accept input of the type of placement data. For example, the information terminal 3 may accept input of the type of placement data (icon, leader line, arrow, etc.) before or after accepting input of the placement location of the placement data.

[0036] Referring to Figure 4, the state in which the placement data reception module accepts placement data will be explained. This figure schematically shows the state in which the inspector 2 has received input for placement data for the predetermined positions of plant equipment shown in the plant diagram displayed on the information terminal 3. In this figure, the information terminal 3 is shown displaying the plant diagram 20. Inspector 2 inputs the desired placement location for the placement data by tapping or other means. Figure 4 shows Inspector 2 tapping placement location 22 as a predetermined location (nearby, surrounding, on top of, etc.) of the plant equipment 21 shown in the plant drawing 20. Information terminal 3 uses this placement location 22 as the placement location for the placement data and transmits its coordinates to computer 10. For example, information terminal 3 sets a predetermined point on the plant drawing 20 as the origin and uses the coordinates of the point input from Inspector 2 corresponding to this origin as the coordinates of placement location 22. Information terminal 3 transmits the coordinates of the placement location 22 to computer 10. At this time, if information terminal 3 has accepted input for the type of placement data, it also transmits the type of placement data to computer 10. The placement data receiving module receives these coordinates and accepts the placement data for the designated positions of the plant equipment 21 shown in the plant drawing 20. If the information terminal 3 has transmitted the type of placement data, the placement data receiving module receives this type and accepts the type of placement data as well.

[0037] Returning to Figure 3, we will continue explaining the data placement process for the layout. The placement data placement module places the placement data at the designated locations of the plant equipment shown in the plant drawing (step S12). The placement data placement module places the placement data at the placement location 22 of the received placement data (see Figure 5). Based on the coordinates of the received placement location 22, the placement data placement module identifies the placement location 22 of the placement data in the plant drawing 20 and places the placement data at the identified placement location 22. At this time, if the type of placement data has been received, the placement data corresponding to this type is placed. In this embodiment, as described above, since the placement data is an icon, the placement data placement module places the icon at the placement location of the placement data.

[0038] Referring to Figure 5, the placement data placed by the placement data placement module will be explained. This figure schematically shows the state in which the placement data placement module has placed the placement data on the plant drawing. The placement data placement module places icons 23 as placement data at the designated locations (received placement locations 22) of the plant equipment 21 in the plant drawing 20. The placement data placement module places the icon 23 at the position based on the coordinates of the placement position 22 received in Figure 4.

[0039] Furthermore, when placing the layout data on the plant drawing, the computer 10 may determine the placement location and place the layout data at the determined location, without relying on input from the inspector 2. If the computer 10 does not rely on input from the inspector 2, it may omit the process in step S11. In this case, computer 10 may determine the placement position using AI, or it may determine the placement position based on a predetermined placement position, or it may determine the placement position by any other method. When using AI, for example, computer 10 can determine the placement location of the placement data (including the type of placement data) using a learning model that has previously learned the placement locations of plant equipment in the plant drawing and the placement locations of the placement data. Alternatively, if the placement location is predetermined, the positions of the plant equipment in the plant drawing and the placement locations of the placement data can be predetermined (including the type of placement data), and these predetermined placement locations can be determined as the placement locations of the placement data. Similarly, in other methods, the placement location of the placement data can be determined as appropriate. In these cases as well, the type of placement data may also be determined. The data placement module should place the placement data based on the determined placement location.

[0040] The above describes the data placement process for layout.

[0041] [Photo processing performed by computer 10] Based on Figure 6, the photo processing performed by the computer 10 will be explained. This figure is a flowchart of the photo processing performed by the computer 10. The photo processing consists of a photo mapping process (step S3) that associates a predetermined photo with the layout data, and a linking process (step S4) that links the attribute information of a photo to the photo.

[0042] The photo acquisition module acquires a predetermined photo to be associated with the placement data (step S20). The designated photograph is a photograph of the actual plant equipment corresponding to the plant equipment in the plant drawing on which the placement data has been placed. This photograph may include a blackboard with the shooting conditions described. Including a blackboard in the photograph means that when photographing the plant equipment, a physical blackboard may be placed around the plant equipment and the photograph may be taken, or a virtual blackboard (electronic mini-blackboard) may be superimposed on the photograph of the plant equipment. The photo acquisition module acquires photographs of plant equipment taken from information terminal 3, etc. Information terminal 3 receives selection input, such as tapping, from inspector 2 regarding the photos of plant equipment that should be associated with the layout data, and sends the received photos to computer 10. Alternatively, information terminal 3 launches a photography application, receives input from inspector 2 regarding the photography of plant equipment, photographs the plant equipment, and sends the photographs to computer 10. The photo acquisition module receives this photo and acquires a predetermined photo to associate with the placement data. Furthermore, there is no particular limit to the number of photos that the photo acquisition module acquires. Furthermore, the photo acquisition module may perform the processing described later using photos it has already stored, rather than acquiring photos from the information terminal 3. In this case, the photo acquisition module may display a list of photos it has stored on the information terminal 3, receive selection input from the inspector 2 regarding this list, identify the photo to be used, and then acquire the identified photo. The photo acquisition module may also acquire photos by other means.

[0043] The mapping module maps a predetermined photograph to the placement data (step S21). The mapping module associates acquired photographs with placement data placed on the plant drawing. In Figure 5, the mapping module associates the acquired photographs with icons 23 placed at predetermined locations on plant equipment 21 in the plant drawing 20. If multiple photographs have been acquired, the mapping module associates all of them with icon 23.

[0044] The attribute information receiving module accepts input of the attribute information of the photograph (step S22). Attribute information refers to information about the plant equipment shown in the photograph, such as name, model, type, manufacturer, and installation location. Furthermore, this attribute information includes a link to a digital report. The digital report is an electronic document, prepared separately from the plant photo album. A link means associating the plant photo album with the attribute information, for example, with a predetermined tag. Including a link means, for example, that the attribute information includes a predetermined tag. The attribute information receiving module transmits input data for the attribute information of the acquired photograph to the information terminal 3. This input data includes an attribute information input form and the photograph into which the attribute information is to be entered. Information terminal 3 receives this input data and displays it via a predetermined UI (User Interface). Information terminal 3 accepts direct text input to the displayed input form, etc., and selection input to the options from inspector 2. For example, information terminal 3 accepts input of photograph attribute information by accepting direct text input via a virtual keyboard, etc., regarding name, type, installation location, etc., and by accepting selection input such as tapping on each option for name, type, installation location, etc. Information terminal 3 transmits the received attribute information to computer 10. The attribute information receiving module receives this attribute information and accepts the attribute information of the photograph.

[0045] The linking module links attribute information to the photograph (step S23). The linking module links the attribute information of the received photo to that photo. As a result, the linking module also links attribute information to placement data that is associated with photographs to which attribute information is linked. In the case of Figure 5, the linking module links attribute information to photographs associated with icons 23 placed at predetermined locations on plant equipment 21 in the plant drawing 20.

[0046] Furthermore, when the computer 10 associates attribute information with a photograph, it may do so without relying on input from the inspector 2. If the computer 10 does not rely on input from the inspector 2, it may omit the process in step S22. In this case, computer 10 may use AI to associate attribute information with photographs, or it may associate pre-set attribute information with photographs, or it may associate attribute information with photographs by any other method. When using AI, for example, computer 10 can determine the attribute information of an acquired photograph using a learning model that has been pre-trained on photographs of plant equipment and attribute information of that plant equipment, and then link the determined attribute information to the acquired photograph. Alternatively, if the attribute information is pre-set, the photographs of plant equipment and their attribute information can be pre-set, and the attribute information set for the acquired photograph can be linked to the acquired photograph. Similarly, in other methods, the attribute information can be linked to the photograph as appropriate.

[0047] The above describes the photo processing process.

[0048] [Process for creating a plant photo album executed by computer 10] Based on Figure 7, the process of creating a plant photo album executed by the computer 10 will be explained. The same figure is a flowchart of the process of creating a plant photo album executed by the computer 10. The process of creating a plant photo album consists of the following steps: an extraction process (step S5) in which small diagrams of plant equipment are extracted from the plant drawing; a small diagram placement process (step S6) in which the small diagrams are placed in the small diagram area of ​​the plant photo album; an association process (step S7) in which the small diagrams are associated with placement data; a photo placement process (step S8) in which photos associated with the placement data linked to the small diagrams are placed in the photo area of ​​the plant photo album; and an attribute information placement process (step S9) in which attribute information linked to the photos is placed in the attribute information area of ​​the plant photo album.

[0049] The extraction module extracts small drawings of plant equipment from the plant drawings (step S30). The bean-shaped diagrams are drawings used to supplement the explanation of plant equipment shown in the acquired photographs. The extraction module identifies the extraction range of plant equipment present in the plant drawings based on AI, pre-configured plant equipment drawings, and input received from Inspector 2, and extracts the identified extraction range as a miniature drawing of the plant equipment (see Figure 8). Furthermore, the method by which the extraction module extracts the miniature diagram is not limited to the example described above, and can be designed as appropriate.

[0050] This section explains how the extraction module uses AI to extract small diagrams. The extraction module uses a learning model that has learned from plant equipment drawings to identify the extraction range of plant equipment shown in the acquired plant drawings, and then extracts the identified extraction range of plant equipment as a miniature drawing.

[0051] This section describes how the extraction module extracts miniature drawings using pre-configured plant equipment drawings. The cutting module refers to pre-configured plant equipment drawings, identifies the cutting range of the plant equipment shown in the acquired plant drawings, and cuts out the identified cutting range of the plant equipment as a miniature drawing.

[0052] This section explains how the extraction module extracts a small diagram using input from inspector 2. Computer 10 transmits the acquired plant drawings to information terminal 3. Information terminal 3 receives the plant drawing and displays it via a predetermined UI. Information terminal 3 receives input from inspector 2 regarding the area to be extracted as a bean-shaped drawing from the plant drawing. Information terminal 3 accepts this input, for example, by enclosing a predetermined area of ​​the plant drawing with a predetermined shape (rectangle, circle, etc.). Information terminal 3 transmits the received extraction range to computer 10. Computer 10 receives this cutout range. The cutout module cuts out the area of ​​the plant drawing corresponding to the received cutout range as a miniature drawing.

[0053] Referring to Figure 8, the state in which the cutting module cuts out the miniature drawing will be explained. This figure schematically shows the state in which the cutting module cuts out the miniature drawing from the plant drawing. The plant drawing 20 is the same as the one shown in Figure 5 above. The cutting module identifies the cutting range 24 based on AI, pre-configured plant equipment drawings, input from inspector 2, etc. Based on the identified cutting range 24, the cutting module cuts out a miniature drawing 25 from the plant drawing 20. This miniature drawing 25 may only include the plant equipment 21 shown in the plant drawing 20, or it may include the plant equipment 21 and its surrounding area.

[0054] Returning to Figure 7, we will continue explaining the process for creating the plant's photo album. The bean diagram placement module places the bean diagram in the bean diagram area of ​​the plant photo album (step S31). The bean-shaped diagram area is the area in a plant photo album where bean-shaped diagrams are placed. The bean diagram placement module identifies the bean diagram areas in the plant photo album based on AI, pre-configured bean diagram areas in the plant photo album, and input received from Inspector 2, and places bean diagrams in the identified bean diagram areas. Furthermore, the method by which the bean diagram placement module places bean diagrams in the bean diagram area of ​​the plant photo album is not limited to the example described above, and can be designed as appropriate.

[0055] This section describes how the bean diagram placement module uses AI to place bean diagrams in the bean diagram area of ​​a plant photo album. The bean diagram placement module uses a learning model that has learned the bean diagram areas of the plant photo album to identify the bean diagram areas in the plant photo album where the extracted bean diagrams will be placed, and then places the extracted bean diagrams in the identified areas.

[0056] This section describes how the bean diagram placement module places bean diagrams in the bean diagram area of ​​the plant photo album using a pre-configured bean diagram area. The bean diagram placement module refers to the bean diagram area of ​​the pre-configured plant photo album, identifies the bean diagram area in the plant photo album where the extracted bean diagram will be placed, and places the extracted bean diagram in the identified bean diagram area.

[0057] This section describes how the bean diagram placement module places bean diagrams in the bean diagram area of ​​the plant photo album using input from Inspector 2. Computer 10 transmits the plant photo album to information terminal 3. In this case, the plant photo album may be blank or it may have some information written on it. Information terminal 3 receives the plant photo album and displays it via a predetermined UI. Information terminal 3 receives input from inspector 2 for the area where the miniature diagrams will be placed in the plant photo album. Information terminal 3 accepts this input, for example, by inputting an arbitrary point that encloses a predetermined area of ​​the plant photo album with a predetermined shape (rectangle, circle, etc.). Information terminal 3 transmits the received bean diagram area to computer 10. Computer 10 receives this miniature diagram area. The miniature diagram placement module places the extracted miniature diagram in the area of ​​the plant photo album corresponding to the received miniature diagram area.

[0058] The association module associates the bean diagram with the placement data (step S32). The association module links miniature diagrams, extracted from plant drawings and placed in a plant photo album, to placement data placed in the plant drawings. The association module links the miniature diagrams to the placement data based on AI, pre-configured placement data, and input received from Inspector 2. Furthermore, the method by which the association module links the bean diagram to the placement data is not limited to the example described above, and can be designed as appropriate. As a result, the association module links attribute information and also associates the miniature diagrams extracted from the plant drawings with the placement data that corresponds to the photographs to which this attribute information is linked. In the cases of Figures 5 and 8, the miniature diagrams 25, which were extracted from the plant drawing 20 and placed in the plant photo album, are associated with the icon 23.

[0059] This section describes how the association module uses AI to associate bean diagrams with placement data. The association module uses a learning model that has learned from the extracted bean diagrams and placement data placed in the vicinity (surroundings, on top of, etc.) of the area from which the bean diagrams were extracted to identify the placement data placed in the plant diagram to which the extracted bean diagrams are associated, and then associates the extracted bean diagrams with the identified placement data.

[0060] This section describes how an association module associates a bean diagram with pre-configured placement data. The association module identifies placement data that has been pre-configured in the vicinity (around, on, etc.) of the area from which the bean diagram has been extracted as pre-set placement data, and associates the extracted bean diagram with the identified placement data.

[0061] This section describes how the association module uses input from inspector 2 to associate a bean diagram with placement data. Computer 10 transmits the plant drawing with the placement data to information terminal 3. Information terminal 3 receives the plant drawing and displays it via a predetermined UI. Information terminal 3 receives input from inspector 2 for placement data to associate with the extracted miniature drawings. Information terminal 3 accepts this input, for example, by tapping the placement data. Information terminal 3 transmits the received placement data to computer 10. Computer 10 receives this placement data. The association module associates the extracted miniature diagrams with the placement data placed in the plant drawing corresponding to the received placement data.

[0062] The photo placement module places photos, which are associated with placement data linked to the bean diagram, into the photo area of ​​the plant photo album (step S33). The photo area is the area in a plant photo album where photographs are placed. The photo placement module identifies photo areas in the plant photo album based on AI, pre-configured photo areas in the plant photo album, and input received from inspector 2, and places photos associated with placement data linked to bean diagrams in the identified photo areas. Furthermore, the method by which the photo placement module places photos, associated with placement data linked to bean diagrams, into the photo area of ​​the plant photo album is not limited to the example described above, and can be designed as appropriate.

[0063] This section describes how a photo placement module uses AI to place photos, associated with placement data linked to beacons, into the photo area of ​​a plant photo album. The photo placement module uses a learning model that has learned the photo areas of the plant photo album to identify the photo areas of the plant photo album where photos associated with placement data linked to bean diagrams should be placed, and then places the photos associated with the placement data linked to bean diagrams into the identified photo areas.

[0064] This section describes how the photo placement module uses a pre-configured photo area in a plant photo album to place photos that are associated with placement data linked to bean diagrams into the photo area of ​​the plant photo album. The photo placement module refers to the photo areas in a pre-configured plant photo album, identifies the photo areas in the plant photo album where photos associated with placement data linked to the bean diagram should be placed, and places the photos associated with the placement data linked to the bean diagram into the identified photo areas.

[0065] This section describes how the photo placement module uses input from inspector 2 to place photos in the photo area of ​​the plant photo album, corresponding to placement data associated with bean diagrams. Computer 10 transmits the plant photo album to information terminal 3. In this case, the plant photo album may be blank or it may contain some information (such as a diagram of the layout). Information terminal 3 receives the plant photo album and displays it via a predetermined UI. Information terminal 3 receives input from inspector 2 for photo areas in the plant photo album where photos corresponding to layout data associated with bean diagrams will be placed. Information terminal 3 accepts this input, for example, by inputting arbitrary points that enclose a predetermined area of ​​the plant photo album with a predetermined shape (rectangle, circle, etc.). Information terminal 3 transmits the received photo area to computer 10. Computer 10 receives this photo area. The photo placement module places the photo, which is associated with the placement data linked to the bean diagram, into the area of ​​the plant photo album corresponding to the received photo area.

[0066] The attribute information placement module places the attribute information associated with the photograph into the attribute information area of ​​the plant photo album (step S34). The attribute information area is the area in a plant photo album where attribute information is placed. The attribute information placement module identifies the attribute information area of ​​the plant photo album based on AI, pre-configured attribute information areas of the plant photo album, and input received from inspector 2, and places attribute information linked to the photos placed in the photo area into the identified attribute information area. Furthermore, the method by which the attribute information placement module places attribute information linked to photographs placed in the photograph area into the attribute information area of ​​the plant photograph album is not limited to the example described above, and can be designed as appropriate.

[0067] This section describes how the attribute information placement module uses AI to place attribute information linked to photographs in the attribute information area of ​​a plant photo album. The attribute information placement module uses a learning model that has learned the attribute information areas of the plant photo album to identify the attribute information photo areas of the plant photo album where attribute information linked to the photos placed in the photo areas should be placed, and then places the attribute information linked to the photos placed in the photo areas into the identified attribute information areas.

[0068] This section describes how the attribute information placement module uses a pre-configured attribute information area of ​​the plant photo album to place attribute information associated with photos placed in the photo area into the attribute information area of ​​the plant photo album. The attribute information placement module refers to the attribute information area of ​​the plant photo album, which has been set up in advance, identifies the attribute information area of ​​the plant photo album where the attribute information linked to the photos placed in the photo area should be placed, and places the attribute information linked to the photos placed in the photo area into the identified attribute information area.

[0069] This section describes how the attribute information placement module uses input from inspector 2 to place attribute information linked to photographs placed in the photograph area into the attribute information area of ​​the plant photograph album. Computer 10 transmits the plant photo album to information terminal 3. In this case, the plant photo album may be blank, or it may contain some information (such as a diagram of the layout or a photograph). Information terminal 3 receives the plant photo album and displays it via a predetermined UI. Information terminal 3 receives input from inspector 2 for an attribute information area in the plant photo album, where attribute information linked to the photos placed in the photo area is placed. Information terminal 3 accepts this input, for example, by inputting an arbitrary point that encloses a predetermined area of ​​the plant photo album with a predetermined shape (rectangle, circle, etc.). Information terminal 3 transmits the received attribute information area to computer 10. Computer 10 receives this attribute information area. The attribute information placement module places the attribute information associated with the photographs placed in the photograph area into the area of ​​the plant photograph album corresponding to the received attribute information area.

[0070] The above describes the process for creating a photo album for the plant. Computer 10 places the diagrams, photographs, and attribute information into the plant photo album to create the plant photo album (see Figure 9). Computer 10 uses the plant photo album created in this way to perform the processing described later.

[0071] Referring to Figure 9, the plant photo album created by computer 10 will be explained. This figure schematically shows the plant photo album created by computer 10. In this figure, plant photo album 30 is shown. The plant photo album 30 has a bean diagram area 31 where bean diagrams 25 are placed, which were placed by the processing in step S31; a photo area 32 (32a, 32b) where photos associated with icons 23 linked to bean diagrams 25 are placed, which were placed by the processing in step S33; and an attribute information area 33 (33a, 33b) where attribute information linked to the photos placed in the photo area 32 is placed, which was placed by the processing in step S34. The bean-shaped area 31 is the position determined by the processing in step S31, the photograph area 32 is the position determined by the processing in step S33, and the attribute information area 33 is the position determined by the processing in step S34. Computer 10 outputs the plant photo album 30 to the information terminal 3. When the information terminal 3 receives input such as a tap from inspector 2 on an icon 23 present in the plant drawing 20, computer 10 displays on the information terminal 3 the page or corresponding location of the plant photo album 30 where the photograph associated with the icon 23, the miniature diagram associated with the icon 23, and the attribute information linked to the photograph are located. Furthermore, when computer 10 receives input from information terminal 3 regarding a link to a digital report included in the attribute information of the plant photo album 30 to be output, it outputs the linked digital report to information terminal 3. In this case, computer 10 transmits the linked digital report to information terminal 3, displays it, and outputs this digital report to information terminal 3.

[0072] [Output processing performed by computer 10] Based on Figure 10, the output processing performed by computer 10 will be explained. This figure is a flowchart showing the output processing performed by computer 10.

[0073] The preview module outputs a preview of the plant photo album (step S40). The preview function simulates the creation results of the plant photo album created by the computer 10 during the plant photo album creation process, and displays them on the screen of the information terminal 3 before actually outputting the album. The preview module sends a preview of the plant photo album created as a result of the plant photo album creation process to the information terminal 3. Information terminal 3 receives a preview of the plant photo album and displays the preview of the plant photo album via a predetermined UI. The preview module outputs a preview of the plant photo album by displaying a preview of the plant photo album created as a result of the plant photo album creation process on the information terminal 3. In the case of Figure 9, the preview module outputs a preview of the plant photo album 30 by sending a preview of the plant photo album 30 to the information terminal 3 and displaying it.

[0074] The editing status confirmation module accepts whether or not the plant photo album should be edited (step S41). Information terminal 3 accepts input from inspector 2 regarding the preview of the displayed plant photo album 30, such as inputting a predetermined icon, changing the arrangement of each area, and changing the content of each area. For example, if editing is not required, information terminal 3 accepts input from inspector 2, such as tapping an icon indicating that editing is not required. Also, for example, if the arrangement of each area is to be changed, information terminal 3 accepts input from inspector 2, such as tapping or dragging the area to be changed (for example, dragging an area when changing the arrangement of areas). Also, for example, if the content of each area is to be changed, information terminal 3 accepts input from inspector 2 regarding the content to be changed (for example, inputting into a predetermined input form to change each content). Information terminal 3 transmits the received input content to computer 10 as edited data. The editing status confirmation module receives this editing data and confirms whether or not the plant photo album has been edited.

[0075] The decision module determines whether or not there has been editing (step S42). The decision module makes this decision based on whether a predetermined icon is entered in the received editing data, whether there are any changes to the area, whether there are any changes to the content of the area, etc.

[0076] If the judgment module determines that editing is required (step S42 YES), the editing module edits at least one of the diagrams, photographs, and attribute information while outputting the preview (step S43). The editing module edits the plant photo album based on the received editing data. The editing performed by the editing module includes rearranging, deleting, or modifying at least one of the following: diagrams, photographs, and attribute information. When the editing module receives a request to change the area, it changes the placement of the area. For example, if the editing module receives a request to change the placement of a miniature area, it changes the placement of the miniature area to the changed position. Also, if the editing module receives a request to swap the placement of a miniature area and a photograph area, it swaps the placement of the miniature area and the photograph area. When the editing module receives a request to change the contents of an area, it modifies the contents of that area. For example, if the editing module receives a request to change the contents of an attribute information area, it modifies the contents of the attribute information area to reflect the modified attribute information. Similarly, if the editing module receives a request to change a bean-shaped diagram or photograph, it modifies the placed bean-shaped diagram or photograph to reflect the modified diagram or photograph.

[0077] Computer 10 repeats the processes in steps S41 to S43 until inspector 2 completes the editing, and when editing is complete, it executes the process in step S44, which will be described later. Completion of editing can be determined, for example, in the process of step S42, by the information terminal 3 receiving input such as a tap on an icon indicating that editing is not required, or by the editing status reception module receiving this editing data.

[0078] If the judgment module determines that there is no editing required (step S42 NO), the output module outputs the plant photo album (step S44). The output module may output the created plant photo album in a predetermined data format (document data, spreadsheet data, presentation data, PDF (Portable Document Format) data, CSV (Comma Separated Values) data, etc.), or it may output to a printer or external recording device connected to the computer 10 for data communication, or it may output to the information terminal 3. When the output module outputs the plant photo album in a predetermined data format, the computer 10 converts the plant photo album to a pre-set data format or to a data format received from the inspector 2. The conversion method is not particularly limited, and any known data conversion method may be used. The output module may store the converted plant photo album in a storage module, transmit it to the information terminal 3, print it using a printing device, or store it in an external recording device. When the output module outputs to the printing device, the computer 10 only needs to cause the printing device to print the plant photo album. The output module sends the plant photo album and a command to print this plant photo album to the printing device. The printing device receives the plant photo album and the command and prints the plant photo album according to the command. When the output module outputs to an external recording device, the computer 10 only needs to store the plant photo album in the external recording device. The output module sends the plant photo album and a command to store this plant photo album to the external recording device. The external recording device receives the plant photo album and the command and stores the plant photo album according to the command. When the output module outputs the plant photo album to the information terminal 3, the computer 10 sends the plant photo album to the information terminal 3. The information terminal 3 receives this plant photo album and displays it via a predetermined UI. The output module only needs to send the plant photo album to the information terminal 3 and display it. When the output module outputs the plant photo album, it may be based on inputs for placement data placed on the plant drawing, or it may be based on other inputs. The output module performs this process on every page of the plant photo album.

[0079] The above describes the output processing.

[0080] Although the processes described above are listed as separate processes, computer 10 can also be configured to execute some or all of the processes described above in combination. Furthermore, computer 10 can be configured to execute each process at times other than those described. Furthermore, although the above-mentioned processes are described as processes executed by computer 10, it is also possible to configure them so that some or all of them are executed by information terminal 3, or by a predetermined application installed on information terminal 3.

[0081] The means and functions described above are realized by a computer (including the CPU, information processing unit, and various terminals) reading and executing a predetermined program. The program may be provided, for example, via a network from the computer (SaaS: Software as a Service) or as a cloud service. Alternatively, the program may be provided in a form recorded on a computer-readable recording medium. In this case, the computer reads the program from the recording medium, transfers it to an internal or external recording device, records it, and executes it. Alternatively, the program may be pre-recorded on a recording device (recording medium) and provided to the computer from that recording device via a communication line.

[0082] Although embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above. Furthermore, the effects described in the embodiments of the present invention are merely a list of the most preferred effects arising from the present invention, and the effects of the present invention are not limited to those described in the embodiments of the present invention.

[0083] A first aspect disclosed in this embodiment is a plant photo album creation system for creating a plant photo album for inspecting plant equipment, An acquisition unit for acquiring plant drawings of the aforementioned plant equipment, A placement data placement unit that places placement data at predetermined locations of plant equipment shown in the plant drawing, The aforementioned arrangement data includes a matching unit that associates a predetermined photograph with it, A linking unit that associates the attribute information of the aforementioned photograph with the aforementioned photograph, From the aforementioned plant drawing, a cutting section for cutting out a miniature drawing of the plant equipment, A miniature diagram arrangement unit for arranging the miniature diagram in the miniature diagram area of ​​the plant photo album, The aforementioned diagram is associated with the aforementioned layout data, A photo placement unit that places photographs associated with the layout data linked to the aforementioned diagram into the photo area of ​​the plant photo album, An attribute information placement unit places attribute information linked to the aforementioned photograph into the attribute information area of ​​the plant photograph album, We provide a plant photo album creation system equipped with the following features.

[0084] A second aspect disclosed in this embodiment is a preview output unit that outputs a preview of the plant photo album, The present invention provides a plant photo album creation system according to the first embodiment, further comprising the above.

[0085] A third aspect disclosed in this embodiment is an editing unit that edits at least one of the miniature figures, photographs, and attribute information while the preview is being output. The present invention provides a plant photo album creation system according to a second embodiment, further comprising the above.

[0086] A fourth aspect disclosed in this embodiment is that the photograph in which the arrangement includes a blackboard. The present invention provides a plant photo album creation system as described in the first embodiment.

[0087] A fifth aspect disclosed in this embodiment is that the placed attribute information includes a link to a digital form. The present invention provides a plant photo album creation system as described in the first embodiment. [Explanation of Symbols]

[0088] 1. Plant Photo Album Creation System 2 Inspectors 3. Information terminals 8 Networks 10 Computers 20 Plant Drawings 21 Plant Equipment 22 Placement position 23 icons 24 Cutting range 25 Bean Diagrams 30 Plant Photo Album 31 Small map area 32 Photographic Area 33 Attribute information area

Claims

1. A plant photo album creation system for creating plant photo albums for inspecting plant equipment, An acquisition unit for acquiring plant drawings of the aforementioned plant equipment, A correspondence unit for associating a photograph of the plant equipment with a predetermined position of the plant equipment shown in the plant drawing, From the aforementioned plant drawing, a cutting section for cutting out a miniature drawing of the plant equipment, The plant drawing includes an association part for associating the miniature diagram with a predetermined position of the plant equipment shown in the plant drawing, A plant photo album creation system equipped with the following features.

2. A preview output unit that outputs a preview of the aforementioned plant photo album, The plant photo album creation system according to claim 1, further comprising:

3. While the aforementioned preview is being output, the editorial department edits at least one of the aforementioned diagram and the aforementioned photograph. The plant photo album creation system according to claim 2, further comprising:

4. The aforementioned photograph, which is shown in the same place, includes an electronic blackboard. A plant photo album creation system according to claim 1.

5. A method for creating a plant photographic album, which is performed by a computer that creates a plant photographic album for inspecting plant equipment, The steps include obtaining a plant drawing of the aforementioned plant equipment, The steps include: associating a photograph of the plant equipment with a predetermined location of the plant equipment shown in the plant drawing; The steps include: extracting a small drawing of the plant equipment from the aforementioned plant drawing, The steps include associating the miniature drawing with a predetermined location of the plant equipment shown in the plant drawing, A method for creating a plant photo album, comprising the following features.

6. A computer that creates a plant photo album for inspecting plant equipment, Steps to obtain plant drawings of the aforementioned plant equipment, The steps include: associating a photograph of the plant equipment with a predetermined location of the plant equipment shown in the plant drawing; Steps include: extracting a small drawing of the plant equipment from the aforementioned plant drawing; The step of associating the bean diagram with a predetermined position of the plant equipment shown in the plant drawing, A computer-readable program for executing a command.

Images