Plant photo album creation system, plant photo album creation method, and program
The plant photo album creation system addresses the challenge of equipment identification in plant photo albums by associating plant drawings, photographs, and attribute information, enabling clear equipment-to-photograph correlations.
Patent Information
- Application Number
- PCT/JP2024/025586
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-17
- Publication Date
- 2026-01-22
AI Technical Summary
Existing technologies fail to immediately identify which plant equipment corresponds to a photograph in a plant photo album during inspections.
A plant photo album creation system that includes an acquisition unit for plant drawings, placement data, association units for photographs and attribute information, and extraction units for miniature diagrams, allowing for the creation of a photo album that clearly associates equipment with photographs and attribute information.
Facilitates easy identification of plant equipment corresponding to photographs in the album, enhancing the understanding of inspection data.
Smart Images

Figure JP2024025586_22012026_PF_FP_ABST
Abstract
Description
Plant photo album creation system, plant photo album creation method and program
[0001] The present invention relates to a technique that is effective for inspecting plant equipment.
[0002] Technologies for outputting images, etc., for inspecting construction sites are attracting attention. For example, Patent Document 1 discloses a system that prompts users to take photographs of the site as evidence while also inputting the inspection results. Furthermore, Patent Document 2 discloses a technology that uses photographs to provide improvement instructions when problems are found during a construction site inspection and improvement instructions are required.
[0003] JP 2010-277442 A JP 2023-154684 A
[0004] Patent Documents 1 and 2 disclose techniques for using photographs of a construction site as images to inspect check items for buildings and equipment using the images. Meanwhile, when installing plant equipment and inspecting the equipment, a plant photo album is used, linking site photos with inspection details. Therefore, there is a need for a technique for easily identifying which plant equipment corresponds to a photograph published in a plant photo album. However, the techniques described in Patent Documents 1 and 2 make it impossible to immediately identify which plant equipment corresponds to a photograph published in a plant photo album. Therefore, the present inventor focused on a mechanism for linking information about plant equipment to a photograph when publishing the photograph in a plant photo album.
[0005] In view of these problems, the present invention aims to provide a plant photo album creation system, a plant photo album creation method, and a program that make it easy to understand which plant equipment each photograph corresponds to in a plant photo album used for inspecting plant equipment.
[0006] The present invention provides a plant photo album creation system that creates a plant photo album for inspecting plant equipment, comprising: an acquisition unit that acquires a plant drawing of the plant equipment; a placement data placement unit that places placement data at a predetermined position of the plant equipment shown in the plant drawing; an association unit that associates a predetermined photograph with the placement data; a linking unit that links attribute information of the photograph to the photograph; an extraction unit that extracts a miniature diagram of the plant equipment from the plant drawing; a miniature diagram placement unit that places the miniature diagram in a miniature diagram area of the plant photo album; an association unit that associates the miniature diagram with the placement data; a photo placement unit that places a photograph associated with the placement data associated with the miniature diagram in a photo area of the plant photo album; and an attribute information placement unit that places the attribute information linked to the photograph in the attribute information area of the plant photo album.
[0007] According to the present invention, a plant photo album is created by extracting a miniature diagram from a plant drawing and arranging photos of the plant equipment and their attribute information together with the miniature diagram. As a result, in the plant photo album used for inspecting the plant equipment, it becomes easy to understand which plant equipment each photo corresponds to.
[0008] Although the present invention is categorized as a system, the same effects and advantages can be obtained even when it is a method or a program.
[0009] According to the present invention, it is possible to easily understand which plant equipment each photograph corresponds to in a plant photo album used in inspecting plant equipment.
[0010] 1 is a diagram illustrating an overview of a plant photo album creation system 1. FIG. 2 is a diagram illustrating the functional configuration of the plant photo album creation system 1. FIG. 3 is a diagram illustrating a flowchart of placement data placement processing executed by a computer 10. FIG. 4 is a diagram illustrating a state in which an inspector 2 has accepted input of placement data for a predetermined position of plant equipment shown in a plant drawing displayed by an information terminal 3. FIG. 5 is a diagram illustrating a state in which the computer 10 has placed placement data on the plant drawing. FIG. 6 is a diagram illustrating a flowchart of photo processing executed by a computer 10. FIG. 7 is a diagram illustrating a flowchart of a plant photo album creation processing executed by a computer 10. FIG. 8 is a diagram illustrating a state in which the computer 10 has cut out a miniature diagram from a plant drawing. FIG. 9 is a diagram illustrating a plant photo album created by a computer 10. FIG. 10 is a diagram illustrating a flowchart of output processing executed by a computer 10.
[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following drawings, the same elements are designated by the same numbers or symbols throughout the description of the embodiments.
[0012] [Outline of Plant Photo Album Creation System 1] Figure 1 is a schematic diagram for explaining an outline of the plant photo album creation system 1. The components of the plant photo album creation system 1 will be explained based on Figure 1. The plant photo album creation system 1 is a system that creates a plant photo album for inspecting plant equipment, and is made up of at least a computer 10 having server functionality. In this embodiment, the plant photo album creation system 1 includes, in addition to the computer 10, an information terminal 3 managed by an inspector 2 who inspects the plant equipment.
[0013] The information terminals 3 are terminal devices managed by the inspectors 2, and are, for example, terminal devices such as mobile phones, smartphones, tablet terminals, personal computers, and laptop computers, as well as wearable terminals such as smart watches, smart glasses, and HMDs (Head Mounted Displays). The number of information terminals 3 can be designed appropriately depending on the number of inspectors 2.
[0014] The computer 10 has a server function and may be realized, for example, by a single computer, or may be realized by multiple computers, such as a cloud computer. In this specification, a cloud computer may refer to either a computer that uses any computer in a scalable manner to perform a specific function, or a computer that includes multiple functional modules to realize a system and uses the functions in any combination.
[0015] In addition, the plant photo album creation system 1 may include external systems, other terminals and devices, etc. in addition to the information terminal 3 and computer 10 described above, and the number, type and functions thereof are not particularly limited and can be designed as appropriate.
[0016] An outline of the processing steps when the plant photo album creation system 1 creates a plant photo album for inspecting plant equipment will be described.
[0017] The computer 10 acquires a plant drawing of the plant equipment from the information terminal 3 or the like (step S1).
[0018] The computer 10 places the placement data at a predetermined position of the plant equipment shown in the plant drawing (step S2). The computer 10 displays the plant drawing on the information terminal 3. The information terminal 3 accepts input of a predetermined position of the plant equipment shown in the displayed plant drawing from the inspector 2 and transmits the accepted position to the computer 10. The computer 10 receives this position and places the placement data at the accepted position in the plant drawing based on the received position. Note that the computer 10 may place the placement data based on AI (artificial intelligence), a preset position, or the like, without relying on input from the inspector 2.
[0019] The computer 10 associates a predetermined photograph with the placement data (step S3). The computer 10 acquires a photograph of the plant equipment taken by the information terminal 3. The computer 10 associates the acquired photograph with the placement data arranged on the plant drawing.
[0020] The computer 10 links the attribute information of the photo to the photo (step S4). The computer 10 accepts input of the attribute information of the photo associated with the placement data via the information terminal 3. The computer 10 links the accepted attribute information to the photo. Note that the computer 10 may link the attribute information based on AI, preset content, etc., without relying on input from the inspector 2.
[0021] The computer 10 extracts a miniature diagram of the plant equipment from the plant drawing (step S5). The computer 10 identifies the range of the plant equipment present in the plant drawing based on the AI, the preset plant equipment drawing, and input received from the inspector 2, and extracts the identified range as a miniature diagram of the plant equipment.
[0022] The computer 10 places the miniature diagram in a miniature diagram area in the plant photo album (step S6). The computer 10 identifies a miniature diagram area in the plant photo album based on the AI, a preset miniature diagram area in the plant photo album, and input received from the inspector 2, and places the cut-out miniature diagram in the identified miniature diagram area.
[0023] The computer 10 associates the miniature drawing with the placement data (step S7). The computer 10 identifies placement data to be associated with the placed miniature drawing based on AI, preset placement data, and reception of input from the inspector 2, and associates the placed miniature drawing with the identified placement data.
[0024] The computer 10 places the photograph associated with the placement data associated with the miniature diagram in the photograph area of the plant photo album (step S8). The computer 10 identifies the photograph area of the plant photo album based on the AI, the preset photograph area of the plant photo album, and the reception of input from the inspector 2, and places the photograph associated with the placement data associated with the miniature diagram in the identified photograph area.
[0025] The computer 10 places the attribute information linked to the photograph in an attribute information area of the plant photo album (step S9). The computer 10 identifies an attribute information area of the plant photo album based on AI, a preset attribute information area of the plant photo album, and input received from the inspector 2, and places the attribute information linked to the placed photograph in the identified attribute information area.
[0026] The computer 10 arranges the miniature drawings, photographs, and attribute information to create a plant photo album. The computer 10 then outputs the created plant photo album to the information terminal 3. In this plant photo album, photographs are associated with placement data in the plant drawing, and the miniature drawings are also associated. Furthermore, in this plant photo album, attribute information is linked to the photographs associated with the placement data. Therefore, for example, when the information terminal 3 receives input for placement data of the plant drawing it displays, it can also display the corresponding page or portion of the plant photo album that is associated with and related to the placement data.
[0027] The above is an overview of the plant photo album creation system 1. With the plant photo album creation system 1, it becomes possible to easily understand which plant equipment each photograph corresponds to in a plant photo album used for inspecting plant equipment.
[0028] [Device Configuration] Figure 2 is a block diagram showing the configuration of the plant photo album creation system 1. The device configuration of the plant photo album creation system 1 will be described with reference to Figure 2. The plant photo album creation system 1 is a system that creates a plant photo album for inspecting plant equipment and is configured with at least a computer 10. In this embodiment, the plant photo album creation system 1 is configured with the computer 10 and an information terminal 3, as described above. The plant photo album creation system 1 is a system in which the computer 10 is connected to the information terminal 3 via a network 8, such as a public line network, so as to be capable of data communication. Note that the plant photo album creation system 1 may include external systems, other terminals, devices, etc. in addition to the information terminal 3 and the computer 10, and the number, types, and functions of these may be designed as appropriate. The number of information terminals 3 may be designed as appropriate depending on the number of inspectors 2.
[0029] The information terminal 3 is the above-mentioned terminal device managed by the inspector 2 who inspects the plant equipment. The information terminal 3 includes a terminal control unit such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), etc., and includes a communication unit such as a device for enabling communication with other terminals, devices, etc. The information terminal 3 includes an input / output unit such as various devices for receiving predetermined inputs, inputting / outputting various data, etc.
[0030] The computer 10 has a server function and may be realized, for example, by a single computer or by multiple computers like a cloud computer. The computer 10 includes a control unit such as a CPU, GPU, RAM, ROM, etc., and a communication unit such as a device for enabling communication with other terminals and devices, and an acquisition unit for acquiring plant drawings of plant equipment. The computer 10 includes a memory unit such as a data storage unit using a hard disk, semiconductor memory, recording medium, memory card, etc. The computer 10 includes, as processing units, various devices for executing various processes, a placement data placement unit for placing placement data at a predetermined position of plant equipment shown in a plant drawing, an association unit for associating a predetermined photograph with the placement data, a linking unit for linking attribute information of the photograph to the photograph, an extraction unit for extracting a miniature diagram of the plant equipment from the plant drawing, a miniature diagram placement unit for placing the miniature diagram in a miniature diagram area of the plant photo book, an association unit for associating the miniature diagram with placement data, a photo placement unit for placing a photograph associated with the placement data associated with the miniature diagram in a photo area of the plant photo book, and an attribute information placement unit for placing attribute information linked to the photograph in the attribute information area of the plant photo book.
[0031] In the computer 10, the control unit loads a predetermined program, which in turn cooperates with the communication unit to realize a drawing acquisition module, a placement data reception module, a photo acquisition module, an attribute information reception module, a preview module, an edit / non-edit reception module, and an output module. Also, in the computer 10, the control unit loads a predetermined program, which in turn cooperates with the storage unit to realize a storage module. Also, in the computer 10, the control unit loads a predetermined program, which in turn cooperates with the processing unit to realize a placement data placement module, a correspondence module, a linking module, a cut-out module, a miniature diagram placement module, an association module, a photo placement module, an attribute information placement module, a determination module, and an editing module.
[0032] The following describes the processes executed by the plant photo album creation system 1, along with the processes executed by the above-mentioned modules. In this specification, each module may execute its processing as its own function, or may execute its processing via a predetermined application.
[0033] [Placement Data Placement Processing Executed by Computer 10] The placement data placement processing executed by the computer 10 will be described with reference to Fig. 3. Fig. 3 is a flowchart of the placement data placement processing executed by the computer 10. The placement data placement processing shows details of an acquisition processing (step S1) for acquiring a plant diagram of a plant device, and a placement data placement processing (step S2) for placing placement data at a predetermined position of the plant device shown in the plant diagram.
[0034] The drawing acquisition module acquires a plant drawing of the plant equipment (step S10). The plant drawing is a drawing of the plant including the plant equipment to be inspected by the inspector 2. The drawing acquisition module acquires the plant drawing from the information terminal 3 or the like. The information terminal 3 accepts a selection input, such as a tap, from the inspector 2 for the plant drawing of the plant equipment to be inspected from among the plant drawings stored in advance in the information terminal 3, and transmits the accepted plant drawing to the computer 10. The drawing acquisition module receives the plant drawing and acquires the plant drawing of the plant equipment. Note that the drawing acquisition module may execute the processing described below using the plant drawing stored in advance in the information terminal 3, rather than acquiring the plant drawing from the information terminal 3. In this case, the drawing acquisition module may display a list of plant drawings stored in the information terminal 3, accept a selection input from the list from the inspector 2, identify the plant drawing to be used, and then acquire the identified plant drawing. The drawing acquisition module may also acquire the plant drawing by other methods (such as from an external system).
[0035] The placement data receiving module accepts placement of the placement data at a predetermined position of the plant equipment shown in the plant drawing (step S11). The placement data is predetermined data for placement on the plant drawing, such as an icon, a leader line, or an arrow. In this embodiment, the placement data is described as an icon. It goes without saying that the present invention is also applicable to data other than icons. In cases other than icons, such as leader lines or arrows that have a start point and an end point, the process described below only accepts input of the start point and end point in addition to input of any point. The placement data receiving module transmits the acquired plant drawing to the information terminal 3 and displays the acquired plant drawing on the information terminal 3. The information terminal 3 accepts input operations, such as tapping, on a predetermined position of the plant equipment shown in the displayed plant drawing to accept input of the placement position of the placement data (see FIG. 4). When accepting input of the placement position of the placement data, the information terminal 3 may also accept input of the type of placement data. For example, the information terminal 3 may accept input of the type of placement data (icon, leader line, arrow, etc.) before or after accepting input of the placement position of the placement data.
[0036] Referring to FIG. 4 , the state in which the placement data receiving module receives placement data will be described. This figure is a schematic diagram illustrating a state in which the inspector 2 receives input for placement of placement data for a predetermined position of plant equipment shown in a plant drawing displayed by the information terminal 3. The figure illustrates a state in which the information terminal 3 displays a plant drawing 20. The inspector 2 inputs the desired placement position of the placement data by tapping or the like. FIG. 4 illustrates a state in which the inspector 2 taps a placement position 22 as a predetermined position (nearby, around, above, etc.) of a plant equipment 21 shown in the plant drawing 20. The information terminal 3 transmits the coordinates of this placement position 22 to the computer 10 as the placement position of the placement data. For example, the information terminal 3 sets a predetermined point on the plant drawing 20 as the origin, and the coordinates of the point input by the inspector 2 corresponding to this origin are set as the coordinates of the placement position 22. The information terminal 3 transmits the coordinates of the placement position 22 to the computer 10. At this time, if the information terminal 3 has accepted input of the type of placement data, it also transmits this type of placement data to the computer 10. The placement data acceptance module receives this coordinate and accepts the placement of the placement data at a predetermined position of the plant device 21 shown in the plant drawing 20. If the information terminal 3 has transmitted the type of placement data, the placement data acceptance module receives this type and also accepts the type of placement data.
[0037] Returning to FIG. 3 , the rest of the placement data placement process will be described. The placement data placement module places the placement data at a predetermined position of the plant equipment shown in the plant drawing (step S12). The placement data placement module places the placement data at the placement position 22 of the received placement data (see FIG. 5 ). The placement data placement module identifies the placement position 22 of the placement data in the plant drawing 20 based on the coordinates of the received placement position 22, and places the placement data at the identified placement position 22. At this time, if the type of placement data has been received, the placement data according to this type is placed. In this embodiment, as described above, the placement data is an icon, so the placement data placement module places the icon at the placement position of the placement data.
[0038] The placement data placed by the placement data placement module will be described with reference to Figure 5. This figure is a diagram schematically illustrating the state in which the placement data placement module has placed the placement data on a plant drawing. The placement data placement module places an icon 23 as placement data at a predetermined position (accepted placement position 22) of a plant device 21 on the plant drawing 20. The placement data placement module places the icon 23 at a position based on the coordinates of the placement position 22 accepted in Figure 4.
[0039] When placing the placement data on the plant drawing, the computer 10 may determine the placement position without relying on input from the inspector 2 and place the placement data in the determined placement position. If the computer 10 does not rely on input from the inspector 2, the processing of step S11 may be omitted. In this case, the computer 10 may determine the placement position using AI, may determine the placement position based on a preset placement position, or may determine the placement position using other methods. When using AI, for example, the computer 10 may determine the placement position of the placement data (which may include the type of placement data) using a learning model that has previously learned the plant equipment in the plant drawing and the placement positions of the placement data. Furthermore, if the placement position is a preset position, the position of the plant equipment in the plant drawing and the placement position of the placement data (which may include the type of placement data) may be previously set, and the set placement position may be determined as the placement position of the placement data. Similarly, when using other methods, the placement position of the placement data may be determined as appropriate. In these cases, the type of placement data may also be determined, and the placement data placement module may place the placement data based on the determined placement position.
[0040] The above is the placement data placement process.
[0041] [Photo Processing Executed by Computer 10] The photo processing executed by the computer 10 will be described with reference to Fig. 6. This figure is a flowchart of the photo processing executed by the computer 10. The photo processing includes details of a photo association process (step S3) that associates a predetermined photo with layout data, and a linking process (step S4) that links photo attribute information to the photo.
[0042] The photo acquisition module acquires a predetermined photo to be associated with the placement data (step S20). The predetermined photo is a photograph of actual plant equipment corresponding to the plant equipment in the plant drawing where the placement data is placed. This photo may include a blackboard describing the shooting conditions. Including a blackboard in the photo may mean placing an actual blackboard near the plant equipment when photographing the plant equipment, or combining a virtual blackboard (electronic small blackboard) with a photograph of the plant equipment. The photo acquisition module acquires photographs of the plant equipment from the information terminal 3 or the like. The information terminal 3 accepts a selection input, such as a tap, from the inspector 2 on a photo of the plant equipment to be associated with the placement data, and transmits the accepted photo to the computer 10. Alternatively, the information terminal 3 launches a photography application or the like, accepts input, such as input related to photographing the plant equipment, from the inspector 2, photographs the plant equipment, and transmits the photograph to the computer 10. The photo acquisition module receives this photo and acquires a predetermined photo to be associated with the placement data. The number of photos acquired by the photo acquisition module is not particularly limited. The photo acquisition module may execute the process described below using photos stored in advance by itself, rather than acquiring photos from the information terminal 3. In this case, the photo acquisition module may display a list of photos stored in itself on the information terminal 3, accept selection input from the inspector 2 on this list, identify the photos to be used this time, and acquire the identified photos. The photo acquisition module may also acquire photos by other methods.
[0043] The association module associates a predetermined photograph with the placement data (step S21). The association module associates the acquired photograph with the placement data placed on the plant drawing. In the case of Figure 5, the association module associates the acquired photograph with an icon 23 placed at a predetermined position of the plant equipment 21 on the plant drawing 20. If multiple photographs have been acquired, the association module associates the multiple photographs with the icon 23.
[0044] The attribute information receiving module receives input of attribute information for the photograph (step S22). The attribute information is information about the plant equipment shown in the photograph, such as the name, model, type, manufacturer, and installation location. Furthermore, this attribute information includes a link to a digital form. The digital form is an electronic form prepared separately from the plant photo album. The link means that the plant photo album is associated with the attribute information, such as a predetermined tag. Including a link means, for example, that a predetermined tag is included as attribute information. The attribute information receiving module transmits input data for the attribute information of the acquired photograph to the information terminal 3. This input data includes an input form for the attribute information, a photograph for inputting the attribute information, and the like. The information terminal 3 receives this input data and displays it via a predetermined UI (User Interface). The information terminal 3 receives direct text input into the displayed input form, selection input into options, and the like from the inspector 2. The information terminal 3 accepts input of attribute information of the photo, for example, by accepting direct input of text regarding the name, type, installation location, etc. via a virtual keyboard, etc., or by accepting selection input such as tapping on each option for the name, type, installation location, etc. The information terminal 3 transmits the accepted attribute information to the computer 10. The attribute information accepting module receives this attribute information and accepts the attribute information of the photo.
[0045] The linking module links the attribute information to the photograph (step S23). The linking module links the attribute information of the received photograph to the photograph. As a result, the linking module also links the attribute information to the placement data associated with the photograph to which the attribute information is linked. In the case of FIG. 5, the linking module links the attribute information to the photograph associated with the icon 23 placed at a predetermined position of the plant equipment 21 in the plant drawing 20.
[0046] Note that when linking attribute information to a photograph, the computer 10 may link the attribute information to the photograph without relying on input from the inspector 2. If the computer 10 does not rely on input from the inspector 2, the processing of step S22 may be omitted. In this case, the computer 10 may link the attribute information to the photograph using AI, may link preset attribute information to the photograph, or may link the attribute information to the photograph by any other method. When using AI, for example, the computer 10 may determine attribute information for the acquired photograph using a learning model that has previously learned photos of plant equipment and attribute information of the plant equipment, and link the determined attribute information to the acquired photograph. Furthermore, when preset attribute information is used, the computer 10 may previously set photos of plant equipment and attribute information, and link the attribute information set for the acquired photograph to the acquired photograph. Furthermore, when any other method is used, attribute information may be linked to the photograph as appropriate.
[0047] This is the photo processing.
[0048] [Plant Photo Album Creation Process Executed by Computer 10] The plant photo album creation process executed by the computer 10 will be described with reference to Figure 7. This figure is a flowchart of the plant photo album creation process executed by the computer 10. The plant photo album creation process includes details of an extraction process (step S5) that extracts a miniature diagram of plant equipment from a plant drawing, a miniature diagram placement process (step S6) that places the miniature diagram in a miniature diagram area of the plant photo album, an association process (step S7) that associates the miniature diagram with placement data, a photo placement process (step S8) that places a photo associated with the placement data in a photo area of the plant photo album, and an attribute information placement process (step S9) that places attribute information linked to the photo in an attribute information area of the plant photo album.
[0049] The cutout module cuts out a miniature diagram of the plant equipment from the plant drawing (step S30). The miniature diagram is a diagram that provides additional explanation of the plant equipment shown in the acquired photograph. The cutout module identifies the cutout range of the plant equipment present in the plant drawing based on AI, preset plant equipment drawings, and input received from the inspector 2, and cuts out the identified cutout range as a miniature diagram of the plant equipment (see FIG. 8). Note that the method by which the cutout module cuts out the miniature diagram is not limited to the example described above and can be designed as appropriate.
[0050] The following describes a case where the cutout module cuts out a miniature diagram using AI. The cutout module uses a learning model that has learned from the plant equipment drawings to identify the cutout range of the plant equipment shown in the acquired plant drawing, and cuts out the identified cutout range of the plant equipment as a miniature diagram.
[0051] The following describes a case where the cutout module cuts out a miniature diagram using a preset plant equipment drawing. The cutout module references the preset plant equipment drawing, identifies the cutout range of the plant equipment shown in the acquired plant drawing, and cuts out the identified cutout range of the plant equipment as a miniature diagram.
[0052] A case will be described in which the cutout module cuts out a miniature diagram using input from the inspector 2. The computer 10 transmits the acquired plant drawing to the information terminal 3. The information terminal 3 receives this plant drawing and displays it via a predetermined UI. The information terminal 3 accepts input from the inspector 2 of a cutout range to be cut out as a miniature diagram on the plant drawing. The information terminal 3 accepts this input, for example, by surrounding a predetermined range on the plant drawing with a predetermined shape (rectangle, circle, etc.). The information terminal 3 transmits the accepted cutout range to the computer 10. The computer 10 receives this cutout range. The cutout module cuts out the range of the plant drawing that corresponds to the received cutout range as a miniature diagram.
[0053] Referring to FIG. 8, the state in which the cutout module cuts out a miniature diagram will be described. This figure is a diagram schematically illustrating the state in which the cutout module cuts out a miniature diagram from a plant diagram. The plant diagram 20 is the same as that shown in FIG. 5 described above. The cutout module specifies a cutout range 24 based on AI, a preset drawing of the plant equipment, input from the inspector 2, etc. The cutout module cuts out a miniature diagram 25 from the plant diagram 20 based on the specified cutout range 24. This miniature diagram 25 may cut out only the plant equipment 21 shown in the plant diagram 20, or may cut out the plant equipment 21 and its surroundings in addition to the plant equipment 21.
[0054] Returning to Figure 7, the rest of the plant photo album creation process will be explained. The miniature diagram placement module places the miniature diagram in the miniature diagram area of the plant photo album (step S31). The miniature diagram area is the area in the plant photo album where the miniature diagram is placed. The miniature diagram placement module identifies the miniature diagram area in the plant photo album based on AI, a preset miniature diagram area in the plant photo album, and input received from the inspector 2, and places the miniature diagram in the identified miniature diagram area. Note that the method by which the miniature diagram placement module places the miniature diagram in the miniature diagram area of the plant photo album is not limited to the example described above and can be designed as appropriate.
[0055] The following describes a case where the miniature diagram placement module uses AI to place a miniature diagram in a miniature diagram area of a plant photo album. The miniature diagram placement module uses a learning model or the like that has learned the miniature diagram area of the plant photo album to identify a miniature diagram area in the plant photo album where the cut-out miniature diagram is to be placed, and places the cut-out miniature diagram in the identified miniature diagram area.
[0056] The following describes a case where the miniature diagram placement module uses a preset miniature diagram area in a plant photo album to place a miniature diagram in the miniature diagram area in the plant photo album. The miniature diagram placement module references the preset miniature diagram area in the plant photo album, identifies the miniature diagram area in the plant photo album where the cut-out miniature diagram is to be placed, and places the cut-out miniature diagram in the identified miniature diagram area.
[0057] A case will be described in which the miniature diagram placement module places a miniature diagram in a miniature diagram area of a plant photo album using input from an inspector 2. The computer 10 transmits the plant photo album to the information terminal 3. In this case, the plant photo album may be blank or may contain some information. The information terminal 3 receives the plant photo album and displays the plant photo album via a predetermined UI. The information terminal 3 receives input from the inspector 2 of a miniature diagram area in the plant photo album where the miniature diagram will be placed. The information terminal 3 receives this input, for example, by inputting an arbitrary point that surrounds a predetermined area in the plant photo album with a predetermined shape (rectangle, circle, etc.). The information terminal 3 transmits the received miniature diagram area to the computer 10. The computer 10 receives this miniature diagram area. The miniature diagram placement module places the cut-out miniature diagram in an area of the plant photo album that corresponds to the received miniature diagram area.
[0058] The association module associates the miniature diagram with the placement data (step S32). The association module associates the miniature diagram cut out from the plant drawing and arranged in the plant photo album with the placement data arranged on the plant drawing. The association module associates the miniature diagram with the placement data based on AI, preset placement data, input from the inspector 2, etc. Note that the method by which the association module associates the miniature diagram with the placement data is not limited to the above example and can be designed as appropriate. As a result, the association module links attribute information and also associates the miniature diagram cut out from the plant drawing with the placement data corresponding to the photo linked with this attribute information. In the case of Figures 5 and 8, the miniature diagram 25 cut out from the plant drawing 20 and arranged in the plant photo album is associated with the icon 23.
[0059] The following describes a case where the association module uses AI to associate a miniature diagram with placement data. The association module uses a learning model or the like that has learned about the cut-out miniature diagram and the placement data placed in the vicinity (surrounding, above, etc.) of the area where the miniature diagram is cut out to identify the placement data placed in the plant drawing to which the cut-out miniature diagram is to be associated, and associates the cut-out miniature diagram with the identified placement data.
[0060] The following describes a case where the association module associates a miniature figure with placement data using preset placement data. The association module identifies placement data that has been previously placed near (around, above, etc.) the area where the miniature figure is cut out as the preset placement data, and associates the cutout miniature figure with the identified placement data.
[0061] A case will be described in which the association module associates a miniature diagram with placement data using input from an inspector 2. The computer 10 transmits a plant drawing on which placement data has been placed to the information terminal 3. The information terminal 3 receives this plant drawing and displays it via a predetermined UI. The information terminal 3 accepts input of placement data to associate the extracted miniature diagram from the inspector 2. The information terminal 3 accepts this input, for example, by tapping on the placement data. The information terminal 3 transmits the accepted placement data to the computer 10. The computer 10 receives this placement data. The association module associates the extracted miniature diagram with the placement data that has been placed on the plant drawing corresponding to the received placement data.
[0062] The photo placement module places the photo associated with the placement data associated with the miniature diagram in the photo area of the plant photo book (step S33). The photo area is an area in the plant photo book where the photo is placed. The photo placement module identifies a photo area in the plant photo book based on AI, a preset photo area in the plant photo book, input from inspector 2, etc., and places the photo associated with the placement data associated with the miniature diagram in the identified photo area. Note that the method by which the photo placement module places the photo associated with the placement data associated with the miniature diagram in the photo area of the plant photo book is not limited to the example described above and can be designed as appropriate.
[0063] This section describes a case where a photo placement module uses AI to place a photo associated with placement data associated with a miniature diagram in a photo area of a plant photo book. The photo placement module uses a learning model or the like that has learned the photo area of the plant photo book to identify a photo area of the plant photo book in which to place a photo associated with the placement data associated with the miniature diagram, and places the photo associated with the placement data associated with the miniature diagram in the identified photo area.
[0064] The photo layout module uses a predetermined photo area in a plant photo book to place a photo associated with placement data associated with a miniature diagram in the photo area of the plant photo book. The photo layout module references the predetermined photo area in the plant photo book, identifies a photo area in the plant photo book in which to place the photo associated with the placement data associated with the miniature diagram, and places the photo associated with the placement data associated with the miniature diagram in the identified photo area.
[0065] The following describes a case in which the photo placement module uses input from the inspector 2 to place photos associated with placement data associated with the miniature drawings in a photo area of the plant photo book. The computer 10 transmits the plant photo book to the information terminal 3. In this case, the plant photo book may be blank or may contain information (such as the placed miniature drawings). The information terminal 3 receives the plant photo book and displays it via a specified UI. The information terminal 3 accepts input from the inspector 2 of a photo area in the plant photo book where the photos associated with the placement data associated with the miniature drawings will be placed. The information terminal 3 accepts this input, for example, by inputting an arbitrary point that surrounds a specified area in the plant photo book with a specified shape (rectangle, circle, etc.). The information terminal 3 transmits the accepted photo area to the computer 10. The computer 10 receives this photo area. The photo placement module places the photo associated with the placement data associated with the miniature diagram in an area of the plant photo album that corresponds to the received photo area.
[0066] The attribute information placement module places the attribute information linked to the photograph in an attribute information area of the plant photo album (step S34). The attribute information area is an area in the plant photo album where attribute information is placed. The attribute information placement module identifies an attribute information area in the plant photo album based on AI, a preset attribute information area in the plant photo album, and input received from inspector 2, and places the attribute information linked to the photograph placed in the photo area in the identified attribute information area. Note that the method by which the attribute information placement module places the attribute information linked to the photograph placed in the photo area in the attribute information area of the plant photo album is not limited to the example described above and can be designed as appropriate.
[0067] The following describes a case where an attribute information placement module uses AI to place attribute information linked to a photo in an attribute information area of a plant photo album. The attribute information placement module uses a learning model or the like that has learned the attribute information area of the plant photo album to identify an attribute information photo area in the plant photo album where attribute information linked to the photo placed in the photo area is to be placed, and places the attribute information linked to the photo placed in the identified attribute information area.
[0068] The following describes a case where an attribute information placement module uses a preset attribute information area of a plant photo album to place attribute information linked to a photo placed in a photo area in the attribute information area of the plant photo album. The attribute information placement module references the preset attribute information area of the plant photo album, identifies an attribute information area of the plant photo album in which to place the attribute information linked to the photo placed in the photo area, and places the attribute information linked to the photo placed in the photo area in the identified attribute information area.
[0069] A case will be described in which the attribute information placement module places attribute information linked to a photograph placed in a photo area in an attribute information area of a plant photo album using input from an inspector 2. The computer 10 transmits the plant photo album to the information terminal 3. In this case, the plant photo album may be blank or may contain information (such as a miniature diagram or photograph). The information terminal 3 receives the plant photo album and displays it via a predetermined UI. The information terminal 3 accepts input from the inspector 2 of an attribute information area in the plant photo album in which attribute information linked to a photograph placed in the photo area is to be placed. The information terminal 3 accepts this input, for example, by inputting an arbitrary point that surrounds a predetermined area in the plant photo album with a predetermined shape (such as a rectangle or a circle). The information terminal 3 transmits the accepted attribute information area to the computer 10. The computer 10 receives this attribute information area. The attribute information placement module places the attribute information linked to the photo placed in the photo area in the area of the plant photo album that corresponds to the received attribute information area.
[0070] The above is the process for creating a plant photo album. The computer 10 arranges the miniature drawings, photos, and attribute information in the plant photo album to create the plant photo album (see FIG. 9). The computer 10 uses the plant photo album created in this way to execute the processes described below.
[0071] Referring to FIG. 9 , a plant photo album created by the computer 10 will be described. This figure is a schematic diagram of a plant photo album created by the computer 10. The figure shows a plant photo album 30. The plant photo album 30 includes a miniature diagram area 31 in which a miniature diagram 25 is arranged by the processing of step S31, a photo area 32 (32a, 32b) in which a photo associated with the miniature diagram 25 is arranged by the processing of step S33, and an attribute information area 33 (33a, 33b) in which attribute information associated with the photo arranged in the photo area 32 is arranged by the processing of step S34. The miniature diagram area 31 is located at a position determined by the processing of step S31, the photo area 32 is located at a position determined by the processing of step S33, and the attribute information area 33 is located at a position determined by the processing of step S34. The computer 10 outputs the plant photo album 30 to the information terminal 3. When the information terminal 3 receives an input such as a tap from the inspector 2 on an icon 23 present on the plant drawing 20, the computer 10 causes the information terminal 3 to display the photo associated with this icon 23, the miniature diagram associated with this icon 23, and the page or relevant section of the plant photo album 30 in which the attribute information linked to this photo is arranged. Furthermore, when the computer 10 receives an input from the information terminal 3 for a link to a digital form included in the attribute information in the plant photo album 30 to be output, the computer 10 outputs the linked digital form to the information terminal 3. In this case, the computer 10 transmits the linked digital form to the information terminal 3, displays it, and outputs the digital form to the information terminal 3.
[0072] [Output Processing Executed by Computer 10] The output processing executed by the computer 10 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the output processing executed by the computer 10.
[0073] The preview module outputs a preview of the plant photo album (step S40). The preview is a process in which the computer 10 simulates the results of the plant photo album created by the plant photo album creation process and outputs the simulated results on the screen of the information terminal 3 before actually outputting the plant photo album. The preview module transmits a preview of the plant photo album created as a result of the plant photo album creation process to the information terminal 3. The information terminal 3 receives the preview of the plant photo album and displays the preview of the plant photo album via a predetermined UI. The preview module outputs a preview of the plant photo album by displaying the preview of the plant photo album created as a result of the plant photo album creation process on the information terminal 3. In the case of FIG. 9 , the preview module transmits a preview of the plant photo album 30 to the information terminal 3 and displays it, thereby outputting a preview of the plant photo album 30.
[0074] The editing / non-editing reception module accepts whether or not the plant photo album is to be edited (step S41). The information terminal 3 accepts inputs, such as input of a predetermined icon, changes to the layout of each area, and changes to the input content of each area, for the displayed preview of the plant photo album 30. For example, if editing is not necessary, the information terminal 3 accepts input, such as tapping on an icon indicating that editing is not necessary, from the inspector 2. Furthermore, for example, if changing the layout of each area, the information terminal 3 accepts input, such as tapping or dragging, from the inspector 2 on the area to be changed (e.g., dragging an area when changing the layout of an area). Furthermore, for example, if changing the content of an area, the information terminal 3 accepts input, such as input into a predetermined input form for changing the content, from the inspector 2. The information terminal 3 transmits the accepted input content to the computer 10 as editing data. The editing / non-editing reception module receives this editing data and accepts whether or not the plant photo album is to be edited.
[0075] The determination module determines whether or not editing has occurred (step S42). The determination module makes this determination based on whether or not a predetermined icon has been input in the received edited data, whether or not there has been a change to the area, whether or not there has been a change to the content of the area, etc.
[0076] If the determination module determines that editing has occurred (step S42: YES), the editing module edits at least one of the miniature diagram, the photo, and the attribute information while outputting the preview (step S43). The editing module edits the plant photo album based on the received editing data. The editing performed by the editing module includes rearranging, deleting, changing, etc., at least one of the miniature diagram, the photo, and the attribute information. If a change to an area is received, the editing module changes the layout position of the area. For example, if the editing module receives a change to the layout position of the miniature diagram area, it changes the layout position of the miniature diagram area to the changed layout position. Furthermore, if the editing module receives a change to swap the layout positions of the miniature diagram area and the photo area, it swaps the layout positions of the miniature diagram area and the photo area. If a change to the content of an area is received, the editing module changes the content of the area. For example, if the editing module receives a change to the content of the attribute information area, it changes the content of the attribute information area to the content of the changed attribute information. Furthermore, when the editing module receives a change to the miniature diagram or photo, it changes the arranged miniature diagram or photo to the changed miniature diagram or photo.
[0077] The computer 10 repeats the processes of steps S41 to S43 until the inspector 2 completes the editing, and when the editing is completed, executes the process of step S44 described below. Completion of editing may be determined, for example, in the process of step S42, when the information terminal 3 receives an input such as a tap on an icon indicating that editing is not required, and the editing presence / absence receiving module receives this edited data, etc.
[0078] If the determination module determines that no editing has been performed (NO in step S42), the output module outputs the plant photo album (step S44). The output module may output the created plant photo album in a predetermined data format (document data, spreadsheet data, presentation data, Portable Document Format (PDF) data, Comma Separated Values (CSV) data, etc.), or may output the data to a printer or external recording device connected to the computer 10 for data communication, or may output the data to the information terminal 3. When the output module outputs the plant photo album in a predetermined data format, the computer 10 converts the plant photo album into a predetermined data format or a data format accepted by the inspector 2. The conversion method is not particularly limited, and any known data conversion method may be used. The output module may store the converted plant photo album in a storage module, transmit it to the information terminal 3, print it on a printing device, or store it in an external recording device. When the output module outputs to a printing device, the computer 10 may cause the printing device to print the plant photo album. The output module transmits the plant photo album and a command to print the plant photo album to the printing device. The printing device receives the plant photo album and the command and prints the plant photo album in accordance with the command. When the output module outputs to an external recording device, the computer 10 may store the plant photo album in the external recording device. The output module transmits the plant photo album and a command to store the plant photo album to the external recording device. The external recording device receives the plant photo album and the command and stores the plant photo album in accordance with the command. When the output module outputs the plant photo album to the information terminal 3, the computer 10 transmits the plant photo album to the information terminal 3. The information terminal 3 receives the plant photo album and displays the plant photo album via a predetermined UI.The output module may be any module that transmits the plant photo album to the information terminal 3 and displays it. When the output module outputs the plant photo album, it may be based on input for the layout data placed on the plant drawing, or it may be based on other input. The output module performs this process for all pages of the plant photo album.
[0079] This completes the output process.
[0080] Although the above-described processes are described as separate processes, the computer 10 can be configured to execute a combination of some or all of the above-described processes. Furthermore, the computer 10 can also be configured to execute each process at a timing other than the timing described. Furthermore, although the above-described processes are described as processes executed by the computer 10, some or all of the processes can also be executed by the information terminal 3, or by a predetermined application installed on the information terminal 3.
[0081] The above-described means and functions are realized by a computer (including a CPU, an information processing device, and various terminals) reading and executing a predetermined program. The program may be provided, for example, from a computer via a network (Software as a Service (SaaS)) or as a cloud service. The program may also be provided in a form recorded on a computer-readable recording medium. In this case, the computer reads the program from the recording medium, transfers it to an internal or external recording device, records it, and executes it. The program may also be pre-recorded on a recording device (recording medium) and provided to the computer from the recording device via a communication line.
[0082] Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments. Furthermore, the effects described in the embodiments of the present invention are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments of the present invention.
[0083] A first aspect disclosed in this embodiment is a plant photo album creation system that creates a plant photo album for inspecting plant equipment, comprising: an acquisition unit that acquires a plant drawing of the plant equipment; a placement data placement unit that places placement data at a predetermined position of the plant equipment shown in the plant drawing; an association unit that associates a predetermined photo with the placement data; a linking unit that links attribute information of the photo to the photo; an extraction unit that extracts a miniature diagram of the plant equipment from the plant drawing; a miniature diagram placement unit that places the miniature diagram in a miniature diagram area of the plant photo album; an association unit that associates the miniature diagram with the placement data; a photo placement unit that places a photo associated with the placement data associated with the miniature diagram in a photo area of the plant photo album; and an attribute information placement unit that places the attribute information linked to the photo in the attribute information area of the plant photo album.
[0084] A second aspect disclosed in the present embodiment provides the plant photo album creation system according to the first aspect, further comprising: a preview output unit that outputs a preview of the plant photo album.
[0085] A third aspect disclosed in this embodiment provides a plant photo album creation system according to the second aspect, further comprising an editing unit that edits at least one of the diagram, the photo, and the attribute information while the preview is being output.
[0086] A fourth aspect disclosed in the present embodiment provides the plant photo album creation system according to the first aspect, wherein the arranged photos include a blackboard.
[0087] A fifth aspect disclosed in the present embodiment provides the plant photo album creation system according to the first aspect, wherein the arranged attribute information includes a link to a digital form.
[0088] REFERENCE SIGNS LIST 1 Plant photo album creation system 2 Inspector 3 Information terminal 8 Network 10 Computer 20 Plant drawing 21 Plant equipment 22 Layout position 23 Icon 24 Extraction range 25 Miniature diagram 30 Plant photo album 31 Miniature diagram area 32 Photo area 33 Attribute information area
Claims
1. A plant photo album creation system that creates a plant photo album for inspecting plant equipment, comprising: an acquisition unit that acquires a plant drawing of the plant equipment; a placement data placement unit that places placement data at a predetermined position of the plant equipment shown in the plant drawing; an association unit that associates a predetermined photo with the placement data; a linking unit that links attribute information of the photo to the photo; an extraction unit that extracts a miniature diagram of the plant equipment from the plant drawing; a miniature diagram placement unit that places the miniature diagram in a miniature diagram area of the plant photo album; an association unit that associates the miniature diagram with the placement data; a photo placement unit that places a photo associated with the placement data associated with the miniature diagram in a photo area of the plant photo album; and an attribute information placement unit that places the attribute information linked to the photo in the attribute information area of the plant photo album.
2. The plant photo album creation system according to claim 1, further comprising a preview output unit that outputs a preview of the plant photo album.
3. The plant photo album creation system according to claim 2, further comprising an editing unit that edits at least one of the miniature diagram, the photo, and the attribute information while the preview is being output.
4. The plant photo album creation system according to claim 1, wherein the arranged photos include a blackboard.
5. The plant photo album creation system according to claim 1, wherein the arranged attribute information includes a link to a digital form.
6. A plant photo album creation method executed by a computer that creates a plant photo album for inspecting plant equipment, comprising the steps of: acquiring a plant drawing of the plant equipment; placing placement data at a predetermined position of the plant equipment shown in the plant drawing; associating a predetermined photograph with the placement data; linking attribute information of the photograph to the photograph; extracting a miniature diagram of the plant equipment from the plant drawing; placing the miniature diagram in a miniature diagram area of the plant photo album; associating the miniature diagram with the placement data; placing a photograph associated with the placement data associated with the miniature diagram in a photo area of the plant photo album; and placing the attribute information linked to the photograph in an attribute information area of the plant photo album.
7. A computer-readable program for causing a computer that creates a plant photo album for inspecting plant equipment to execute the following steps on a computer that creates a plant photo album for inspecting plant equipment: acquiring a plant drawing of the plant equipment; placing placement data at a predetermined position of the plant equipment shown in the plant drawing; associating a predetermined photograph with the placement data; linking attribute information of the photograph to the photograph; extracting a miniature diagram of the plant equipment from the plant drawing; placing the miniature diagram in a miniature diagram area of the plant photo album; associating the miniature diagram with the placement data; placing a photograph associated with the placement data associated with the miniature diagram in a photo area of the plant photo album; and placing the attribute information linked to the photograph in an attribute information area of the plant photo album.
Citation Information
Patent Citations
Photograph management support system and program
JP2022170154A
Composite image generation system, composite image generation method, and program
JP7507987B1