Update board design support system

The update panel design support system uses a camera and gyro sensor to efficiently update panel designs by associating real-time image data with 3D structural diagrams, addressing inefficiencies in manual measurement and photography errors.

JP7612559B2Active Publication Date: 2025-01-14TMEIC CORP (100 00)
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021198546
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-12-07
Publication Date
2025-01-14
Estimated Expiration
2041-12-07

AI Technical Summary

Technical Problem

Existing panel update processes in plant renewal engineering are inefficient due to manual measurements and photography errors, leading to potential redesigns and reduced productivity.

Method used

An update panel design support system utilizing a camera and gyro sensor to acquire image data and position/angle information, which is used to search and associate three-dimensional structural diagrams with a database, enabling accurate and efficient updating of panel designs.

Benefits of technology

The system streamlines the update process by providing precise 3D structural diagrams, improving productivity and reducing the need for re-designs by accurately reflecting actual panel configurations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007612559000001
    Figure 0007612559000001
  • Figure 0007612559000002
    Figure 0007612559000002
  • Figure 0007612559000003
    Figure 0007612559000003
Patent Text Reader

Abstract

To provide a replacement panel design support system for streamlining update work and replacement panel design work for an existing panel.SOLUTION: An embodiment is provided with image data acquisition means for acquiring first image data of an entire existing panel; position and angle information detection means for detecting first position information and first angle information of the image data acquisition means; first database storage means including a first three-dimensional structure drawing of the entire existing panel and a second three-dimensional structure drawing corresponding to a unit; and a processing device for retrieving and extracting the first three-dimensional structure drawing from the first database storage means, besed on the feature quantity of the first image data.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] An embodiment of the present invention relates to a replacement panel design support system for use in plant replacement engineering. [Background technology]

[0002] In plants that are already in operation, equipment may be replaced or new equipment may be introduced. In such plant renewal engineering work, the latest expansion and connection diagram for the plant is obtained. Even if it is the latest expansion and connection diagram, it is often the case that corrections and changes are made depending on the time without being reflected in the drawing. Therefore, it is necessary to investigate the status of the panels installed at the actual site and update the expansion and connection diagram.

[0003] Previously, on-site surveys would involve measuring the dimensions of the equipment inside the existing panel using a tape measure and taking numerous photographs, then this data would be brought back to update the connection diagram, and the renewal design would then be carried out on paper based on the updated connection diagram.

[0004] Therefore, depending on the know-how of the on-site surveyor, measurements or photographs may be missed, making it necessary to conduct the on-site survey again. If it is discovered that necessary information is missing in the final stages of the renewal design, redesign may be required, which significantly reduces the productivity of the renewal design.

[0005] For example, Patent Document 1 describes designing a control panel using a three-dimensional model (3D structural drawing). Currently, such 3D structural drawings are generally easy to prepare, and their use is being promoted. In addition to electrical circuit information for the development and connection diagram, 3D structural drawings can also be associated with information on the dimensions of panels, units, etc. and stored in a database, and their use in the design work of updated panels is expected to improve productivity. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 6-314318 Summary of the Invention [Problem to be solved by the invention]

[0007] An embodiment of the present invention has been made to solve the above-mentioned problems, and aims to provide an update panel design support system that improves the efficiency of update work for existing panels and update panel design work. [Means for solving the problem]

[0008] An embodiment of the present invention includes an image data acquisition means for acquiring first image data including the entire existing panel installed in a plant, a position angle information detection means for detecting first position information and first angle information of the image data acquisition means, a first database storage means including a first three-dimensional structural drawing representing the entire existing panel and a second three-dimensional structural drawing corresponding to a unit constituting the existing panel, and a processing device for searching and extracting the first three-dimensional structural drawing from the first database means based on a feature amount of the first image data. After acquiring the first image data, the image data acquisition means acquires second image data acquired by photographing a part of the existing panel. The position angle information detection means detects the second position information and first angle information of the image data acquisition means when the second image data is acquired. Location information and the second Angle Information The processing device searches for and extracts the second three-dimensional structural drawing from the first database means based on the second image data, and associates the second three-dimensional structural drawing with the first three-dimensional structural drawing based on the distance between the image data acquisition means and the existing panel, the first position information, the first angle information, the second position information, and the second angle information. Effect of the Invention

[0009] In this embodiment, an update panel design support system is realized that improves the efficiency of update work for existing panels and update panel design work. [Brief description of the drawings]

[0010] [Figure 1] 1 is a schematic block diagram illustrating an updated board design support system according to an embodiment; [Diagram 2] 2(a) and 2(b) are schematic diagrams illustrating a part of an updated board design support system according to an embodiment. [Diagram 3] FIG. 2 is a schematic diagram for explaining the operation of the updated board design support system according to the embodiment. [Figure 4] 4(a) and 4(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. [Diagram 5] 5(a) and 5(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. [Figure 6] 6(a) and 6(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. [Figure 7] 7(a) and 7(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. [Figure 8] 8(a) and 8(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. [Figure 9] 1 is an example of a flowchart for explaining an operation of the updated board design support system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The drawings are schematic or conceptual, and the relationship between the thickness and width of each part, the size ratio between parts, etc. are not necessarily the same as in reality. Even when the same part is shown, the dimensions and ratios of each part may be different depending on the drawing. In this specification and each drawing, elements similar to those described above with reference to the previous drawings are given the same reference numerals and detailed description thereof will be omitted as appropriate.

[0012] FIG. 1 is a schematic block diagram illustrating an updated board design support system according to an embodiment. As shown in Fig. 1, the renewal board design support system 100 includes a camera (image data acquisition means) 13, a gyro sensor (position angle information detection means) 14, and a processing device 2. The camera 13 and the gyro sensor 14 are communicatively connected to the processing device 2. In this example, the camera 13 and the gyro sensor 14 are communicatively connected to a communication device 11, and the processing device 2 is communicatively connected to a communication device 10. The communication devices 10 and 11 are communicatively connected to each other via a communication line. As long as the camera 13 and the gyro sensor 14 can be communicatively connected to the processing device 2, the communication connection path is not limited to this.

[0013] The camera 13 and the gyro sensor 14 are, for example, a portable terminal that is integrated. This portable terminal preferably has a display unit that can display the captured image and can display information transmitted by the processing device 2. A portable terminal in which the camera 13 and the gyro sensor 14 are integrated may be referred to as the camera 13, etc. below. The gyro sensor 14 has a position detection function. Since the camera 13, etc. is integrated with the gyro sensor 14, the gyro sensor 14 can collect information on the position and angle of the camera 13. The camera 13, etc. transmits information on the position and angle of the camera 13 acquired by the gyro sensor 14 to the communication device 11 together with image data acquired by the camera 13.

[0014] The processing device 2 is communicatively connected to the communication device 10, and receives image data from the camera 13 etc., and information on the position and angle of the camera 13 etc., transmitted via the communication devices 11, 10. The processing device 2 is connected to an input device 8 such as a keyboard and a mouse, and executes a predetermined process based on the information from the communication device 10 and the input information from the input device 8, and outputs a desired output to, for example, a display device 1 connected to the processing device 2.

[0015] A configuration example of the processing device 2 will be described. The processing device 2 has an arithmetic processing unit 4 and an image processing unit 3. The arithmetic processing unit 4 executes a predetermined process based on input information. The predetermined process is, for example, an image recognition function executed according to a program stored in a storage device (not shown). The image processing unit 3 executes image processing to obtain a desired display output based on the results of calculations performed by the arithmetic processing unit 4, for example, according to information input from an input device 8.

[0016] The processing device 2 further has a 3D structural drawing CAD processing unit 6, an existing board 3D structural drawing library 5, and an updated board 3D structural drawing library 7. The 3D structural drawing CAD processing unit 6 accesses the existing board 3D structural drawing library 5 and the updated board 3D structural drawing library 7, and creates, edits, and deletes each 3D structural drawing by using the 3D structural drawing CAD processing unit 6. The processing device 2 also performs design work for the updated board using the 3D structural drawing stored in the 3D structural drawing library by the calculation processing unit 4, image processing unit 3, and 3D structural drawing CAD processing unit 6. The 3D structural drawing is structural drawing data created by three-dimensional (3D) CAD and can be used with software compatible with 3D CAD, and as described below, it is possible to associate the dimensions of each part as well as electrical connection information, etc.

[0017] The processing device 2 is, for example, an information processing device operated by an arithmetic processing device, such as a computer terminal or a server, etc. The communication devices 10 and 11 are, for example, access points for wireless communication, etc.

[0018] The on-site surveyor 12 carries a camera 13 or the like and goes to the site where the existing panel 15 is installed, and photographs the existing panel 15. The photographed image data of the existing panel 15 is transmitted to the processing device 2 via the communication devices 11, 10 together with information on the position and angle of the camera 13 or the like. The processing device 2 searches the existing panel 3D structural drawing library 5 for 3D structural drawings corresponding to the existing panel 15 and the units 17 etc. mounted on the existing panel 15, based on the received image data and the information on the position and angle of the camera 13 etc.

[0019] The processing device 2 updates the information of the 3D structural drawing corresponding to the existing panel 15 based on image data of the existing panel 15 and information on the position and angle of the camera 13, etc. Updating the information of the 3D structural drawing means modifying the information of the units actually installed, etc., of the original 3D structural drawing corresponding to the existing panel 15 based on image data, etc. of the existing panel 15 installed on-site, and creating a 3D structural drawing corresponding to the latest existing panel 15 with the modified content.

[0020] 2(a) and 2(b) are schematic diagrams illustrating a part of an updated board design support system according to an embodiment. 2(a) and 2(b) show examples of 3D structural drawing databases 50, 70 stored in the existing board 3D structural drawing library 5 and the updated board 3D structural drawing library 7. As shown in FIG. 2(a), the 3D structural drawing database 50 stored in the existing board 3D structural drawing library 5 includes a 3D structural drawing 150 of the entire board. In addition, the 3D structural drawing database 70 stored in the updated board 3D structural drawing library 7 includes a 3D structural drawing 150a of the entire board. The 3D structural drawings 150, 150a of the entire board are associated with the board name, and the board name is associated with information on the dimensions of the entire board and information on the devices housed therein. The information associated with the board name may include various information for identifying the board, such as information on the installation location of the board and the serial number.

[0021] As shown in FIG. 2(b), the 3D structural drawing database 50 of the existing panel 3D structural drawing library 5 stores a 3D structural drawing 170 of a unit stored in the panel. Also, the 3D structural drawing database 70 of the updated panel 3D structural drawing library 7 stores a 3D structural drawing 170a of a new unit to be stored in the panel. In this example, the 3D structural drawing of the unit is shown as data for the 3D structural drawing 170a, but the existing panel 3D structural drawing library 5 and the updated panel 3D structural drawing library 7 store in advance 3D structural drawings of all the devices and equipment stored in the existing panel and all the devices and equipment to be stored in the updated panel.

[0022] The 3D structural diagrams of units stored in any of the 3D structural diagram libraries are associated with the unit name and unit number, and the unit number is associated with the unit's dimensional information as well as information on the installed I / O modules and connection information for the I / O modules.

[0023] In the existing panel 3D structural drawing library 5, a database is constructed using data from the time of design or the latest renewal engineering, but as mentioned above, there may be differences from the actual configuration of the existing panel at the site. In a site survey during the renewal engineering, the actual configuration of the existing panel, including differences in the configuration of the existing panel at the site, is investigated, and the 3D structural drawing database 50 of the existing panel 3D structural drawing library 5 is updated to the latest state.

[0024] In the design work for the renewal panel, the design work for the renewal panel is carried out based on the 3D structural drawing database updated to the latest state and the specifications to be updated. When the design work for the renewal panel is completed, the processing device 2 replaces the 3D structural drawing database after the design work is completed with the 3D structural drawing database of the existing panel.

[0025] The operation of the updated board design support system 100 according to the embodiment will be described. FIG. 3 is a schematic diagram for explaining the operation of the updated board design support system according to the embodiment. Figure 3 shows an existing panel 15 to be inspected on-site, a camera 13, etc. The existing panel 15 has a panel name for identifying the existing panel written on a plate 16, which is "P1102-P5" in this example. A unit 17 is provided on the existing panel 15. Note that the name of the unit 17 may be written on a plate or the like, but generally the unit name is not written on the plate.

[0026] The surveyor photographs the entire existing panel 15 and measures the distance between the camera 13 etc. and the existing panel 15 as an initial operation in order to identify the position in the image data of the photographed existing panel 15. The distance between the camera 13 etc. and the existing panel 15 is measured according to the principle of three-point surveying.

[0027] For example, the surveyor holds the camera 13, etc. almost horizontally to photograph the entire existing panel 15, and then tilts the camera 13, etc. downward in the same position to photograph the installation part at the bottom end of the existing panel. The distance between the camera 13, etc. and the existing panel 15 is calculated based on the holding height of the camera 13, etc. and the angle of the camera 13, etc. at this time. The camera 13, etc. transmits the measured data to the processing device 2. The processing device 2 calculates the distance between the camera 13, etc. and the existing panel 15 from the height and angle information received from the camera 13, etc. The distance between the camera 13, etc. and the existing panel 15 may be calculated by the camera 13, etc. and the result may be transmitted to the processing device 2. Also, after measuring the distance between the camera 13, etc. and the existing panel 15, the entire existing panel 15 may be photographed. The distance between the camera 13, etc. and the existing board 15 is not limited to this, and may be measured more directly by detecting the position of the existing board 15 using the position detection function of the gyro sensor 14, or a measuring tape may be used to measure the distance between the camera 13, etc. and the existing board 15. In this case, the measured distance must be input to the processing device 2 manually, etc.

[0028] The camera 13 etc. transmits image data (first image data) capturing an image of the entire existing board 15, as well as position information (first position information) and angle information (first angle information) of the camera 13 etc. to the processing device 2.

[0029] 4(a) and 4(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. FIG. 4(a) shows an example of image data DI captured by the camera 13 or the like. As shown in FIG. 4(a), the image data (first image data) DI includes the panel name "P1102-P5" written on the plate of the existing panel 15. The image data DI also includes a full view of the existing panel 15. Since the 3D structural drawing of the existing panel 15 includes information regarding the dimensions of the casing, etc., the position of each part can be identified by setting a reference position in the image data DI and photographing the existing panel 15. In this example, the position of the plate is set to the reference position of the existing panel.

[0030] The camera 13 etc. transmit the image data DI to the processing device 2. The processing device 2 uses an image recognition function implemented by the calculation processing unit 4, for example an image recognition program, to recognize the board name "P1102-P5" as a feature of the image data of the existing board, and identifies the existing board.

[0031] As shown in FIG. 4(b), the processing device 2 searches the 3D structural drawing database 50 of the existing board 3D structural drawing library 5 and extracts the 3D structural drawing (first three-dimensional structural drawing) 150 associated with the board name "P1102-P5". The processing device 2 can display the extracted 3D structural drawing 150 on the display device 1 according to the operation of the operator. Also, preferably, the on-site inspector can operate the camera 13 or the like to display the 3D structural drawing 150 extracted by the processing device 2 on the camera 13 or the like. In the above description, a plate with the board name written thereon is used to identify the existing board, but this is not limited to this. For example, if the shape of the board's casing is characteristic, the image data and the 3D structural drawing may be directly compared to extract the desired 3D structural drawing. In that case, the processing device 2 is set to set a specific point of the existing board and the 3D structural drawing as the reference position.

[0032] 5(a) and 5(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. As shown in Fig. 5(a), multiple units are stored in the image data DI of the existing panel. Parts A to D of the image data DI show four units stored in the panel. In this example, when the plate position is set as the reference position, parts A to D of the image data DI are arranged in this order below the plate position.

[0033] As shown in Fig. 5(b), an on-site inspector photographs the entire existing panel including the plate that is the reference position of the image data DI, and then photographs the units housed in the existing panel. The inspector photographs the target by tilting the camera 13 etc. downward from a state in which the camera is focused on the plate, and focusing on part C. The camera 13 etc. transmits the photographed image data (second image data) DIC to the processing device 2 together with position information (second position information) and angle information (second angle information) of the camera 13 etc.

[0034] The processing device 2 extracts features of the image data DIC using the image recognition function of the calculation processing unit 4, searches the 3D structural drawing database of the existing board 3D structural drawing library 5, and extracts the 3D structural drawing 170 that matches the extracted features.

[0035] The processing device 2 associates the 3D structural drawing identified by the image data DIC with the 3D structural drawing corresponding to the existing panel. When associating, information on the placement position on the existing panel is also associated based on the distance between the camera 13, etc. and the existing panel 15, and the position information and angle information of the camera 13, etc. received together with the image data DIC.

[0036] Next, the on-site investigator tilts the camera 13 etc. further downward to capture an image so as to focus on part D. The camera 13 etc. transmits the captured image data DID to the processing device 2 together with position information and angle information of the camera 13 etc. The processing device 2 searches for and extracts a 3D structural diagram that matches the feature amount of the image data DID, as in the case of the image data DIC. Similarly, for parts A and B, the processing device 2 obtains image data, position information and angle information of the camera 13 etc. by capturing images with the camera 13 etc., and based on these, searches for and extracts a 3D structural diagram of the corresponding unit.

[0037] In this example, a 3D structural drawing 170 corresponding to a unit 17 stored in advance in the existing panel 15 is associated with a 3D structural drawing 150 corresponding to the existing panel 15. These 3D structural drawings and their associations are updated with the 3D structural drawings of the units identified by the image data DIC, DID, etc.

[0038] 6(a) and 6(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. In the embodiment of the renewal panel design support system 100, modules and the like mounted on units housed in the existing panel 15 are also registered in the 3D structural drawing, and the information is associated with the existing panel and the renewal panel. Therefore, the modules mounted on the units can also be identified in the 3D structural drawing by photographing them.

[0039] As shown in Fig. 6(a), an on-site inspector photographs image data DID corresponding to portion D of image data DI of an existing panel with a camera 13 or the like, in this example, by changing the angle from left to right. For example, first, the camera 13 or the like is aimed so as to focus on the leftmost module and image data DID1 is acquired. The camera 13 or the like transmits the acquired image data DID1 and position information and angle information of the camera 13 or the like to the processing device 2. The processing device 2 performs image recognition on the image data DID1, and searches for and extracts a 3D structural drawing 171 that matches the feature amount of the image data DID1.

[0040] The on-site investigator turns the camera 13, etc. further to the right and acquires image data DID2. The acquired image data DID2 is subjected to image recognition by the processing device 2 in the same manner as described above, and the 3D structural drawing 172 is searched for and extracted.

[0041] The extracted 3D structural drawing is associated with the 3D structural drawing of the existing panel after the placement position is specified based on the distance between the camera 13 etc. and the existing panel 15, and the position information and angle information of the camera 13 etc. The association of the 3D structural drawing may be performed hierarchically, such as existing panel-unit-module.

[0042] After extracting the 3D structural diagram of the module to be mounted on the unit, the processing device 2 may perform image recognition of the wiring number of the module and associate information regarding the wiring with the 3D structural diagrams 171, 172 of the module.

[0043] 7(a) and 7(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. As shown in Figures 7(a) and 7(b), in the existing panel 3D structural drawing library 5, the 3D structural drawing database 50 is updated to a 3D structural drawing database 50a. For units stored in the panel, 3D structural drawings are extracted from image data, and the placement positions within the existing panel are identified from position information and angle information of the camera 13, etc.

[0044] The unit corresponding to portion A of the image data DI is designated as unit A' in the updated 3D structural drawing 50a and is stored in the top row of the board. The unit corresponding to portion B is designated as unit B' in the updated 3D structural drawing 50a and is stored in the second row from the top of the board. The unit corresponding to portion C is designated as unit 170a in the updated 3D structural drawing 50a and is stored in the third row from the top of the board. The unit corresponding to portion D is designated as unit 170b in the updated 3D structural drawing 50a and is stored in the bottom row of the board.

[0045] In the embodiment of the renewal panel design support system 100, the 3D structural drawing database 50 of the existing panel 3D structural drawing library 5 stores data based on the latest information, but in the case of renewal engineering, changes that are not reflected in the database may be made to the existing panel on-site. In this example, the units in the top row and the second row from the top have been replaced with products from company A and company B that do not exist in the 3D structural drawing database. Also, in the bottom unit 170b, the Xth module has been changed.

[0046] When such a change that is not reflected in the 3D structural drawing database is made, the 3D structural drawing of the changed unit, etc. may not exist in the 3D structural drawing database. In that case, in the updated panel design support system 100 of the embodiment, dummy units and dummy modules are registered in the 3D structural drawing database for the non-existent units, modules, etc., and the dummy units are associated with the units A' and B' corresponding to the parts A and B, and the dummy module is associated with the Xth module of the unit 170b.

[0047] Any number of dummy units and dummy modules can be stored, and in the design work of the update panel, necessary information, such as information on dimensions, information on the functions of the units, and information on the connecting wiring, is input by an input device 8 or the like.

[0048] In this way, the latest 3D structural drawing 50a of the existing panel, taking into account the results of the on-site survey, is stored in the 3D structural drawing database of the existing panel 3D structural drawing library 5.

[0049] 8(a) and 8(b) are schematic diagrams for explaining the operation of the updated board design support system according to the embodiment. The design work for the renewal panel will be carried out based on the latest 3D structural drawing 50a of the existing panel, which takes into account the results of the on-site survey shown in Figure 8(a). The operator of the processing device 2 (the designer of the updated panel) reads out, for example, the latest 3D structural drawing 50a of the existing panel from the existing panel 3 structural drawing library 5, and designs each of the units A'' to D'' shown in Fig. 8(b) according to the design specifications of the updated panel. In this way, the updated panel design support system 100 of the embodiment makes it possible to design the updated panel based on the latest 3D structural drawing of the existing panel, thereby making it possible to streamline the design work and improve productivity.

[0050] FIG. 9 is an example of a flowchart for explaining the operation of the updated board design support system according to the embodiment. A series of operations of the updated board design support system 100 according to the embodiment will be described below with reference to a flowchart. 9, in step S1, an inspector photographs the existing panel 15 installed at the site using the camera 13 or the like. When photographing the existing panel 15 for the first time, the photograph is taken so as to include a full view of the existing panel 15, including a plate that serves as a reference position. The photographed image data DI, and position information and angle information of the camera 13 or the like are transmitted to the processing device 2.

[0051] In step S2, the processing device 2 identifies the board name included in the image data DI by image recognition, and specifies the corresponding existing board. The processing device 2 sets the plate on which the board name is written to a reference position.

[0052] In step S3, the processing device 2 searches the 3D structural drawing database of the existing panel 3D structural drawing library 5 to extract a 3D structural drawing corresponding to the identified existing panel. The processing device 2 enables the extracted 3D structural drawing corresponding to the existing panel to be displayed on the display device 1, and also enables it to be displayed by the camera 13, etc.

[0053] In step S4, the inspector moves, tilts, etc. the camera 13, etc., and takes pictures by focusing on the units in the existing panel 15. The taken image data, position information and angle information of the camera 13, etc. are transmitted to the processing device 2.

[0054] In step S5, the processing device 2 identifies the photographed unit based on the reference position, the image data, and the position information and angle information of the camera 13 and the like.

[0055] In step S6, the processing device 2 searches the 3D structural drawing database of the existing board 3D structural drawing library 5.

[0056] In step S7, the processing device 2 determines whether or not there is a 3D structural drawing corresponding to the identified unit.

[0057] If a 3D structural drawing corresponding to the unit identified in step S7 exists, in step S9, the processing device 2 extracts the 3D structural drawing and registers it in the database in association with the 3D structural drawing corresponding to the existing panel.

[0058] If there is no 3D structural drawing corresponding to the unit identified in step S7, in step S8, the processing device 2 extracts a dummy unit and registers it in the database in association with the 3D structural drawing corresponding to the existing panel.

[0059] In the renewal board design support system 100, the above-mentioned processes from step S4 to step S9 are repeated according to the number of units to be housed in the existing board. If there are multiple modules mounted on the unit, the processes from step S4 to step S9 are repeated according to the number of modules.

[0060] In this way, the renewal panel design support system 100 of the embodiment can update the 3D structural drawing corresponding to the existing panel, taking into account the configuration of the existing panel on-site.

[0061] In the above, the processing device 2 has been described as using the plate as the reference position, but when the plate is used as the reference position, other points on the existing board 15 are photographed by the camera 13, etc., and the angle between the reference position and the other points is measured by the gyro sensor 14, and the distance between the camera 13, etc. and the existing board 15 is found according to the principle of three-point surveying. In this case, the height of the camera 13, etc. is set in advance to the height of the surveyor, etc. According to this principle, the reference position is not limited to the plate, and may be other positions. For example, the distance between the camera 13, etc. and the existing board 15 can be found according to the photographing angles of the upper and lower corners of the board's casing, and any position within the board can be found according to the angle detected by the gyro sensor 14.

[0062] The effects of the updated board design support system 100 according to the embodiment will be described. The replacement panel design support system 100 according to the embodiment includes a camera 13 and a gyro sensor 14, and the processing device 2 receives image data DI of the existing panel 15 acquired by the camera 13, etc., and position information and angle information of the camera 13, etc. The processing device 2 uses an image recognition function to determine information identifying the existing panel contained in the image data DI. The processing device 2 has a 3D structural drawing corresponding to the existing panel in advance, which is associated with information identifying the existing panel. Therefore, the replacement panel design support system 100 can identify the existing panel 15 based on the image data DI of the existing panel 15, and extract the corresponding 3D structural drawing that has been set in advance.

[0063] The renewal panel design support system 100 of the embodiment is equipped with a gyro sensor 14, and is therefore capable of acquiring angle information from the camera 13, etc. The processing device 2 acquires the angle information from the camera 13, etc. together with image data, and is therefore able to identify the locations of units, modules, etc. housed in the existing panel based on this information, and to search for and extract 3D structural drawings corresponding to the units and modules using the image recognition function of the processing device 2.

[0064] The image recognition function of the processing device 2 can also recognize and determine information related to characters in image data. Therefore, the update board design support system 100 can also obtain information on wiring connected to units, modules, etc., and store it in a database in association with the units, modules, etc.

[0065] In this way, the replacement panel design support system 100 of the embodiment can sequentially collect the configuration details of the existing panel on site in real time and reflect them in the 3D structural drawing of the existing panel. This makes it possible to streamline the update work of the deployment connection drawing and the replacement panel design work.

[0066] The 3D structural diagrams created by the updated panel design contain not only electrical connection information but also three-dimensional shape information, so they can be used as elements for augmented reality (AR).

[0067] According to the embodiment described above, it is possible to realize an updated panel design support system that improves the efficiency of update work for existing panels and updated panel design work.

[0068] Although several embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. In addition, the above-mentioned embodiments can be implemented in combination with each other. [Explanation of symbols]

[0069] Reference Signs List 1 display device, 2 processing device, 3 image processing unit, 4 calculation processing unit, 5 existing board 3D structural drawing library, 6 3D structural drawing CAD processing unit, 7 renewal board 3D structural drawing library, 8 input device, 13 camera, 14 gyro sensor, 15 existing board, 16 plate, 17 unit, 50, 70 3D structural drawing database, 100 renewal board design support system

Claims

1. an image data acquisition means for acquiring first image data including an entire existing panel installed in a plant; a position and angle information detection means for detecting first position information and first angle information of the image data acquisition means; a first database storage means for storing a first three-dimensional structural diagram representing the entirety of the existing panel and a second three-dimensional structural diagram corresponding to a unit constituting the existing panel; a processing device that searches and extracts the first three-dimensional structural diagram from the first database storage means based on the feature amount of the first image data; Equipped with The image data acquisition means acquires second image data by photographing a portion of the existing board after acquiring the first image data, the position and angle information detection means detects second position information and second angle information of the image data acquisition means when the second image data is acquired; The processing device searches and extracts the second three-dimensional structural drawing from the first database storage means based on the second image data, and associates the second three-dimensional structural drawing with the first three-dimensional structural drawing based on the distance between the image data acquisition means and the existing panel, the first position information, the first angle information, the second position information and the second angle information.This is an updated panel design support system.

2. The first image data includes an image of a plate on which a character name of the existing board is written, the feature amount of the first image data is a character in a portion of the image of the plate; In the first database storage means, the first three-dimensional structural diagram is associated with a name of the existing board, 2. The updated board design support system according to claim 1, wherein the processing device has an image recognition function, and the image recognition function is used to identify and recognize the name of the board from the image of the plate.

3. 3. The updated board design support system according to claim 2, wherein the processing device searches for and extracts the second three-dimensional structural drawing based on a feature amount of the second image data.

4. the image data acquisition means acquires third image data by photographing a portion of the existing board after acquiring the first image data, the position and angle information detection means detects third position information and third angle information of the image data acquisition means when the third image data is acquired; The renewal panel design support system of claim 3, wherein when the processing device searches the first database storage means and does not find any data matching the features of the third image data, the processing device associates a dummy third three-dimensional structural drawing with the first three-dimensional structural drawing based on the distance between the image data acquisition means and the existing panel, the first position information, the first angle information, the third position information and the third angle information.

Citation Information

Patent Citations

  • Method and device for supporting design of control panel

    JP1994314318A

  • Maintenance drawing creation device, maintenance drawing creation method, and maintenance information management system

    JP2017187981A

  • Layout drawing creation device

    JP2017211908A

  • Image processing device and manufacturing system

    JP2018180868A

  • Information processing device, information processing method, and program recording medium

    WO2017179543A1