Model creation system and model creation method

Abstract

To provide a model creation system or the like that efficiently creates an attributed model of an asset.SOLUTION: A model creation system 10 includes: a partial CAD model creation unit 11 that creates a partial CAD model in which attributes are associated with components of an asset based on a design drawing 1 showing a partial configuration of the asset and an attribute database 2 showing the attributes of the components of the asset, and creates first code data obtained by encoding connection relationships of the components of the asset; and a model matching unit 12 that creates second code data obtained by encoding the connection relationships of the components based on 2D / 3D image data 4 of the asset, identifies the position of the partial CAD model in the 2D / 3D image data based on a comparison between the first code data and the second code data, and creates an attributed CAD model 5 of the asset.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a model creation system and the like. [Background technology]

[0002] Known technologies for assigning predetermined attributes to point cloud data of plants and the like are, for example, those described in Patent Documents 1 and 2. Patent Document 1 describes that "...a logical connection-spatial route correspondence table is generated, which is made up of correspondence data that associates logical connection data whose end point connection information matches with the spatial route data."

[0003] Furthermore, Patent Document 2 describes that the system is provided with "a graph generation unit that generates a first graph, which is a graph with nodes corresponding to segments obtained by dividing point cloud data, and a second graph, which is a graph with nodes corresponding to segments obtained by dividing 3D CAD data, and a matching unit that matches the first graph with the second graph." [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 4940267 [Patent Document 2] Patent No. 5830004 Summary of the Invention [Problem to be solved by the invention]

[0005] When converting point cloud data into a 3D model, as in Patent Documents 1 and 2, the target is usually simple-shaped objects such as pipes and steel materials. However, converting complex-shaped objects such as valves into a 3D model is difficult. Furthermore, it is practically difficult to accurately convert all of a plant's piping into a 3D model from point cloud data. This often requires correcting the 3D model and creating additional 3D models that were not automatically created. Thus, converting point cloud data into a 3D model with attributes requires a significant amount of work. While there is a demand for efficient creation of 3D models with attributes of assets such as plants, Patent Documents 1 and 2 do not describe such technology.

[0006] Therefore, an object of the present invention is to provide a model creation system or the like that efficiently creates an attributed model of an asset. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems, the model creation system of the present invention comprises a partial model creation unit that creates a partial model in which attributes are associated with the components of the asset based on design drawings that show the partial configuration of the asset and an attribute database that shows the attributes of the components of the asset, and creates first code data that encodes the connection relationships of the components of the asset; and a model matching unit that creates second code data that encodes the connection relationships of the components based on image data of the asset, identifies the position of the partial model in the image data based on a comparison between the first code data and the second code data, and creates an attributed model of the asset. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a model creation system or the like that efficiently creates an attributed model of an asset. [Brief explanation of the drawings]

[0009] [Figure 1]FIG. 1 is a functional block diagram of a model creation system according to an embodiment. [Figure 2] 1 is a diagram showing design drawings of pipes and valves that are part of assets in a model creation system according to an embodiment. [Figure 3] FIG. 2 is an explanatory diagram of an attribute database of the model creation system according to the embodiment. [Figure 4] FIG. 10 is an explanatory diagram showing an example of piping extracted by a drawing recognition unit in the model creation system according to the embodiment. [Figure 5] FIG. 10 is an explanatory diagram showing the position of a valve extracted by a drawing recognition unit in the model creation system according to the embodiment. [Figure 6] FIG. 2 is an explanatory diagram showing an example of a partial CAD model in the model creating system according to the embodiment. [Figure 7] FIG. 2 is a diagram showing assets from which point cloud data is to be acquired in the model creation system according to the embodiment. [Figure 8] FIG. 2 is an explanatory diagram showing an example in which a predetermined 3D image is created from a plurality of 2D images in the model creation system according to the embodiment. [Figure 9] FIG. 2 is an explanatory diagram showing an example of 3D image data recognized as a valve in the model creation system according to the embodiment. [Figure 10] FIG. 2 is an explanatory diagram showing an example of 3D image data recognized as piping in the model creation system according to the embodiment. [Figure 11] FIG. 2 is an explanatory diagram showing an example of a processing result of a second encoding unit in the model creation system according to the embodiment. [Figure 12] FIG. 2 is an explanatory diagram showing an example of a three-dimensional model with attributes in the model creation system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] <Embodiment> FIG. 1 is a functional block diagram of a model creating system 10 according to an embodiment. The model creation system 10 may include a partial CAD model creation unit 11 that creates a partial CAD model 3 having attribute data using data of design drawings that show a portion of an asset that includes piping and at least one of a valve and equipment, and a model matching unit 12 that includes a part recognition unit 12a that acquires position information of the valves and equipment from data of a two-dimensional image or a three-dimensional image of the asset, identifies the position of the partial CAD model 3 by pattern matching between the partial CAD model 3 and the three-dimensional image of the asset, and creates an attribute-attached CAD model 5 by arranging the partial CAD model 3 in three-dimensional space. The model matching unit 12 then limits the range of pattern matching based on the position information of the valves and equipment acquired by the part recognition unit 12a and the relative position information of the valves and equipment acquired from the partial CAD model 3. The aforementioned "asset" is an English word meaning "something useful" or "property," and in this specification, "assets" include facilities such as power plants, chemical plants, and manufacturing plants, but are not limited to these. Also, the aforementioned "design drawings" include isometric drawings.

[0011] While some assets such as plants are managed using 3D-CAD (Computer Aided Design), others are built a long time ago and do not have 3D-CAD data, so design drawings and other documents are managed on paper. For example, it is possible to obtain point cloud data of assets using laser measurement and create a 3D model of the asset based on this point cloud data, but 3D models based on point cloud data do not include attributes for each component, such as piping or valves. Furthermore, manually assigning attributes to 3D models requires a great deal of effort from operators.

[0012] Therefore, in this embodiment, a model creation system 10 creates an attributed CAD model 5 of an asset based on the asset design drawings 1, attribute database 2, and 2D / 3D image data 4. Below, as an example, a case will be described in which an attributed CAD model 5 of a predetermined plant (asset 20 in FIG. 12) including piping and valves is created. The design drawing 1 shown in FIG. 1 is an isometric projection drawing (hereinafter referred to as an isometric drawing) of the asset, which is a drawing that represents the asset three-dimensionally as seen from diagonally above.

[0013] Figure 2 is a design drawing 1 of the piping and valves that are part of the asset. Since the design drawing 1 of a plant, which is an asset, is often used for the construction of piping and the like, a continuous line of piping is extracted and drawn as an isometric drawing as shown in Figure 2. The data for such design drawing 1 may be drawing data created with CAD, a photographed image of a paper design drawing, or drawing data in another format. Details of isometric drawings will be described later.

[0014] It is desirable that the model creation system 10 further includes an attribute database 2 having attribute data and management numbers of asset parts. It is also desirable that the partial CAD model creation unit 11 acquires the management number displayed on the design drawing, acquires attribute data associated with the management number of the part from the attribute database 2, and adds the attribute data to the partial CAD model 3. For example, a pipe is assigned a predetermined pipe number as a management number, and attribute data such as the outer diameter, thickness, material, etc. of the pipe is assigned in association with this pipe number. Also, if an asset includes a valve, a predetermined valve number is used as the management number.

[0015] 1, the model creation system 10 includes a partial CAD model creation unit 11 (partial model creation unit) and a model matching unit 12. The partial CAD model creation unit 11 creates a partial CAD model 3 (partial model) in which attributes are associated with the components of the asset, based on a design drawing 1 showing the partial configuration of the asset and an attribute database 2 showing the attributes of the components of the asset, and also creates first code data obtained by encoding the connection relationships between the components of the asset.

[0016] 1, the partial CAD model creation unit 11 includes a drawing recognition unit 11a, a modeling unit 11b, and a first encoding unit 11c. The drawing recognition unit 11a captures information contained in a design drawing 1 (for example, the isometric drawing of FIG. 2) based on a predetermined drawing recognition technology. For example, the drawing recognition unit 11a extracts each pipe from the isometric drawing (see FIG. 2) by associating it with a pipe number, extracts each valve by associating it with a valve number, and extracts the direction in which the pipe extends, the dimensions of the pipe, and the like as asset information.

[0017] The modeling unit 11b shown in FIG. 1 creates a partial CAD model 3 based on the asset information acquired by the drawing recognition unit 11a and the information in the attribute database 2. The partial CAD model 3 is a model created by the partial CAD model creation unit 11. In the example of piping, it is a 3D-CAD model of a continuous pipe having a certain pipe number. Note that a continuous pipe may be a single pipe with no branches, or a single pipe with branches. The pipe number is also assigned to the partial CAD model 3 as attribute data. Note that multiple partial design drawings 1 showing the configuration of each part of the asset are prepared, and multiple partial CAD models 3 are created corresponding to these multiple design drawings 1.

[0018] 1 converts the asset information captured by the drawing recognition unit 11a into first code data that indicates the connection relationships of pipes, valves, etc. The first code data is used when the model matching unit 12 identifies the position of the partial CAD model 3 (the position in the 2D / 3D image data 4 described later). Details of the first code data will be described later.

[0019] As described above, the partial CAD model 3 shown in FIG. 1 is a partial CAD model created by the partial CAD model creation unit 11. In the example of piping, a 3D-CAD model of a continuous pipe assigned a certain pipe number is created as the partial CAD model 3. As described above, a continuous pipe may be a single pipe with no branches, or a single pipe with branches. In addition to the outer diameter, wall thickness, and material of the pipe, the pipe number and the like are assigned as attribute data of the pipe.

[0020] The 2D / 3D image data 4 is overall image data of the asset, and includes predetermined two-dimensional image data and three-dimensional image data. For example, a predetermined part of the asset may be represented by two-dimensional image data, and another part may be represented by three-dimensional image data. Furthermore, the 2D / 3D image data 4 may include 2D image data of the same part photographed from multiple angles and 3D image data (point cloud data) created based on the 2D image data. The point cloud data included in the 2D / 3D image data 4 may be obtained by laser measurement.

[0021] The model matching unit 12 creates second code data obtained by encoding the connection relationships of the asset's constituent elements based on the asset's 2D / 3D image data 4 (image data). Then, based on a comparison between the first code data and the second code data, the model matching unit 12 identifies the position of the partial CAD model 3 (partial model) in the 2D / 3D image data 4 (image data) and creates an attributed CAD model 5 (attributed model) of the asset.

[0022] 1, the model matching unit 12 includes a body part recognition unit 12a, a second encoding unit 12b, a position identification unit 12c, and a 3D matching unit 12d. Details of the model matching unit 12 will be described later.

[0023] The attribute-attached CAD model 5 is a three-dimensional model in which attributes are associated with each component of an asset, and is created by arranging a plurality of partial CAD models 3 in a predetermined manner. As described above, attribute data is assigned to the partial CAD models 3, and therefore the attribute-attached CAD model 5, which is an aggregate of these models, becomes a 3D CAD model with attributes. The following describes in detail this embodiment in the case of a plant.

[0024] As mentioned above, design drawing 1 shown in Figure 2 is an isometric drawing that includes the piping and valves that are part of the plant. In the example of Figure 2, the coordinate axes are defined as the x-axis, y-axis, and z-axis. The most basic drawing method for isometric drawings was used. That is, the z-axis direction is the vertical direction of the paper in Figure 2, and the x-axis and y-axis directions are each tilted 30° from the horizontal direction of the paper in Figure 2, resulting in an angle of 120° between them. Piping is usually drawn along one of the x-axis, y-axis, or z-axis. Each pipe is assigned a specific pipe number, and each valve is assigned a specific valve number.

[0025] Although the bends in the piping are actually bent pipes, in the example of Figure 2, the bent pipes are depicted as a schematic right-angled pipe. As shown in Figure 2, if a valve is installed in the piping, it is also displayed in the isometric drawing as appropriate. Furthermore, dimensions used in construction, such as the length of the straight pipe, the length to the branch pipe, and the position from the end of the piping to the valve, are displayed using predetermined dimension lines. Both ends of the dimension lines are arrows, and the dimension leader lines are line segments. However, the thickness of the dimension leader lines is different from the thickness of the piping lines so that the drawing recognition unit 11a (see Figure 1) can distinguish between the line segments and the piping. Furthermore, in the isometric drawing, a predetermined piping number is written near each piping. In the example of Figure 2, "PSA-01-300" shown near the piping at the right edge of the page is the piping number.

[0026] FIG. 3 is an explanatory diagram of the attribute database 2. Attribute database 2 records attribute data for each part of an asset along with the part's management number. In the case of piping, the management number is the piping number, and attribute information (attribute data) such as the piping's outer diameter, wall thickness, material, and insulation thickness is recorded linked to the piping number. Therefore, a 3D-CAD model with a piping number can obtain all related attributes by linking it to attribute database 2. Although not shown in Fig. 3, the attribute database 2 also includes attribute data of valves in addition to piping. These attribute data are used when the modeling unit 11b (see Fig. 1) creates the partial CAD model 3.

[0027] 1 extracts information contained in an isometric drawing using a drawing recognition unit 11a, and creates a partial CAD model 3 using a modeling unit 11b based on the extracted information. Furthermore, the partial CAD model creation unit 11 encodes the information extracted by the drawing recognition unit 11a in a predetermined manner using a first encoding unit 11c. The processing flow of each component will be described below in order.

[0028] First, the processing flow of the drawing recognition unit 11a will be described. Step S101: The drawing recognition unit 11a recognizes the isometric drawing (i.e., design drawing 1 in FIG. 2) as an image and extracts line segments whose thickness corresponds to piping. As a result, line segments representing each piping are extracted as shown in FIG.

[0029] FIG. 4 is an explanatory diagram showing an example of piping extracted by the drawing recognition unit. For example, in FIG. 4, line segment AB extending in the x-axis direction, line segment BD extending in the y-axis direction, and line segment DF extending in the z-axis direction are extracted as a continuous pipe. Also, line segment CE branching from point C midway along line segment BD is extracted as another pipe. Note that the method for recognizing pipe branches (which pipes are to be main pipes and which pipes are to be branch pipes) is set in advance. After extracting the pipes from the isometric drawing in this way (S101), the process of the drawing recognition unit 11a proceeds to step S102.

[0030] Step S102: The drawing recognition unit 11a extracts dimension lines and dimension values ​​from the isometric drawing and associates them with the length information of each line segment extracted in step S101. As a result, for example, the length of line segment AB is associated with 5800 [mm], which is the length of the pipe represented by this line segment AB (see also FIG. 2).

[0031] Step S103: The drawing recognition unit 11a selects one end point of the continuous pipe, sets its coordinates as the origin (0,0,0), and determines the coordinates of the other points based on the inclination and length of each line segment on the drawing. For example, if the drawing recognition unit 11a sets point A shown in FIG. 4 as the origin, then, as viewed from point A, point B extends in the negative direction of the x-axis and has a length of 5800 mm (see also the dimensions in FIG. 2). Therefore, the coordinates of point B are (-5800,0,0). Also, as viewed from point B, point C extends in the positive direction of the y-axis and has a length of 3000 mm (see also the dimensions in FIG. 2). Therefore, the coordinates of point C are (-5800,3000,0). In this way, the coordinates of each point can be determined based on the direction and length of the line segment.

[0032] If no dimension values ​​are written on the design drawing 1, the drawing recognition unit 11a calculates the actual length of the pipe based on the length and scale of the line segment on the design drawing 1, and determines the coordinates of each point. For example, if the length of the line segment on the paper surface of the design drawing 1 is 25 [mm] and the scale is 1 / 100, the actual length of the pipe corresponding to this line segment is 2500 [mm].

[0033] Step S104: The drawing recognition unit 11a extracts the pipe number of the target pipe and determines the outer diameter and other attributes of the pipe. Since the pipe number is written on the isometric drawing (see FIG. 2), the pipe number can be read from the isometric drawing using, for example, OCR (Optical Character Reader) technology. In the example of FIG. 2, the pipe numbers "PAS-01-300" and "PAS-02-300" are extracted. A single pipe number is assigned to a continuous pipe of the same diameter. For example, the pipe number "PAS-01-300" shown in FIG. 2 corresponds to a continuous pipe including points A, B, C, D, and F in FIG. 4, and the pipe number "PAS-02-300" shown in FIG. 2 corresponds to a continuous pipe from point C to point E in FIG. 2.

[0034] As part of the processing in step S104, the drawing recognition unit 11a determines the outer diameter and other attributes of each pipe. The outer diameter and other attributes of the pipe are associated with the pipe number and stored in advance in the attribute database 2. In the example of FIG. 3, the outer diameter of each pipe with the pipe numbers "PAS-01-300" and "PAS-02-300" is 318.5 mm. Furthermore, both of these pipes have a wall thickness of 6.9 mm, are made of carbon steel, and have a thermal insulation thickness of 50 mm.

[0035] Step S105: The drawing recognition unit 11a acquires the coordinates and valve numbers of the valves. For example, the drawing recognition unit 11a recognizes the shape of each valve shown in the isometric drawing (see FIG. 2) based on a predetermined pattern recognition.

[0036] FIG. 5 is an explanatory diagram showing the positions of the valves extracted by the drawing recognition unit. When the positions of the valves are identified from the design drawing 1 (isometric drawing) based on image recognition, in the example of FIG. 5, points G and H are the positions of the valves. The method for determining the three-dimensional coordinates of points G and H is the same as the method for determining the coordinates of points A to F of the pipe in step S103. In other words, the drawing recognition unit 11a calculates the three-dimensional coordinate values ​​of each valve when a predetermined end point (for example, point A) is set as the origin (0,0,0). The valve numbers are obtained in the same way as the method for obtaining the pipe numbers in step S104. Alternatively, the drawing recognition unit 11a can refer to the attribute database 2 (see FIG. 3) and obtain attribute data of the valves using the valve numbers as a key. By sequentially performing the above steps S101 to S105, the three-dimensional coordinates and attribute data of the pipes and valves included in the isometric drawing are acquired.

[0037] Next, the processing flow of the modeling unit 11b (see FIG. 1) will be described. Step S201: The modeling unit 11b reads the three-dimensional coordinates of the pipes and valves extracted by the drawing recognition unit 11a, as well as the attribute data associated with the management numbers (pipe numbers and valve numbers).

[0038] Step S202: The modeling unit 11b creates a piping model based on the 3D coordinates and attribute data (pipe outer diameter and insulation thickness) read in step S201. In general CAD software, a piping model can be created using the CAD software's API by specifying the pipe number and pipe outer diameter and specifying the piping route using 3D coordinates. In addition, a piping model that includes the insulation can be created by specifying the insulation thickness of the piping.

[0039] Step S203: The modeling unit 11b creates a partial CAD model 3 by placing a valve model in the created piping model. Specifically, the modeling unit 11b uses the 3D coordinates of the valve read in step S201 and utilizes the API of the CAD software to place the valve model in the piping model. Note that the valve model differs depending on the type of valve. In this embodiment, the modeling unit 11b selects a valve model based on the type corresponding to the valve number written in the isometric drawing. In the example of FIG. 2, "VG" represents a gate valve, so the modeling unit 11b places the gate valve model in a predetermined position in the piping model. The partial CAD model 3 is created by sequentially performing the above steps S201 to S203.

[0040] FIG. 6 is an explanatory diagram showing an example of the partial CAD model 3. As shown in FIG. In the example of Fig. 6, the piping and valves shown in the isometric drawing (design drawing 1 in Fig. 2) are represented as a partial CAD model 3. Such a partial CAD model 3 is stored in the model matching unit 12 (see Fig. 1).

[0041] The first encoding unit 11c shown in FIG. 1 generates first code data by encoding the connection relationships between the components of an asset. That is, the first encoding unit 11c generates the first code data by encoding information related to the direction of piping, valves, reducers, piping branches, and equipment connections based on information extracted by the drawing recognition means 31. Here, "encoding" means representing the connection relationships between the components of an asset as a sequence of codes based on a predetermined rule. Specific codes used for "encoding" will be described later. Next, the processing flow of the first encoding unit 11c (see FIG. 1) will be described.

[0042] Step S301: The first encoding unit 11c divides the piping drawn on the isometric drawing into continuous piping units (hereinafter referred to as piping groups) that do not include branches. For example, the first encoding unit 11c divides the piping on the isometric drawing shown in Fig. 5 into a first piping group (ABCDHF) and a second piping group (CGE).

[0043] Step S302: The first encoding unit 11c encodes each piping group based on connection information such as "piping direction," "valve," "reducer," and "piping branch." For example, in the case of the first piping group described above, with point F as the base point, the following are sequentially connected: the piping of line segment FH extending to the positive side (+ side) of the z-axis direction, the valve at point H, the piping of line segment HD extending to the positive side (+ side) of the z-axis direction, the piping of line segment DC extending to the negative side (- side) of the y-axis direction, the branch at point C, the piping of line segment CB extending to the negative side (- side) of the y-axis direction, and the piping of line segment BA extending to the positive side of the x-axis. Therefore, when the first encoding unit 11c encodes the first piping group, the resulting code is "Z+, Valve, Z+, Y-, Branch, Y-, X+." Similarly, when the first encoding unit 11c encodes the second piping group, the resulting code is "Z-, Valve, Z-" with point C as the base point. In this way, the partial CAD model creation unit 11 (partial model creation unit) creates the first code data of each continuous piping group that does not include a branch, based on the design drawing 1 of the asset.

[0044] Codes used to encode the connection relationships of the components of an asset can be broadly divided into four types. The first type is a code that represents the extension direction or orientation of the component of an asset. For example, when a pipe extending from a predetermined position to the positive side of the z-axis direction (the pipes of line segments FH and HD in Figure 5) is encoded, it is represented as "Z+". This "Z+" represents not only the direction and orientation of the pipe extension, but also the pipe itself. Note that instead of "Z+", it may be represented as "Pipe:Z+", etc.

[0045] For example, when one of points A and F, which are the end points of the first piping group, is used as the base point, and encoding is performed sequentially from point F toward point A, as follows: That is, the end point on the point F side (base point side) of the line segment corresponding to this piping is used as the reference when expressing the direction in which the piping extends with a code ("+" or "-") Specifically, the piping represented by line segment DC extends on the negative side of the y-axis direction with point D, which is close to point F (base point), as the reference point, and is therefore represented by the code "Y-". In this way, the direction in which the piping extends is represented by a code.

[0046] When encoding a specific branch pipe (CGE in FIG. 5), the connection point (point C in FIG. 5) between the branch pipe and the main pipe (ABCDHF in FIG. 5) is used as the base point. When encoding the main pipe, one of the two end points (points A and F in FIG. 6) is appropriately selected according to a predetermined rule. In this embodiment, point F is set as the end point based on the rule that the one with the smaller x-coordinate value is set as the base point. Note that, since there are cases where it is difficult to identify the end point according to the rule, the first encoding unit 11c may create code data from both end points of the piping.

[0047] The second type of code is a code that simply represents the component of the asset. For example, a valve is represented as "Valve." The third type of symbol is a symbol indicating a point where the components of the asset branch off. In this embodiment, a point where a pipe branches off is indicated by the symbol "Branch." The fourth type of symbol is a symbol used to separate symbols (including adjacent symbols of the same type) that indicate the components of an asset. In this embodiment, "," is used as such a separator symbol.

[0048] Note that examples of the codes are not limited to those described above. That is, predetermined alphabets, numbers, or symbols may be used as appropriate for each of the four types of codes described above. Furthermore, the components to be coded are not limited to pipes and valves, but may include various components such as reducers (not shown) and pumps (not shown). For example, if a reducer (not shown) is present between pipes C and D and a predetermined device is connected to point F, the first pipe group is coded as "Equipment, Z+, Valve, Z+, Y-, Reducer, Y-, Branch, Y-, X+." By sequentially performing the processes of steps S301 and S302, the first code data of the predetermined portion in the design drawing 1 is created.

[0049] Next, the 2D / 3D image data 4, the model matching unit 12, and the CAD model with attributes 5 shown in FIG. 1 will be described. The 2D / 3D image data 4 includes, for example, 2D image data of a predetermined part of an asset photographed from multiple angles and 3D image data created based on the 2D image data. The 3D image data is point cloud data of the asset as shown in FIG.

[0050] FIG. 7 is a diagram showing an asset 20 from which point cloud data is to be acquired. Point cloud data of assets 20 including a tank 22, a pump 23, a valve 24, etc. in addition to the piping 21 shown in FIG. 7 is created based on laser measurement.

[0051] FIG. 8 is an explanatory diagram showing an example in which a predetermined 3D image is created from a plurality of 2D images. Note that Fig. 8 shows an example in which one 3D image is created from N 2D images of an asset. Data for the N 2D images includes the image file name and the two-dimensional coordinate values ​​of each component element included in the image file. In addition to the data for the N 2D images and one 3D image, data indicating the correspondence between the two is also saved as 2D / 3D image data 4 (see Fig. 1).

[0052] 1 recognizes components such as valves, equipment, and piping based on 2D or 3D images of a plant, which is an asset. Then, the part recognition unit 12a acquires position information of the recognized valves, equipment, piping, etc. In this embodiment, the part recognition unit 12a recognizes valves and equipment using 2D images, and recognizes piping using 3D images.

[0053] Next, the processing flow of the part recognition unit 12a will be described. In step S401, the part recognition unit 12a recognizes the components of an asset, such as a valve or a device, from a predetermined 2D image. Deep learning, for example, is used as a method for recognizing objects in an image. By having the part recognition unit 12a learn images of valves and devices in advance, the valves and devices can be identified from the 2D image.

[0054] In step S402, the part recognition unit 12a identifies a 3D image corresponding to the valve or device identified in the 2D image based on the correspondence between the 3D image and the 2D image. Note that the 2D image corresponding to the 3D image of the valve may be contained in multiple image files. That is, among the valve images recognized in the specified 2D image data, pixels corresponding to the 3D image may correspond to only a part of the valve. In such a case, the part recognition unit 12a recognizes the valve based on all 2D images used to create the 3D image and identifies the corresponding 3D image, thereby identifying the valve in the 3D image. Note that a method for identifying the corresponding 3D image may also be used, in which, for each point in all 3D images, it is determined whether the corresponding 2D image is within the area identified in step S401.

[0055] Next, in step S403, the part recognition unit 12a identifies the position information of the constituent element, such as a valve or device, based on the coordinate data of the constituent element identified in the 3D image.

[0056] FIG. 9 is an explanatory diagram showing an example of 3D image data recognized as a valve. In the example of FIG. 9, the part including the valve is indicated by a rectangular parallelepiped R1 drawn with dashed lines. Such a rectangular parallelepiped R1 may be displayed on a display (not shown). By displaying the rectangular parallelepiped R1, the user can easily grasp each part recognized by the part recognition unit 12a (see FIG. 1). Note that the rectangular parallelepiped R1 may not be displayed on the display (not shown). The same applies to the recognition of other components by the part recognition unit 12a (see FIG. 1).

[0057] By sequentially performing the processes of steps S401 to S403 described above, three-dimensional position information of each component such as a valve or device is acquired. Note that, although the present embodiment has shown an example in which a valve or device is recognized based on a 2D image, the valve or device may also be recognized based only on a 3D image. Furthermore, if there is sufficient 3D image data of the valve or device as training data, the part recognition unit 12a may recognize the valve or device based on three-dimensional shape recognition.

[0058] FIG. 10 is an explanatory diagram showing an example of 3D image data recognized as piping. In Fig. 10, the ridge lines of the pipes are indicated by thick lines. The part recognition unit 12a (see Fig. 1) recognizes, for example, a straight pipe, which is a portion where the 3D image (i.e., point cloud data) matches a cylindrical shape, as a pipe. Note that there is no particular need to perform image recognition on bends included in a continuous pipe, but bends in the pipes may be recognized appropriately based on the positional relationship between straight pipes.

[0059] The second encoding unit 12b (see FIG. 1) converts the 3D image data (point cloud data) into second code data based on the recognition result of the part recognition unit 12a. The second code data is data obtained by encoding the connection relationships between the components of the asset based on a predetermined rule. The second code data includes information on base points that indicate the reference positions of the multiple components identified by this second code data. The encoding method by the second encoding unit 12b is the same as the encoding method by the first encoding unit. That is, the model matching unit 12 creates second code data for each continuous piping group that does not include branches based on the 2D / 3D image data (image data).

[0060] The codes used to create the first code data and the second code data include a predetermined code (e.g., "Z+") that indicates the extension direction and orientation of the asset's components, as well as a predetermined code (e.g., "Valve") that succinctly indicates the asset's components. In addition, the codes used to create the first code data and the second code data also include a predetermined code (e.g., "Branch") that indicates where the asset's components branch, and another code (e.g., ",") that separates the predetermined codes that indicate the asset's components.

[0061] FIG. 11 is an explanatory diagram illustrating an example of a processing result of the second encoding unit. As shown in FIG. 11, the second code data sequentially includes the three-dimensional coordinate values ​​of the base point and codes indicating the connection relationships of the asset's components. For example, in the code "12000, 900, 4000, Z+, Valve, Z+, Y-, Branch, Y-, X+" on the sixth line in FIG. 11, "12000, 900, 4000" indicates the coordinate values ​​of the base point in this encoding, and the remaining part indicates the connection relationships of the asset's components. Note that the "three-dimensional coordinate values ​​of the base point" in the second code data indicates the relative positional relationships of multiple piping groups in the asset. Furthermore, the origin (0, 0, 0) that serves as the reference for multiple base points such as "12000, 900, 4000" is assumed to be common to each second code data.

[0062] 1 matches the second code data created by the second encoding unit 12b with the first code data based on the isometric drawing, thereby identifying the position of the pipes, etc. in the 2D / 3D image data 4 (point cloud data). Specifically, the position identification unit 12c identifies the position in the point cloud data of each part drawn in the isometric drawing by comparing the first code data based on the isometric drawing with the second code data shown in FIG.

[0063] When the position identification unit 12c compares the first code data with the second code data, the coordinate values ​​of the base points included in each of the second code data (see FIG. 11) may not be used. This allows the comparison of the part of the second code data that indicates the connection relationship between the components of the asset with the first code data.

[0064] As described above, in the example of this embodiment, the first code data based on the isometric drawing (see FIG. 2) is “Z+, Valve, Z+, Y-, Branch, Y-, X+” and “Z-, Valve, Z-.” The model matching unit 12 searches for a code sequence that matches the first code data from among the plurality of second code data shown in FIG.

[0065] For example, the first code data "Z+, Valve, Z+, Y-, Branch, Y-, X+" matches the second code data (the portion showing the connection relationships of the components) on the sixth line in Fig. 11, so it is clear that the position of its base point is (12000, 900, 4000) at the beginning of the second code data. Also, the first code data "Z-, Valve, Z-" matches the second code data (the portion showing the connection relationships of the components) on the seventh line in Fig. 11, so it is clear that the position of its base point is (12000, 3900, 4000) at the beginning of the second code data.

[0066] In this way, the model matching unit 12 (see FIG. 1) identifies the three-dimensional coordinate values ​​of the base point included in the second code data that matches (or has the highest degree of match) with the predetermined first code data. Then, the position identification unit 12c matches the position of the base point of the partial CAD model 3 corresponding to the first code data with the three-dimensional coordinate values ​​of the base point included in the second code data. For example, the model matching unit 12 matches the position of the base point (point F in FIG. 4) of the partial CAD model 3 (see FIG. 6) of the first piping group (ABCDHF in FIG. 4) corresponding to the first code data of "Z+, Valve, Z+, Y-, Branch, Y-, X+" with the three-dimensional coordinate values ​​(12000, 900, 4000) of the base point included in the second code data.

[0067] The model matching unit 12 combines multiple partial CAD models 3, just like putting together pieces of a puzzle, to create an overall CAD model 5 with attributes of the asset. In this way, by encoding and matching both the piping etc. in the isometric drawing and the point cloud data, the position of the piping in the isometric drawing can be identified quickly.

[0068] The 3D matching unit 12d shown in Fig. 1 mainly performs two processes. The first process is to identify a single position when the position identification unit 12c lists multiple candidates for the position of a pipe or the like in the 2D / 3D image data 4. Specifically, the 3D matching unit 12d places a partial CAD model 3 at multiple candidate positions in the point cloud data included in the 2D / 3D image data 4 and compares it with the shape of the point cloud data. This is because even if the first code data match, the length or diameter of the pipe may differ.

[0069] When there are multiple candidates for the position of the partial CAD model 3 (partial model) in the 2D / 3D image data 4 (image data), the 3D matching unit 12d (i.e., the model matching unit 12) identifies, among the multiple candidates for the position, the one in which the shape of a predetermined component indicated by the candidate for the position in the 2D / 3D image data 4 is closest to the shape of the component of the partial CAD model 3, as the position of the partial CAD model 3 in the 2D / 3D image data. This makes it possible to identify the position in the 2D / 3D image data 4 of a pipe or the like drawn in the isometric drawing. Note that when the length and diameter of the pipe are completely identical for each of the multiple candidates, the 3D matching unit 12d identifies the pipe based on the equipment number of the connected device, etc.

[0070] Another process performed by the 3D matching unit 12d (see FIG. 1) is a process performed when there is a difference between the information in the isometric drawing (see FIG. 2) and the information in the point cloud data (2D / 3D image data 4: see FIG. 1). For example, if a plant is remodeled and a difference occurs between the information in the isometric drawing (design drawing 1: see FIG. 2) and the actual plant, the partial CAD model 3 and the point cloud data will not completely match. In this case, the 3D matching unit 12d changes the parameters of the partial CAD model 3 so that the partial CAD model 3 matches the point cloud data that reflects the actual plant after the remodeling.

[0071] For example, if there is a discrepancy between the coordinate values ​​of a valve calculated by the position identification unit 12c and the coordinate values ​​of the valve based on the partial CAD model 3, the 3D matching unit 12d corrects the coordinates of the valve in the partial CAD model 3 to match the point cloud data. The same applies to correcting the position of a pipe. In this way, when the 3D matching unit 12d (i.e., the model matching unit 12) identifies the position of the partial CAD model 3 (partial model) in the image data, if there is a difference between the 2D / 3D image data 4 (image data) and the partial CAD model 3 at that position, the 3D matching unit 12d (i.e., the model matching unit 12) modifies the partial CAD model 3 to match the 2D / 3D image data 4. This makes it possible to match the partial CAD model 3 to the actual shape of the plant after modification.

[0072] As described above, in this embodiment, by utilizing the isometric drawing (design drawing 1) and the 2D / 3D image data 4, it is possible to efficiently create a CAD model 5 (see FIG. 1) with attributes of piping and valves.

[0073] FIG. 12 is an explanatory diagram showing an example of the CAD model 5 with attributes. For example, by adding CAD models of equipment and structures to CAD models of piping and valves with attributes, an attributed CAD model 5 of the entire plant shown in Fig. 12 is created. The models of the equipment and structures may be created manually based on input operations by the user, or the models that best match the point cloud data may be obtained from a library of these models (not shown). Alternatively, the point cloud data of the equipment and structures may be converted into a predetermined surface model.

[0074] Furthermore, the model matching unit 12 may specify the position of one of the multiple partial CAD models 3 (partial models) in the 2D / 3D image data 4 (image data) as an attributed CAD model 5 (attributed model) and display it superimposed on the 2D / 3D image data 4. This allows the user to easily grasp the progress of the creation of the attributed CAD model 5.

[0075] <Effects> According to this embodiment, the attributed CAD model 5 can be efficiently created by comparing the first code data based on the asset design drawing 1 and the attribute database 2 with the second code data based on the 2D / 3D image data 4. Note that if an attempt is made to create the attributed CAD model 5 of the asset by directly comparing the recognition results of the asset design drawing 1 with the 2D / 3D image data 4, the process would take a long time. In contrast, in this embodiment, the position of the partial CAD model 3 is identified based on a comparison between the first code data and the second code data, thereby significantly reducing the time required to create the attributed CAD model 5.

[0076] Furthermore, since there is no particular need to include information such as the length of the pipe in the first code data or the second code data, even if an error occurs in the length of the pipe in the 2D / 3D image data 4, this error can be prevented from adversely affecting the identification of the position of the partial CAD model 3.

[0077] <<Variations>> Although the model creating system 10 according to the present invention has been described above in terms of the embodiments, the present invention is not limited to these descriptions and various modifications can be made. For example, in the embodiment, the model matching unit 12 searches for a plurality of second code data that includes a code sequence that matches the first code data. However, this is not limiting. For example, due to insufficient accuracy of point cloud data or insufficient accuracy of part recognition, a portion of the second code data may be missing from the original data. Therefore, the model matching unit 12 may compare the first code data and the second code data based on DP (Dynamic Programming) matching instead of (or in addition to) a simple code search. By using the DP matching technique, even if the first code data and the second code data do not perfectly match, the best match can be identified.

[0078] In addition, in the embodiment, the case where the 2D / 3D image data 4 includes both two-dimensional image data and three-dimensional image data has been described, but this is not limiting. That is, the 2D / 3D image data 4 may include either two-dimensional image data or three-dimensional image data. Furthermore, in the embodiment, a case where a three-dimensional CAD model 5 with attributes of an asset is created has been described, but the present invention is not limited to this. For example, the embodiment can also be applied to a case where a two-dimensional model with attributes of an asset is created. In addition, in the embodiment, the case where the first encoding unit 11c (see FIG. 1) is connected to the model matching unit 12 (see FIG. 1) has been described, but this is not limiting. For example, the second encoding unit 12b (see FIG. 1) may be connected to the partial CAD model creation unit 11 (see FIG. 1). In this case, at least a part of the functions of the model matching unit 12 may be performed by the partial CAD model creation unit 11.

[0079] In addition, in the embodiment, the case where the asset is a plant including pipes and valves has been described, but the embodiment can also be applied to various other assets. In the embodiment, the design drawing 1 (see FIG. 2) is an isometric projection drawing of a plant, which is an asset, but may be a drawing in another format. Furthermore, in the embodiment, a case where a CAD model 5 with attributes is created has been described, but this is not limiting. That is, a three-dimensional model with attributes may be created using predetermined software other than CAD.

[0080] Furthermore, the programs executed by the model creation system 10 (programs such as a model creation method) can be provided via a communication line, or can be written to a recording medium such as a CD-ROM and distributed. The "partial model creation process" in the above-mentioned "model creation method" includes the processes of steps S101 to S105, S201 to S203, S301, and S302 in the embodiment. Furthermore, the "model matching process" in the "model creation method" includes the process of creating second code data in addition to S401 to S403 in the embodiment.

[0081] Furthermore, the embodiments have been described in detail to clearly explain the present invention, and are not necessarily limited to those having all of the described configurations. Furthermore, it is possible to add, delete, or replace some of the configurations of the embodiments with other configurations. Furthermore, the mechanisms and configurations described above are those considered necessary for explanation, and do not necessarily represent all of the mechanisms and configurations of the product. [Explanation of symbols]

[0082] 1. Design drawings 2 Attribute Database 3 Partial CAD model (partial model) 4 2D / 3D image data (image data) 5 CAD model with attributes (model with attributes) 10 Model Creation System 11 Partial CAD model creation section (partial model creation section) 11a Drawing recognition section 11b Modeling section 11c 1st encoding section 12 Model Matching Section 12a Part recognition part 12b Second encoding section 12c Position identification part 12d 3D Matching Section 20 assets 21 Piping (component) 22 Tank (component) 23 Pump (component) 24 Valve (component)

Claims

1. a partial model creation unit that creates a partial model in which attributes are associated with the components of the asset based on design drawings that show a partial configuration of the asset and an attribute database that shows attributes of the components of the asset, and that creates first code data that encodes the connection relationships of the components of the asset; a model matching unit that creates second code data by encoding the connection relationships of the components based on the image data of the asset, identifies the position of the partial model in the image data based on a comparison between the first code data and the second code data, and creates an attributed model of the asset.

2. The codes used to create the first code data and the second code data include predetermined codes that indicate the extending direction and orientation of the components.

2. The model creation system according to claim 1, wherein:

3. The codes used to create the first code data and the second code data include predetermined codes that indicate the locations where the components branch off.

2. The model creation system according to claim 1, wherein:

4. The codes used to create the first code data and the second code data include other codes that separate predetermined codes that indicate the components.

2. The model creation system according to claim 1, wherein:

5. The second code data includes information on base points that indicate reference positions of the plurality of components identified by the second code data.

2. The model creation system according to claim 1, wherein:

6. The components include piping; the partial model creation unit creates the first code data of a continuous piping group that does not include a branch based on the design drawing, The model matching unit creates the second code data of a continuous piping group that does not include a branch based on the image data.

2. The model creation system according to claim 1, wherein:

7. The model matching unit searches for a code string that matches the first code data from among the plurality of second code data.

2. The model creation system according to claim 1, wherein:

8. The model matching unit compares the first code data with the second code data based on DP (Dynamic Programming) matching.

2. The model creation system according to claim 1, wherein:

9. When there are a plurality of candidates for the position of the partial model in the image data, the model matching unit specifies, among the plurality of candidates for the position, a candidate for the position in the image data in which a shape of a predetermined component indicated by the candidate for the position is closest to a shape of a component of the partial model, as the position of the partial model in the image data.

2. The model creation system according to claim 1, wherein:

10. When the position of the partial model in the image data is identified, if there is a difference between the image data and the partial model at that position, the model matching unit modifies the partial model so that it matches the image data.

2. The model creation system according to claim 1, wherein:

11. The model matching unit displays, as the attributed model, one of the plurality of partial models whose position in the image data has been identified, by superimposing it on the image data.

2. The model creation system according to claim 1, wherein:

12. The design drawing is an isometric view of the plant that is the asset.

2. The model creation system according to claim 1, wherein:

13. a partial model creation process for creating a partial model in which attributes are associated with the components of the asset based on design drawings showing a partial configuration of the asset and an attribute database showing attributes of the components of the asset, and for creating first code data obtained by encoding the connection relationships of the components of the asset; a model matching process for creating second code data by encoding the connection relationships of the components based on the image data of the asset, identifying the position of the partial model in the image data based on a comparison between the first code data and the second code data, and creating an attributed model of the asset.

Images