AR application method and system based on CATIA software modeling

Abstract

The invention provides an AR (Augmented Reality) application method and system based on CATIA (Computer Aided Three-dimensional Interactive Application) software modeling, and the method comprises the following steps of: converting a CATProduct file in a specific output format of CATIA software into an nwc file by utilizing a secondary development environment of Navisworks software, extracting geometry, material and attribute data in an nwc file model by utilizing secondary development of Navisworks, outputting an analysis result, and loading the analysis result in an AR application. According to the method, the CATIA data is converted into the data type which can be identified by the AR application in a low-cost and lossless analysis mode, so that AEC related enterprises can be helped to reduce cost and increase efficiency, the AR application scene is expanded, and the satisfaction degree of a user to the model AR application is improved.

Description

Technical Field

[0001] The present application relates to three-dimensional modeling technology in the field of computer technology, and in particular to an AR application method and system based on CATIA software modeling. Background Art

[0002] In recent years, intelligent manufacturing and digital transformation have become the core engines for promoting industrial upgrading and enhancing corporate competitiveness. The demand for industrial information software is also increasing. As an important member of industrial software, CATIA (Computer-Aided Three-Dimensional Interactive Application), a computer-aided three-dimensional interactive application software from Dassault Aviation, France, is widely used in industrial product design, architecture, aerospace, automobiles, ships and other fields. However, CATProduct, as a unique output format of CATIA software, cannot be directly read and loaded by AR applications, resulting in data island problems.

[0003] At present, the existing technology mainly realizes data format conversion through the following two methods: one is to realize data conversion through secondary development of CATIA software. On the one hand, this method requires the authorization of CATIA software, and on the other hand, it needs to be continuously iterated with the update of CATIA software version, which has a high investment cost; the other is to purchase a third-party SDK to directly parse the CATProduct format, which is also costly. Therefore, an efficient and low-cost solution is needed to realize lossless transmission of CATIA software output format during the conversion process. Summary of the invention

[0004] One purpose of the present application is to provide an AR application method and system based on CATIA software modeling, so as to solve the technical problem of high cost of CATIA software output format conversion under the prior art.

[0005] To achieve the above objectives, some embodiments of the present application provide an AR application method based on CATIA software modeling, the method comprising the following steps:

[0006] Step 1: Navisworks, a construction engineering management software, reads the CATProduct format file output by CATIA software and converts the CATProduct format file into an nwc format file;

[0007] Step 2: Reference the Navisworks method library;

[0008] Step 3: Recursive model structure tree: Obtain the nwc format file through the Application.ActiveDocument interface provided by the Navisworks API, and obtain the root object of the model structure tree through the RootItem attribute, which is used as the starting point of the recursion. The termination condition of the recursion is that the HasGeometry attribute of the object is True or the Children attribute is empty;

[0009] Step 4: When the HasGeometry property is True, extract the geometric information, material information, and attribute information of the object;

[0010] Step 5: Output the parsing results and load them in the AR application.

[0011] Furthermore, the method library in step 2 includes Autodesk.Navisworks.Api, Autodesk.Navisworks.ComApi and Autodesk.Navisworks.Interop.ComApi.

[0012] Furthermore, extracting the geometric information, material information and attribute information of the object in step 4 further includes: acquiring geometric information through the InwSimplePrimitivesCB interface, wherein the geometric information includes vertices, normals, index lists and texture coordinate information.

[0013] Furthermore, extracting the geometric information, material information and attribute information of the object in step 4 further includes: obtaining the ARGB color through the ActiveColor attribute in the object's Geometry attribute, and retrieving the map by traversing the object's attribute set; first finding the attribute set named LcOaProteinMaterialAttribute, then traversing the attributes in the attribute set, finding the attribute whose name contains unifiedbitmap_Bitmap, and finding the file path corresponding to the map according to the attribute value of the attribute.

[0014] Furthermore, extracting the geometric information, material information and attribute information of the object in step 4 further includes: extracting all attribute names and attribute values ​​by traversing the attribute set of the object.

[0015] Furthermore, the step 5 also includes: exporting a required model format according to a format type supported by the AR application, the model format including OBJ, FBX, and GLTF.

[0016] Furthermore, the GLTF format is exported according to the format type supported by the AR application, and the GLTF format definition includes the scene scene, node node, mesh mesh, accessor accessor, buffer view buffer view, buffer buffer, material material, texture texture, and image image core parts.

[0017] Furthermore, the nodes of the model structure tree in step 3 correspond to nodes of different levels in the GLTF.

[0018] Furthermore, the geometric information corresponds to the mesh in the GLTF, wherein the geometric information of the mesh is stored in the buffer of the GLTF in binary form, and is accurately matched through the buffer view and the accessor; the material information object corresponds to the material in the GLTF, the mapping information in the material information corresponds to the texture in the GLTF, and the mapping information is stored in the buffer of the GLTF in binary form and is associated in the image of the GLTF.

[0019] On the other hand, the present application also provides an AR application system based on CATIA software modeling, the system comprising a memory for storing computer program instructions and a processor for executing program instructions, wherein when the computer program instructions are executed by the processor, the system is triggered to execute the above-mentioned AR application method based on CATIA software modeling.

[0020] Compared with the prior art, the AR application method and system based on CATIA software modeling provided by this application uses the secondary development environment of Navisworks software to convert the CATProduct file, which is a unique output format of CATIA software, into an nwc file, and then uses Navisworks secondary development to extract the geometry, material and attribute data in the nwc file model, output the parsing results, and load them in the AR application, thus realizing lossless data transmission. This application converts CATIA data into a data type that can be recognized by AR applications in a low-cost and lossless parsing method, which can help related companies reduce costs and increase efficiency, expand the application scenarios of AR, and improve user satisfaction with model AR applications. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 is a schematic diagram of loading a CATIA model in an AR application according to an embodiment of the present invention;

[0022] Figure 2It is a schematic diagram of the GLTF core definition and relationships in an embodiment of the present invention. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0024] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0025] The embodiment of the present application proposes an AR application method and system based on CATIA software modeling. The method first reads a CATProduct format file through Navisworks, converts the CATProduct format file into an nwc format file, and then uses Navisworks secondary development to extract the geometry, material and attribute data in the nwc format file, thereby realizing lossless data transmission.

[0026] In some embodiments, the AR application method based on CATIA software modeling is as follows:

[0027] Step 1: Navisworks, a construction engineering management software, reads the CATProduct format file output by CATIA software and converts the CATProduct format file into an nwc format file;

[0028] Step 2: Reference the Navisworks method library, which includes Autodesk.Navisworks.Api, Autodesk.Navisworks.ComApi, and Autodesk.Navisworks.Interop.ComApi;

[0029] Step 3: Recursively construct the model structure tree, which is a multi-layer tree structure: obtain the nwc format file through the Application.ActiveDocument interface provided by the Navisworks API, and obtain the root object through the RootItem attribute, which is used as the starting point of the recursion. The termination condition of the recursion is that the HasGeometry attribute of the object is True or the Children attribute is empty;

[0030] Step 4: When the HasGeometry property is True, extract the geometry, material, and attribute information of the object;

[0031] Step 4.1: Get geometric information through the InwSimplePrimitivesCB interface, where the geometric information includes vertices, normals, index lists, texture coordinates, and other information;

[0032] Step 4.2: Get the ARGB color through the ActiveColor property in the Geometry property of the object, and retrieve the texture by traversing the property set of the object. First, find the property set named "LcOaProteinMaterialAttribute", then traverse the properties in the property set and find the property with the name "unifiedbitmap_Bitmap". Find the file path corresponding to the texture according to the property value of the property;

[0033] Step 4.3: Extract all attribute names and attribute values ​​by traversing the attribute set of the object;

[0034] Step 5: Output the parsing results, load them in the AR application, and export the required model format according to the format type supported by the AR application, generally including OBJ, FBX, GLTF, etc.

[0035] Example

[0036] This embodiment will take the conversion of CATIA format to GLTF as an example to realize the loading of CATIA model in AR application.

[0037] Step 1: Navisworks, a construction engineering management software, reads the CATProduct format file output by CATIA software and converts the CATProduct format file into an nwc format file;

[0038] Step 2: Reference Navisworks method libraries, including Autodesk.Navisworks.Api, Autodesk.Navisworks.ComApi, and Autodesk.Navisworks.Interop.ComApi;

[0039] Step 3: Recursively retrieve the model structure tree, obtain the current document through Application.ActiveDocument, and obtain the root object through the RootItem property, which is used as the starting point of the recursion. The recursion ends when the HasGeometry property of the object is True or the Children property is empty.

[0040] Step 4: When the HasGeometry property is True, extract the object geometry, material, and attribute information.

[0041] Step 4.1: Get geometric information through the InwSimplePrimitivesCB interface, including vertices, normals, index lists, and texture coordinate information;

[0042] Step 4.2: Get the ARGB color through the ActiveColor property in the Geometry property of the object, and retrieve the texture by traversing the property set of the object. First, find the property set named "LcOaProteinMaterialAttribute", then traverse the properties in the property set and find the property with the name "unifiedbitmap_Bitmap". Find the file path corresponding to the texture according to the property value of the property;

[0043] Step 4.3: Extract all attribute names and attribute values ​​by traversing the attribute set of the object;

[0044] Step 5: Output the parsing result to a GLTF file and load it in the AR application. Figure 1 The GLTF format definition includes the scene, node, mesh, accessor, buffer view, buffer, material, texture, and image core parts, and their interrelationships are as follows: Figure 2 As shown. The structure tree described in step 3 recursively corresponds to nodes at different levels in GLTF, and the geometric information described in step 4.1 corresponds to the mesh in GLTF, where the geometric information of the mesh is stored in the buffer of GLTF in binary form, and is accurately matched through buffer view and accessor, and the material information object described in step 4.2 corresponds to the material in GLTF, and the mapping information in the material corresponds to the texture in GLTF. The image data is also stored in the buffer of GLTF in binary form and is associated in the image of GLTF.

[0045] Some embodiments of the present application also provide an AR application system based on CATIA software modeling, the system comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the system is triggered to execute the aforementioned AR application method based on CATIA software modeling.

[0046] To sum up, the AR application method and system based on CATIA software modeling provided in this application converts CATIA data into data types that can be recognized by AR applications in a low-cost and lossless parsing manner, which can help related companies reduce costs and increase efficiency, expand the application scenarios of AR, and improve user satisfaction with model AR applications.

[0047] It should be noted that the present application can be implemented in software and / or a combination of software and hardware, for example, can be implemented using an application specific integrated circuit (ASIC), a general purpose computer or any other similar hardware device. In one embodiment, the software program of the present application can be executed by a processor to implement the steps or functions described above. Similarly, the software program of the present application (including relevant data structures) can be stored in a computer-readable recording medium, for example, a RAM memory, a magnetic or optical drive or a floppy disk and similar devices. In addition, some steps or functions of the present application can be implemented using hardware, for example, as a circuit that cooperates with a processor to perform each step or function.

[0048] In a typical configuration of the present application, the terminal and the network device each include one or more processors (CPU), input / output interface, network interface and memory.

[0049] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0050] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory media such as modulated data signals and carrier waves.

[0051] In addition, a part of the present application may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present application through the operation of the computer. The program instruction for calling the method of the present application may be stored in a fixed or removable recording medium, and / or transmitted through a data stream in a broadcast or other signal-bearing medium, and / or stored in a working memory of a computer device that runs according to the program instruction. Here, according to an embodiment of the present application, a device is included, the device including a memory for storing computer program instructions and a processor for executing program instructions, wherein, when the computer program instruction is executed by the processor, the device is triggered to run the method and / or technical solution based on the aforementioned multiple embodiments according to the present application.

[0052] It is obvious to those skilled in the art that the present application is not limited to the details of the above exemplary embodiments, and that the present application can be implemented in other specific forms without departing from the spirit or basic features of the present application. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the present application is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present application. In addition, it is obvious that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices stated in the device claim can also be implemented by one unit or device through software or hardware.

Claims

1. An AR application method based on CATIA software modeling, characterized in that: The method comprises the following steps: Step 1: Navisworks, a construction engineering management software, reads the CATProduct format file output by CATIA software and converts the CATProduct format file into an nwc format file; Step 2: Reference the Navisworks method library; Step 3: Recursive model structure tree: Obtain the nwc format file through the interface Application.ActiveDocument provided by the Navisworks API, and obtain the root object of the model structure tree through the RootItem property, which is used as the starting point of the recursion. The termination condition of the recursion is that the HasGeometry property of the object is True or the Children property is empty; Step 4: When the HasGeometry property is True, extract the geometric information, material information and attribute information of the object; Step 5: Output the parsing results and load them in the AR application.

2. The method according to claim 1, characterized in that The method libraries in step 2 include Autodesk.Navisworks.Api, Autodesk.Navisworks.ComApi and Autodesk.Navisworks.Interop.ComApi.

3. The method according to claim 1, characterized in that Extracting the geometric information, material information and attribute information of the object in step 4 further includes: obtaining geometric information through the InwSimplePrimitivesCB interface, and the geometric information includes vertices, normals, index lists and texture coordinate information.

4. The method according to claim 3, characterized in that The step 4 of extracting the geometric information, material information and attribute information of the object further includes: obtaining the ARGB color through the ActiveColor attribute in the object's Geometry attribute, and retrieving the map by traversing the object's attribute set; first finding the attribute set named LcOaProteinMaterialAttribute, then traversing the attributes in the attribute set, finding the attribute whose name contains unifiedbitmap_Bitmap, and finding the file path corresponding to the map according to the attribute value of the attribute.

5. The method according to claim 1, characterized in that Extracting the geometric information, material information and attribute information of the object in step 4 further includes: extracting all attribute names and attribute values ​​by traversing the attribute set of the object.

6. The method according to claim 4, characterized in that The step 5 also includes: exporting a required model format according to the format type supported by the AR application, where the model format includes OBJ, FBX, and GLTF.

7. The method according to claim 6, characterized in that The GLTF format is exported according to the format type supported by the AR application, and the GLTF format definition includes the scene scene, node node, mesh mesh, accessor accessor, buffer view buffer view, buffer buffer, material material, texture texture, and image image core parts.

8. The method according to claim 7, characterized in that The nodes of the model structure tree in step 3 correspond to nodes at different levels in the GLTF.

9. The method according to claim 7, characterized in that: The geometric information corresponds to the mesh in the GLTF, wherein the geometric information of the mesh is stored in the buffer of the GLTF in binary form, and is accurately matched through the buffer view and the accessor; the material information object corresponds to the material in the GLTF, the mapping information in the material information corresponds to the texture in the GLTF, and the mapping information is stored in the buffer of the GLTF in binary form and is associated in the image of the GLTF.

10. An AR application system based on CATIA software modeling, characterized in that: The system includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the system is triggered to execute the AR application method as described in any one of claims 1 to 9.

Images