Method and system for embedding three-dimensional model in OFD document

Abstract

The invention discloses a method and system for embedding a three-dimensional model in an OFD document, and relates to OFD and three-dimensional technologies, and the method comprises the steps: reducing the order of the three-dimensional model needing to be embedded, converting the three-dimensional model into standard target format data, and extracting one or more frames of images from the target format data as static preview images; embedding the target format data into the OFD document as resources; based on the static preview image, inserting an image primitive at a specified position of an OFD page, inserting an annotation object at the same page position of an annotation layer of the page, and configuring an associated 3D action; after the OFD is opened, triggering the action of the annotation object at the same position of the image primitive; and searching a registry or an environment variable in a system according to the corresponding plug-in interface identifier, loading a three-dimensional model browsing plug-in, and executing browsing plug-in rendering and interaction. The invention provides a three-dimensional data embedding method which is compatible with an OFD standard framework and has small disturbance on an existing reading implementation framework.

Description

Technical Field

[0001] This application relates to OFD and the three-dimensional field, and in particular to a method and system for embedding a three-dimensional model in an OFD document. Background Technology

[0002] The application of 3D models is becoming increasingly widespread in fields such as digital twins, industrial design, smart cities, and cultural heritage preservation. However, the popularization of 3D model applications still faces significant bottlenecks: 1) High application cost: Viewing and interacting with 3D models requires the installation of dedicated 3D software or plugins, which has high requirements for terminal hardware environment and also poses a certain threshold for users. 2) Inconvenient dissemination and collaboration: 3D model files are usually independent of the document circulation system and cannot be easily distributed, archived, or directly viewed in a general office environment like ordinary documents, which hinders their application in cross-departmental and cross-domain collaboration. 3) Discontinuous experience: Users need to frequently switch between dedicated 3D model viewing software and office software, which disrupts the continuity and immersion of information acquisition.

[0003] 4) Insufficient intellectual property protection: The original 3D model design results contain the experience and creative knowledge of the design unit and engineers. Some of them also contain information about the process of multiple trials or simulations. Directly distributing the original 3D model is not friendly to the intellectual property protection of the design unit and designers.

[0004] OFD is an open-source document format standard. Due to its open format, controllable technology, and support for domestic cryptographic algorithms, it is widely used in fields such as electronic documents, electronic certificates, and electronic archives. The OFD standard supports embedding multimedia content as resources into documents and defines an action mechanism that allows document objects to respond to specific events (such as page clicks) to trigger specific predefined behaviors, such as link redirection or activation of software plugins.

[0005] In the field of 3D model data formats, there are native formats for various professional software such as CATPart (Catia) and DGN (Bentley), as well as lightweight formats such as PRC, JT, and gLTF. However, these formats usually require specific software environments or dedicated components to achieve full rendering and interactive functions. Traditional methods of combining 3D content with documents are typically limited to inserting static screenshots of 3D models into the document or linking to external 3D files via hyperlinks. Neither of these methods can provide a native, interactive 3D experience within the document itself.

[0006] CN118093524A proposes a method for constructing and displaying OFD files for 3D models. This method involves inserting object placeholders on the page where the 3D model needs to be displayed, inserting 3D model attachments in the Attachments.xml file using STL format, associating the object placeholders with the 3D model attachments, launching the browser and loading the OFD parsing service, decompressing the OFD file to the local machine, locating the 3D model attachment according to the path defined in the attachment definition, and placing it in the position of the corresponding object placeholder for drawing and interaction. This method achieves complete storage of 3D model objects and their associated attributes on the OFD page, while providing a concise and efficient interactive viewing function for 3D models. However, on the one hand, it is not familiar with the OFD standard; its proposed method of using 3D model files as OFD attachments increases the workload when generating documents and conflicts with the existing definition of the "GotoA" action, which does not support precisely defining the presentation and interaction position when opening attachment files. 2) Software dependency not eliminated: Using non-standard (ISO or GB) 3D model file formats (STL), it is still difficult to operate without STL-related software or its modules; 3) Undermining OFD universality: The inventors are not familiar with the general rules for OFD reading software to parse and present OFD documents. In fact, they have redefined the loading logic of OFD reading software (starting the browser and loading the OFD parsing service, decompressing the OFD to the local machine, and reading the 3D model attachments according to their ID, path, and filename). Reading software implementing this solution will transform from general document software into industry-customized software. The activation and presentation of 3D content depends entirely on the native support of the reading software. It lacks a flexible plug-in mechanism, and the dependence on the software and hardware environment has not been eliminated but has increased. In addition to the dedicated software corresponding to the 3D model, it also depends on the customized reading software. Summary of the Invention

[0007] This application provides a method and system for embedding a 3D model in an OFD document, which proposes a 3D data embedding method that is compatible with the OFD standard and has minimal impact on existing reading implementation architectures. The aim is to achieve reliable integration of the 3D model and the OFD document, and the generated OFD file can still be recognized and parsed by existing general-purpose reading software.

[0008] This application provides a method for embedding a 3D model in an OFD document, including: Before embedding the 3D model into the OFD document, the 3D model is downsized and standardized to convert it into standard target format data, and one or more frames of images are extracted from the target format data as static preview images. The target format data is embedded as a multimedia resource into the OFD document, and the extracted static preview image is embedded as an image resource into the specified directory of the OFD document package. Based on the image resource, an image primitive is inserted at a specified position on the OFD page, an annotation object is inserted at the same position in the annotation layer of the corresponding page, and the action of the annotation object is configured as an associated 3D action, and the trigger area of ​​the action is set to be the same as the page position of the static preview image primitive. Once OFD is enabled, the action of the annotation object at the same location is triggered according to the click command of the trigger area to activate the 3D model browsing plugin; Based on the plugin interface identifier corresponding to the activated associated 3D action, search the registry or environment variables in the system to find the software library that implements the plugin interface and load its browsing plugin. Based on the associated 3D action triggering area and the current document display window, set the working area of ​​the browsing plugin; Within the work area, the browsing plugin is rendered and interacted with.

[0009] This application provides a system for embedding a 3D model in an OFD document, including a processor and a memory. The memory stores a computer program, which, when executed by the processor, implements the steps of the method for embedding a 3D model in an OFD document as described above.

[0010] This application proposes a 3D data embedding method that is compatible with the OFD standard and has minimal disruption to existing reading implementation architectures. The aim is to achieve reliable integration of 3D models and OFD documents, and the generated OFD files can still be recognized and parsed by existing general-purpose reading software.

[0011] The above description is only an overview of the technical solution of this application. In order to better understand the technical means of this application and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of this application more obvious and understandable, the following are specific embodiments of this application. Attached Figure Description

[0012] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the scope of this application. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings: Figure 1 This application provides a schematic diagram of the system architecture for implementing the method of embedding 3D model data in OFD according to the embodiments of this application. Figure 2 This is a basic flowchart illustrating the method for embedding three-dimensional model data in OFD according to an embodiment of this application. Detailed Implementation

[0013] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0014] This application provides a method for embedding a 3D model in an OFD document, such as... Figure 1 As shown, the system for implementing the method of this application involves a document generation end and a document reading end. The document generation end is responsible for reducing the size of the 3D model, standardizing it, and embedding it into the OFD document, including a format conversion module, a resource encapsulation module, and a page description generation module.

[0015] Document reading end: This refers to general OFD reading software and standard 3D modeling software or their plugins. OFD reading software is compatible with both new and old versions, and can be used even if it is an older version that does not support the plugin mechanism. Standard 3D modeling software only needs to support downscaled 3D models, which is less difficult to develop and can even be implemented by office software vendors themselves.

[0016] like Figure 2 As shown, the method for embedding three-dimensional model data in OFD according to the embodiments of this application includes: Before embedding the 3D model into the OFD document, in step S1, the 3D model data to be embedded is downsized (lightweighted) and uniformly converted into standard target format data. One or more frames of images are extracted from the target format data as static preview images. In some embodiments of this application, the document generation end uses a format conversion module to uniformly convert 3D model data from various modeling software, such as .obj, .stl, .3ds, .CATPart, .DGN, etc., into a lightweight PDV format that does not contain process content. One or more frames of static preview images (such as isometric views or front views) are extracted from the PDV data and saved as JPG or PNG format. This step minimizes software environment dependence. The processed 3D model data uses a standard format, has a small file size, and is beneficial for protecting intellectual property rights.

[0017] In step S2, the target format data is embedded as a multimedia resource into the OFD document, and the extracted static preview image is embedded as an image resource into the specified directory of the OFD document package. In this specific example, resource embedding is an existing mechanism of OFD, and using this mechanism to embed 3D models and image resources will not cause any disturbance to the OFD document.

[0018] In step S3, based on the image resource, an image primitive is inserted at a specified position on the OFD page, an annotation object is inserted at the same position in the corresponding page annotation layer, and the action of the annotation object is configured as an associated 3D action. The content of the image primitive is a static preview image extracted from the 3D model data, used to provide a static visual preview to the user when the 3D model function is not activated. The trigger area of ​​the associated 3D action is configured to be the same as the area of ​​the image primitive.

[0019] In step S4, after OFD is opened, the action of the annotation object at the same image primitive position is triggered according to the click instruction in the trigger area to activate the associated 3D action. In the specific example, using this mechanism to define the activation action will not interfere with the OFD document.

[0020] In step S5, based on the plugin interface identifier corresponding to the activated associated 3D action (for example, in subsequent examples of this application, the interface identifier is "ofd.I3DViewer"), the registry or environment variables in the system are searched to find the software library implementing the plugin interface and load its browsing plugin. In some embodiments of this application, finding the software library implementing the plugin interface and loading its 3D browsing plugin further includes: if the plugin is not found, activating the associated 3D action fails, a corresponding prompt is given through the reading software interface, and the static preview image of the current document at the corresponding position is controlled to be browsable. That is, if the plugin is not found, activation fails, and a prompt is given through the reading software, such as displaying "3D browsing component not installed" in the prompt bar, but the browsing of the current document is not affected, and the user can still see the static preview at that position. This is an important compatibility guarantee of the method of this application. When the OFD reading software does not support activating 3D actions, cannot find the 3D browsing plugin, or fails to load the 3D browsing plugin, only 3D interaction cannot be performed, but the document browsing process is not interrupted, and the user can still view the static preview effect of the 3D model.

[0021] In step S6, the working area of ​​the browsing plugin is set according to the associated 3D action triggering area and the current document display window.

[0022] In step S7, the browsing plugin rendering and interaction are performed in the working area.

[0023] The method described in this application significantly reduces the application threshold and cost. Users do not need to install professional and expensive 3D software; they can browse and interact with 3D models simply through general OFD reading software that supports plug-in mechanisms. This allows 3D technology to be popularized in a wider range of groups and scenarios. The method described in this application enhances the document information carrying capacity and experience, achieving seamless integration of 3D models and 2D document content, creating a richer and more immersive information consumption experience. It is particularly suitable for scenarios that require rich illustrations of complex structures (such as product manuals, technical solutions, and on-site reports).

[0024] In some embodiments of this application, embedding target format data as a resource into OFD includes: The target format data that has been downgraded and converted is embedded as an independent multimedia resource into the Res directory inside the OFD document package, and a unique resource ID is assigned to it. In a specific example, the resource encapsulation module of the document generation end embeds the converted PDV format 3D model file as an independent multimedia resource into the Res directory inside the OFD document package, and assigns it a unique resource ID, such as 3DModel_001.

[0025] Static preview images extracted from the PDV format 3D model are embedded as image resources into the Res directory within the OFD document package, and each image is assigned a unique resource ID. Specifically, the extracted static preview images are embedded as image resources into the Res directory within the OFD document package, and each image is assigned a unique resource ID, such as Image_00n. This step uses an existing OFD mechanism for resource embedding, which will not cause any disturbance to the OFD document.

[0026] In some embodiments of this application, inserting image primitives at a designated location on the OFD page and inserting annotation objects in the annotation layer of the page includes: associating the image primitives that provide a visual preview with the embedded 3D model data resources through annotation objects that have the same appearance and position as the image primitives; the association is made by associating 3D actions through the annotation objects.

[0027] In some embodiments of this application, configuring associated 3D actions includes the following key parameters: A resource ID parameter that points to the embedded target format data, such as ResourceID: "3DModel_001".

[0028] The type parameter describes the preferred interactive action after activation, for example, Type: "Highlight".

[0029] Parameters adapted to the swap operation, for example, Parameter: "{CompID:compid_0001}".

[0030] The plugin interface corresponding to the associated 3D action is "ofd.I3DViewer". Any plugin registered within the operating system that implements this interface can be called by the reading software. The comments and actions used in this step are existing OFD mechanisms, and defining activation actions using these mechanisms will not cause any disturbance to the OFD document.

[0031] After this step, the insertion of the 3D model data is complete. The inserted resource file can be protected by the digital signature or electronic seal of the entire OFD document, just like other resource and content files. In subsequent step S4, user triggering and action parsing are performed. In some embodiments, the working area of ​​the browsing plugin is set to the area where the associated 3D action triggering area intersects with the current document display window; that is, the action triggering area is the same as the page position of the image primitive.

[0032] For example, in some embodiments of this application, the triggering area for triggering an action on an annotation object at the same location based on a click instruction includes: Upon receiving a click on a preview image element's location on the page, the associated 3D action is triggered, and the control software parses the corresponding interactive operation and its parameters associated with the 3D action. For example, a user opens a document using OFD reading software. When the user clicks on an image element on the page, they are actually clicking on the trigger area of ​​an annotation object's action at the same location. Within the trigger area of ​​the annotation object's action, the associated 3D action is triggered, and the reading software simultaneously parses the interactive operation and its parameters associated with that action.

[0033] This application specifies the identifier of the associated 3D model resource, as well as the interactive operations and parameters after activation, to guide the reading software plugin to correctly render the initial presentation effect of the 3D model.

[0034] The software's plugin management module searches the operating system's registry or environment variables for the plugin interface identifier corresponding to the activated associated 3D action, finds the software library that implements the interface, and loads its 3D browsing plugin.

[0035] In some embodiments of this application, after the browsing plugin is activated, the resource data stream, interactive operations, and parameters corresponding to the relevant key parameters in the OFD document package are passed to the browsing plugin. For example, after the plugin is activated, the reading software sets the plugin's working area to the intersection of the activated 3D action trigger area and the current document display window. Furthermore, the reading software loads the resource content corresponding to "3DModel_001" in the OFD document package and passes its data stream, interactive operations, and parameters to the plugin.

[0036] In some embodiments of this application, performing browser plugin rendering and interaction in the working area includes: Within the browsing plugin's workspace, initialize the 3D rendering environment and load the target format data; and... Based on the interactive operations and their parameters, render the initial presentation of the 3D model and provide interactive operations.

[0037] At this point, users can perform interactive operations within the plugin's working area, such as zooming in, zooming out, rotating, translating, selecting parts, viewing properties, and even editing model annotations (non-OFD annotation objects). The support for these interactive operations depends on the plugin's own implementation.

[0038] The process also includes, in step S8, exiting the current 3D mode based on clicking on a location outside the associated 3D action trigger area, or pressing a specified key. For example, when the user clicks on a location outside the associated 3D action trigger area, or presses the ESC key, the reading software will close the 3D browsing plugin, release the resources it occupies, update the resource data stream, and revert the display state to the original document browsing mode, displaying only the image primitives at that location on the page.

[0039] The method in this application embodiment achieves seamless integration of three-dimensional models and two-dimensional document content, creating a richer and more immersive information consumption experience, which is particularly suitable for scenarios that require rich illustrations of complex structures (such as product manuals, technical solutions, and on-site reports).

[0040] The method described in this application also has the following advantages: The system is flexible and easily expandable. Its plug-in interactive architecture allows the 3D rendering function to be developed and updated independently of the main reading software program, facilitating the introduction of new 3D format support or customized interactive tools (such as measurement and sectioning), thus enhancing the adaptability and vitality of the entire technology system.

[0041] To ensure the reliability and compatibility of the document, the "static preview effect primitives" and "plugin detection" mechanisms ensure that the core information of the document remains complete and readable even in environments that do not support 3D rendering, thus solving the compatibility pain point of 3D documents.

[0042] 3D models can be protected by document signatures / seals, taking into account the intellectual property protection concerns of design units and designers, which is conducive to increasing the willingness to circulate and exchange 3D model technical data.

[0043] This application also proposes a system for embedding a 3D model in an OFD document, including a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, it implements the steps of the method for embedding a 3D model in an OFD document as described above.

[0044] This application also proposes a software system for implementing the above method, involving a document generation end and a document reading end, wherein: The document generation module is responsible for downscaling the 3D model and generating an OFD document embedded in the 3D model. It includes a format conversion module, a resource encapsulation module, and a page description generation module.

[0045] The document reader is a general-purpose OFD reader software. Depending on the version and environment, the following situations may occur: a. OFD reading software does not support plugin mechanisms; b. The OFD reading software supports a plug-in mechanism, but no 3D browsing plug-in is registered on the terminal.

[0046] c. The OFD reading software supports a plug-in mechanism and the terminal on which it is located has a 3D browsing plug-in registered.

[0047] It should be noted that, in the embodiments of this application, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0048] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0049] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0050] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims. All of these forms are within the protection scope of this application.

Claims

1. A method for embedding a 3D model in an OFD document, characterized in that, include: Before embedding the 3D model into the OFD document, the 3D model is downsized and standardized to convert it into standard target format data, and one or more frames of images are extracted from the target format data as static preview images. The target format data is embedded as a multimedia resource into the OFD document, and the extracted static preview image is embedded as an image resource into the specified directory of the OFD document package. Based on the image resource, an image primitive is inserted at a specified position on the OFD page, an annotation object is inserted at the same position in the corresponding page annotation layer, and the action of the annotation object is configured as an associated 3D action, with the triggering area of ​​the action being the same as the page position of the static preview image primitive. Once OFD is enabled, the action of the annotation object in the corresponding position is triggered according to the click command of the trigger area to activate the 3D model browsing plugin; Based on the plugin interface identifier corresponding to the activated associated 3D action, search the registry or environment variables in the system to find the software library that implements the corresponding plugin interface and load its browsing plugin. Based on the associated 3D action triggering area and the current document display window, set the working area of ​​the browsing plugin; Within the work area, the browsing plugin is rendered and interacted with.

2. The method for embedding a 3D model in an OFD document as described in claim 1, characterized in that, The formats of the 3D model data to be embedded include .obj, .stl, .rvt, .3ds, .CATPart, and .DGN, and the target format data includes PDV format.

3. The method for embedding a 3D model in an OFD document as described in claim 1, characterized in that, Embedding target format data as a resource in OFD includes: The target format data is converted and embedded as an independent multimedia resource into the Res directory inside the OFD document package, and a unique resource ID is assigned to it. The static preview image extracted from the target format data is embedded as an independent multimedia resource into the Res directory inside the OFD document package and assigned a unique resource ID.

4. The method for embedding a 3D model in an OFD document as described in claim 1, characterized in that, Configuring associated 3D actions includes the following key parameters: A resource ID parameter pointing to the embedded target format data; The type parameter describes the preferred interactive action after activation; Parameters adapted to the exchange operation; The plugin interface corresponding to the associated 3D action is "ofd.I3DViewer". Any plugin registered in the operating system that implements the corresponding interface can be called by the reading software.

5. The method for embedding a 3D model in an OFD document as described in claim 4, characterized in that, The action of the annotation object located at the same position as the primitive in the preview image is triggered based on the click command: Upon receiving a click on a trigger area on the page, the associated 3D action is triggered, and the control software parses out the corresponding interactive operation and its parameters associated with the 3D action.

6. The method for embedding a 3D model in an OFD document as described in claim 5, characterized in that, The process includes locating and loading software libraries that implement the plugin interface for 3D browsing plugins. It also includes: if no plugin is found, activating associated 3D actions fails, providing corresponding prompts through the interface, and controlling the static preview image of the current document at the corresponding location to be browsable.

7. The method for embedding a 3D model in an OFD document as described in claim 5, characterized in that, Set the working area of ​​the browsing plugin to the area where the associated 3D action triggering area intersects with the current document display window; After the browsing plugin is activated, the resource data stream, interactive operations, and their parameters corresponding to the relevant key parameters in the OFD document package are passed to the browsing plugin.

8. The method for embedding a 3D model in an OFD document as described in claim 7, characterized in that, In the work area, performing browser plugin rendering and interaction includes: Within the browsing plugin's workspace, initialize the 3D rendering environment and load the target format data; and... Based on the interactive operations and their parameters, render the initial presentation of the 3D model and provide interactive operations.

9. The method for embedding a 3D model in an OFD document as described in claim 1, characterized in that, Exit the current 3D mode by clicking on other parts of the page outside the associated 3D action trigger area, or by pressing a specified button.

10. A system for embedding a 3D model in an OFD document, characterized in that, It includes a processor and a memory, wherein the memory stores a computer program that, when executed by the processor, implements the steps of the method for embedding a three-dimensional model in an OFD document as described in any one of claims 1 to 9.

Images