Electronic manual development system and method for optical image measuring equipment

Abstract

The present invention relates to the technical field of interactive electronic manuals, and in particular to an electronic manual development system and method for optical image measurement equipment. The system comprises an optical equipment setting subsystem, an interactive information sorting subsystem, an NLP processing subsystem and a three-dimensional model subsystem; the NLP processing subsystem uses an NLP model to analyze and understand a knowledge base sorted by the interactive information sorting subsystem and an input query operation statement, so that the system has question-answering system, intelligent customer service and search engine functions, which is convenient for operators to directly use the system, manage documents, perform maintenance inspection and fault query in natural language; the three-dimensional model subsystem builds a three-dimensional model according to the parameters of the optical image acquisition equipment, and cooperates with the interactive information sorting subsystem that provides a dynamic user interface, so that the system integrates elements such as dynamic demonstration and interaction, improves the readability and practicality of information, saves use time and use cost, and improves the quality of document review.

Description

Technical Field

[0001] The invention belongs to the technical field of interactive electronic manuals, and in particular relates to an electronic manual development system and method for optical image measuring equipment. Background Art

[0002] At present, important documents such as technical documents and maintenance manuals of optical image measurement equipment are mostly in paper or electronic document form, lacking both unified management and convenient and accurate retrieval methods, which brings many inconveniences to operators in the process of teaching, using and maintaining the equipment. Although some equipment is equipped with relatively comprehensive electronic interactive manuals that can realize the integrated management of equipment-related documents, and equipment operators can perform various operations such as electronic document review, manual query of equipment failures, and retrieval of maintenance codes according to needs, such electronic interactive manuals are cumbersome to operate, cannot accurately identify keywords, and require a lot of time for software operation training. Existing document integration, graphic image demonstration and keyword retrieval methods lack flexibility and are difficult to provide more intuitive, convenient and efficient assistance to operators of optical image measurement equipment.

[0003] In the environment where optical image measurement equipment is widely used in shooting ranges, the number of accompanying paper technical materials has increased dramatically, and problems such as inconvenience in carrying, difficulty in updating, and time-consuming reference have become increasingly prominent. In addition, the existing electronic interactive manual technology is not intelligent enough in terms of information retrieval and human-computer interaction. In this situation, the three-dimensional interactive electronic manual of optical image measurement equipment based on natural language processing has become an effective solution to the above problems.

[0004] The Chinese patent publication number is CN105512395A, the publication date is April 20, 2016, and the patent name is "A method for making a three-dimensional interactive electronic manual". The disclosed method includes: providing interactive electronic manual materials, creating three-dimensional visualization materials, creating traditional materials, and making three-dimensional electronic manuals; using a three-dimensional interactive manual software system to write a product manual based on a three-dimensional model, including the construction of a product directory tree and the production of manual pages, manual publishing, and manual use. This method overcomes the defect that two-dimensional interactive electronic manuals cannot express three-dimensional information, but this method can only be done manually through page management, text input, and three-dimensional model insertion, which increases the update workload of manual users, and the use of Pro / E three-dimensional models is not intuitive enough, and the interactivity with manual users is not strong.

[0005] The Chinese patent publication number is CN114780498A, the publication date is July 22, 2022, and the invention patent application named "Electronic Interactive Manual" includes: XML (Extensible Markup Language) editor, workflow management module and content management module; XML editor is used to edit XML files; workflow management module is used to manage workflows according to requirements, including defining states, menus and actions for work respectively; content management module is used to use XML files to generate display pages. The advantages of this manual are that the manual can be managed in a digital way to achieve data reuse and reorganization; it can be archived in a standardized manner and saved in accordance with regulations; it is conducive to data integration and integration, and improves the utilization rate of data; for specific data, the manual can be protected to ensure that only authorized functional departments can view it, and any illegal access from outside or inside will be prohibited. However, this invention does not have the function of three-dimensional model input and interaction, and cannot prompt the fault code and maintenance period of the equipment. Summary of the invention

[0006] In view of this, the invention aims to provide an electronic manual development system and method for optical image measuring equipment. By setting up an NLP (Natural Language Processing) processing subsystem, the system is equipped with a question-and-answer system, intelligent customer service and search engine functions, which facilitates operators to directly use natural language for system use, document management, maintenance inspection and fault query; through the setting of a three-dimensional model subsystem, in conjunction with an interactive information sorting subsystem that provides a dynamic user interface, the system integrates elements such as dynamic demonstration and interaction, improves the readability and practicality of the information, helps equipment operators save time and cost, and improves the quality of document review.

[0007] To achieve the above object, the technical solution created by the present invention is implemented as follows:

[0008] An electronic manual development system for optical image measurement equipment comprises: an optical equipment setting subsystem for completing parameter setting of an optical image acquisition equipment; an interactive information sorting subsystem for collecting and processing instruction documents of the optical image acquisition equipment to obtain a content outline, a knowledge base and a multimedia material library, and to form a dynamic user interface; an NLP processing subsystem for analyzing and understanding the knowledge base and query operation statements input into the user interface by using an NLP model, obtaining a natural language text and an executable text understood by a device equipped with the electronic manual development system according to the understanding result, and displaying the natural language text on the user interface; a three-dimensional model subsystem for completing the construction and display of a three-dimensional model of the optical image acquisition equipment in the user interface according to the parameters of the optical image acquisition equipment, performing corresponding operations on the three-dimensional model according to the executable text, displaying the process of performing corresponding operations on the three-dimensional model in the user interface by using the multimedia material library, and exporting the three-dimensional model after the operation.

[0009] Furthermore, the interactive information organization subsystem includes: a content arrangement module, which collects instruction manual documents and classifies the instruction manual documents to obtain a detailed content outline; at the same time, the instruction manual documents are organized and the organized contents are classified according to the content outline, and the classified documents are the knowledge base; a multimedia processing module, which collects video information and audio information related to the optical image acquisition device to obtain a multimedia material library; a typesetting module, which completes the page layout of the user interface; and an interactive design module, which combines the knowledge base and the media material library to construct a user interface.

[0010] Furthermore, in the user interface, a hot spot area is set on the three-dimensional model, and by clicking a hot spot in the hot spot area, corresponding information pops up at a corresponding position of the three-dimensional model.

[0011] Furthermore, the NLP processing subsystem includes: a word segmentation module, which divides the input text into meaningful word units, and the input text includes a knowledge base and a query operation statement; a part-of-speech tagging module, which tags the corresponding part of speech for each word unit; a named entity recognition module, which identifies specific entities in the input text according to the part of speech and meaning of each word unit, and then determines the key information in the input text; a syntactic analysis module, which analyzes the sentence structure in the input text and determines the grammatical relationship between the word units in the sentence; a semantic understanding module, which converts the input text into a corresponding executable text using an NLP model according to the part of speech and meaning of each word unit, the determined key information and the grammatical relationship between the word units in the sentence; a text generation module, which matches the executable text corresponding to the query operation statement with the executable text corresponding to the knowledge base, passes the operation content in the matching result to the three-dimensional model subsystem, converts the text content in the matching result into natural language text, and passes the natural language text to the interactive information sorting subsystem and displays it in the user interface.

[0012] Furthermore, the text generation module analyzes and understands previous query operation statements and their corresponding matching results to obtain user habit patterns; when receiving executable text corresponding to a new query operation statement, the text generation module matches the executable text in combination with the user habit patterns.

[0013] Furthermore, the three-dimensional model subsystem includes: a modeling module, which builds a three-dimensional model of the optical image acquisition device according to the parameters of the optical image acquisition device; an interaction module, which receives operation content and performs corresponding operations on the three-dimensional model according to the operation content, and transmits the results of the operation to the interactive information sorting subsystem and displays them in the user interface; a publishing module, which exports the three-dimensional model after the operation; an animation module, which cooperates with the interaction module and uses the video and audio in the multimedia material library to display the process of performing corresponding operations on the three-dimensional model in the user interface; a rendering module, which cooperates with the modeling module to increase the details of the three-dimensional model; and a data integration module, which associates the three-dimensional model with the parameter information of the optical image acquisition device.

[0014] Furthermore, the data integration module converts external data in other formats into data in a format required by the device equipped with the electronic manual development system; and at the same time changes the format of the data exported by the publishing module.

[0015] Furthermore, the optical device setting subsystem includes an interface for setting parameters of the optical image acquisition device.

[0016] A method for developing an electronic manual for an optical image measuring device, characterized in that it comprises the following steps:

[0017] S1: Building the electronic manual development system provided by the present invention, embedding the trained NLP model into the NLP processing subsystem, embedding the 3D modeling plug-in into the 3D model subsystem, and forming a user interface;

[0018] S2: Determine the optical image acquisition device of the manual to be developed in the optical device setting subsystem and input its parameters;

[0019] S3: collecting and processing the relevant knowledge and instruction documents of the optical image acquisition device determined in step S2 through the interactive information sorting subsystem and the NLP processing subsystem to obtain a knowledge base of the optical image acquisition device;

[0020] S4: using the three-dimensional model subsystem to generate a three-dimensional model of the optical image acquisition device according to the parameters input in step S2, and displaying the three-dimensional model in the user interface;

[0021] S5: The NLP processing subsystem analyzes and understands the knowledge base and query operation statements to obtain natural language text and executable text; the natural language text is displayed on the user interface, and the 3D model subsystem performs corresponding operations on the 3D model according to the executable text, and displays the process of performing corresponding operations on the 3D model in the user interface.

[0022] Further, step S3 includes the following steps:

[0023] S31: The interactive information sorting subsystem classifies the relevant knowledge and obtains a content outline;

[0024] S32: the interactive information sorting subsystem extracts key knowledge points and important data from the instruction document, and classifies the sorted information according to the content outline obtained in step S31;

[0025] S33: optimizing the text classified in step S32 according to the content outline and the organized information in combination with the multimedia material library to obtain a knowledge base;

[0026] S34: The NLP processing subsystem analyzes and understands the knowledge base to obtain executable text.

[0027] Compared with the prior art, the invention can achieve the following beneficial effects:

[0028] (1) In the electronic manual development system and method for the optical image measurement device created by the present invention, by using NLP technology, when searching for information in the electronic interactive manual, the equipment operator does not need to use precise professional terms, but only needs to describe the problem in daily natural language; NLP will analyze its semantics, accurately understand the needs of the equipment operator, and quickly locate the troubleshooting content related to image blur in the manual. This intelligent search function can greatly improve the efficiency of equipment operators in obtaining information and reduce the difficulty of searching due to unfamiliar professional vocabulary; the three-dimensional model subsystem provides an intuitive three-dimensional visualization effect, and the equipment operator can more quickly and accurately understand the structure and working principle of the equipment when learning the relevant knowledge of the optical image measurement equipment. At the same time, the three-dimensional model subsystem cooperates with the dynamic user interface provided by the interactive information sorting subsystem to transform the electronic interactive manual from a static information display to a dynamic interactive experience; the equipment operator can actively participate in the exploration and operation of the three-dimensional model of the equipment, and the added interactivity can increase the equipment operator's sense of participation and learning interest;

[0029] (2) In the electronic manual development system and method for optical image measurement equipment created by the present invention, the text generation module in the NLP processing subsystem can analyze the historical query records and browsing behaviors of the equipment operator, and the electronic interactive manual can provide personalized content recommendations for the equipment operator, actively recommending some common fault prevention measures and new maintenance case-related content. This helps the equipment operator discover useful information that they may be interested in but have not yet paid attention to. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The drawings constituting part of the present invention are used to provide a further understanding of the present invention. The exemplary embodiments and descriptions of the present invention are used to explain the present invention and do not constitute an improper limitation on the present invention. In the drawings:

[0031] Figure 1 A schematic diagram of the structure of an electronic manual development system for an optical image measuring device according to an embodiment of the present invention;

[0032] Figure 2 A schematic flow chart of a method for developing an electronic manual for an optical image measuring device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0033] In order to make the purpose, technical solution and advantages of the invention more clear, the invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described here are only used to explain the invention and do not constitute a limitation of the invention.

[0034] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0035] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention. In addition, the terms "first", "second", etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0036] In the description of the invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installation", "connection" and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the invention can be understood according to specific circumstances.

[0037] The present invention will be described in detail below with reference to the accompanying drawings and in combination with embodiments.

[0038] like Figure 1 As shown, the electronic manual development system of the optical image measurement device described in the embodiment of the invention includes an optical device setting subsystem, an interactive information sorting subsystem, an NLP processing subsystem and a three-dimensional model subsystem. Among them, the optical device setting subsystem completes the parameter setting of the optical image acquisition device. The interactive information sorting subsystem collects and processes the instruction document of the optical image acquisition device, obtains the content outline, knowledge base and multimedia material library, and forms a dynamic user interface. The NLP processing subsystem uses the NLP model to analyze and understand the knowledge base and the query operation statement input in the user interface, and obtains the natural language text and the executable text that can be understood by the device equipped with the electronic manual development system according to the understanding result, and the natural language text is displayed on the user interface. The three-dimensional model subsystem completes the construction and display of the three-dimensional model of the optical image acquisition device in the user interface according to the parameters of the optical image acquisition device, and performs corresponding operations on the three-dimensional model according to the executable text, uses the multimedia material library to display the process of performing corresponding operations on the three-dimensional model in the user interface, and exports the three-dimensional model after the operation.

[0039] Specifically, the optical device setting subsystem includes an interface for setting the parameters of the optical image acquisition device, and the relevant parameters of the optical image acquisition device of the electronic manual to be developed are input through the interface. In some embodiments, the interface of the optical device setting subsystem can be connected to input devices such as a keyboard and a mouse, and the optical image measurement device and its relevant parameters of the manual to be developed are input on the keyboard, and other subsystems can be called to complete the document preparation and three-dimensional modeling of the optical image measurement device with the click of the mouse; in some embodiments, the interface in the optical device setting subsystem can also be connected to a three-dimensional laser scanner, that is, a three-dimensional laser scanner is used to scan the optical image measurement device of the electronic manual to be developed, and the scanner measures the distance information of each point on the surface of the optical image measurement device by emitting a laser beam and receiving reflected light to generate the point cloud data of the device. After obtaining the point cloud data, the point cloud processing software Geomagic is used for processing; finally, the point cloud data is subjected to denoising, splicing, simplification and other operations, and the point cloud is converted into a three-dimensional mesh model, thereby obtaining the relevant parameters of the optical image acquisition device. This method can quickly and accurately obtain the true shape of the device, and is suitable for the modeling of complex optical image measurement devices.

[0040] The interactive information arrangement subsystem includes a content arrangement module, a typesetting module, a multimedia processing module and an interactive design module. The content arrangement module collects the instruction documents and classifies the instruction documents to obtain a detailed content outline; at the same time, the instruction documents are arranged and the arranged contents are classified according to the content outline, and the classified documents are the knowledge base. In an embodiment of the present invention, the content arrangement module is implemented by Adobe InDesign (a set of typesetting tools) and Microsoft Word (a document editing tool), and the classification, arrangement and induction of the instruction documents are completed to obtain a knowledge base. The typesetting module completes the page layout of the user interface, which is completed by Adobe InDesign in an embodiment of the present invention. A friendly operation interface is designed in the user interface, including a navigation bar, a search box, an information display area, etc., to ensure that the equipment operator can easily operate and browse the manual content. The multimedia processing module collects video information and audio information related to the optical image acquisition device to obtain a multimedia material library. In the embodiment of the present invention, the multimedia processing module is implemented by Adobe Premiere Pro software and Adobe Audition software. Premiere Pro software is used for operations such as editing, editing, adding special effects and subtitles, etc., to produce high-quality manual video content; Adobe Audition software adds audio content to the electronic interactive manual, such as operation prompt sounds, explanation audio, etc. It can perform operations such as audio recording, editing, mixing and noise reduction to ensure the quality and effect of the audio. The interactive design module combines the knowledge base and the media material library to build a user interface. In the embodiment of the present invention, the interactive design module is implemented by Axure RP. Axure RP can help quickly build annotated prototypes in the form of components, and can provide dynamic demonstration files of basic functions or page logic for the user interface by means of custom reusable components, dynamic panels and rich scripts, thereby building a dynamic user interface.

[0041] Preferably, in the user interface, a hot spot area is set on the three-dimensional model and is associated with relevant text, picture, video and other information. By clicking a hot spot in the hot spot area, corresponding information pops up at the corresponding position of the three-dimensional model.

[0042] Natural language processing plays an important role and has broad application prospects in document manuals. By adopting the deep learning model of NLP, the present invention makes the interactive electronic manual of the optical image measurement device have many advantages:

[0043] (1) In terms of document and manual creation: Natural language processing technology can realize the rapid analysis and organization of a large number of paper or traditional electronic documents; it can automatically extract key information from documents, classify and annotate the content, and make the document materials more orderly; for technical documents of optical image measurement equipment, natural language processing can identify key content such as equipment specifications, operating procedures, fault phenomena, etc., and classify and store them, providing basic data for the creation of electronic interactive manuals (IETM);

[0044] (2) In terms of document and manual retrieval: Natural language processing has greatly improved the accuracy and convenience of retrieval. Traditional document retrieval often relies on keyword matching, but this method is prone to missed detection or false detection. Natural language processing technology can understand the natural language questions input by equipment operators, and through semantic analysis and context understanding, it can more accurately locate the information required by equipment operators. Equipment operators no longer need to guess the exact keywords, but only need to describe the problem in everyday language to quickly obtain relevant document content.

[0045] (3) In terms of document manual interaction: Natural language processing brings a more intelligent interactive experience to document manuals; with the intelligent question-and-answer system, equipment operators can ask questions to the document manual in a conversational manner. The system uses natural language processing technology to understand the questions and give accurate answers. At the same time, natural language processing can also analyze the feedback from equipment operators, continuously optimize the content and retrieval algorithms of the document manual, and improve the satisfaction and interactivity of equipment operators.

[0046] (4) In terms of document manual updates: Natural language processing can automatically monitor new information and technological developments in related fields, and promptly remind document manual maintainers to update them. During the update process, natural language processing technology can assist in content integration and optimization, ensuring that document manuals are always kept up to date and most accurate.

[0047] In short, the combination of natural language processing and electronic interactive manuals provides equipment operators with a more efficient, convenient, and intelligent document review and usage experience, which is of great significance for improving work efficiency and reducing training costs.

[0048] In the electronic manual development system of the optical image measuring device described in the embodiment of the invention, the NLP processing subsystem includes a word segmentation module, a part-of-speech tagging module, a named entity recognition module, a syntactic analysis module, a semantic understanding module and a text generation module.

[0049] The word segmentation module divides the input text into meaningful word units, where the input text includes the knowledge base and query operation statements. For the electronic interactive manual of the optical image measurement equipment, accurate word segmentation can help the equipment operator better locate key information during retrieval. For example, when the equipment operator enters "image measurement equipment failure", the word segmentation module can correctly divide it into words such as "image", "measurement", "equipment", and "failure" for subsequent processing and analysis. The part-of-speech tagging module marks the corresponding part of speech for each word unit, such as noun, verb, adjective, etc.; in the electronic interactive manual, part-of-speech tagging can help understand the grammatical structure and semantic relationship of the text. The named entity recognition module identifies specific entities in the input text according to the part of speech and meaning of each word unit, such as equipment number, task code, fault code, time, date, etc., and then quickly determines the key information in the input text. The syntactic analysis module analyzes the sentence structure in the input text and determines the grammatical relationship between word units in the sentence; in the electronic interactive manual, syntactic analysis can enable the NLP model to better understand the intention of the equipment operator and improve the accuracy of information retrieval; for the system, the syntactic analysis module can help the system understand the structure of the questions raised by the equipment operator, so as to more accurately extract relevant information from the knowledge base to answer; for the equipment operator, the syntactic analysis module helps the equipment operator better understand the text content such as the equipment operation steps and maintenance instructions. The semantic understanding module converts the input text into the corresponding executable text based on the part of speech and meaning of each word unit, the determined key information and the grammatical relationship between the word units in the sentence through word vector representation, semantic network and other technologies combined with the NLP model; in the electronic interactive manual, the semantic understanding module can help achieve more accurate retrieval and intelligent question and answer. The text generation module matches the executable text corresponding to the query operation statement with the executable text corresponding to the knowledge base, passes the operation content in the matching result to the three-dimensional model subsystem, converts the text content in the matching result into natural language text, and passes the natural language text to the interactive information sorting subsystem and displays it in the equipment operator interface. In the electronic interactive manual, the text generation module can be used to automatically generate text content such as equipment operating instructions and maintenance reports. The text generation module also has an automated recommendation function, which generates and recommends relevant maintenance or suggestion texts based on the historical input information of the equipment operator or user needs; specifically, the text generation module analyzes and understands previous query operation statements and their corresponding matching results to obtain user habit patterns; when receiving the executable text corresponding to a new query operation statement, the text generation module matches the executable text in combination with the user habit pattern; the module analyzes and understands a large amount of historical data, extracts key information and user habit patterns, and provides accurate and valuable text suggestions for equipment operators.

[0050] The software platform that the 3D model subsystem relies on is not limited to Cortona3D and 3ds Max. Specifically, the 3D model subsystem includes a modeling module, an interaction module, a publishing module, an animation module, a rendering module, and a data integration module. Among them, the modeling module creates a high-precision 3D model for the equipment operator, including the appearance and internal structure of the optical image measurement equipment; the modeling module meets the modeling requirements of different types of equipment; the equipment operator can accurately restore the true form of the optical image measurement equipment and provide realistic visualization effects for the electronic interactive manual. The interactive module receives the operation content, and performs corresponding operations on the 3D model according to the operation content, and passes the results of the operation to the interactive information sorting subsystem and displays it in the user interface; this module can realize the equipment operator's rotation, scaling, sectioning and other operations on the equipment model, as well as the function of clicking on the components of the 3D model to obtain relevant information. The animation module cooperates with the interaction module to display the process of performing corresponding operations on the three-dimensional model in the user interface using the video and audio in the multimedia library, which is used to create dynamic three-dimensional animation effects; in the electronic interactive manual, the animation module can show the working principle and operation process of the equipment; by making the equipment startup process animation and measurement process animation, the equipment operator can more intuitively understand the operation mode of the equipment; the animation module allows the equipment operator to control the playback of the animation by clicking, dragging and other operations, which enhances the equipment operator's sense of participation and learning effect. The rendering module cooperates with the modeling module to increase the details of the three-dimensional model and is responsible for rendering the three-dimensional model into a realistic image; the rendering module provides a variety of rendering technologies and effects, such as lighting, materials, shadows, etc., which can make the three-dimensional model look more realistic; in the electronic interactive manual, high-quality rendering effects can enhance the visual experience of the equipment operator and allow the equipment operator to better observe the details and features of the equipment. The data integration module is used to integrate the 3D model with other data, such as the technical parameters, operating instructions, and maintenance manuals of the equipment; in the electronic interactive manual, the data integration module can associate this information with the 3D model, so that the equipment operator can easily obtain relevant documents while viewing the model; the data integration module can also support the import and export of multiple data formats, which is convenient for data exchange with other software. The publishing module publishes the created 3D model and electronic interactive manual to different platforms, such as stand-alone web pages, portable mobile devices, etc.; the publishing module provides a variety of publishing formats and options to meet the needs of different equipment operators.

[0051] In the embodiment of the present invention, the 3D model subsystem is implemented by using the Cortona3D tool. The Cortona3D software plays an important role in the interactive electronic manual of the optical image measurement device:

[0052] 1) Powerful 3D visualization function: Cortona3D can create realistic 3D models for optical image measurement equipment, presenting complex equipment structures in an intuitive electronic interactive manual; equipment operators can observe the equipment in all directions through operations such as rotation, scaling, and cutting, and better understand its internal structure and working principle; this 3D visualization effect is unattainable by traditional paper manuals, greatly improving equipment operators' awareness of the equipment;

[0053] 2) Interactive operation: After integrating Cortona3D into the electronic interactive manual, equipment operators can interact with the 3D model; for example, by clicking on different parts of the equipment, they can view its detailed information, technical parameters and operating instructions. This interactive operation experience makes learning and using the equipment more vivid and interesting, reduces the learning cost of equipment operators, and improves training efficiency;

[0054] 3) Fault diagnosis and maintenance assistance: Cortona3D can simulate the fault status of the equipment to help equipment operators quickly locate the problem; when the equipment fails, the electronic interactive manual can use Cortona3D to show the location of the faulty parts and possible causes, and provide corresponding maintenance suggestions and steps; this greatly shortens the troubleshooting time and improves the availability and reliability of the equipment;

[0055] 4) Easy to update and expand: With the continuous upgrading and improvement of optical image measurement equipment, the electronic interactive manual also needs to be updated in a timely manner; Cortona3D can easily update the 3D model and related information of the equipment to ensure that the manual is always consistent with the actual equipment; at the same time, it can also be expanded according to the needs of equipment operators, adding new functional modules and content to meet the personalized needs of different equipment operators.

[0056] The combination of Cortona3D and the electronic interactive manual provides strong support for the use and maintenance of optical image measurement equipment, making the operation of the equipment easier and more efficient, and troubleshooting faster and more accurate.

[0057] The embodiment of the present invention also provides an electronic manual development method for an optical image measuring device, comprising the following steps:

[0058] S1: Build an electronic manual development system for the optical image measurement device described in the embodiment of the invention, embed the trained NLP model into the NLP processing subsystem, embed the 3D modeling plug-in into the 3D model subsystem, and form a user interface.

[0059] S2: Determine the optical image acquisition device of the manual to be developed in the optical device setting subsystem and input its parameters. The parameters include external parameters and internal parameters of the optical image acquisition device. The external parameters include the overall size and dimensions of each component of the optical image acquisition device, which can be directly obtained through the instruction document or actual measurement; the internal parameters are the original BIT (built-in self-test) information of the optical image acquisition device. The original BIT information is obtained in the following way: in the process of using the optical image acquisition device to acquire the real background image, BIT runs automatically when the optical image acquisition device is started to ensure that all key hardware components are in normal working condition. BIT can detect various types of hardware failures, and can add various types of software failure states according to other subsystems of the device. Since only random targets need to be acquired and there are no other special requirements, the optical measurement equipment does not have high requirements on the working distance, and the range of lens parameters is very wide. Generally, commercial finished lenses can be used with ordinary visible light CCD or CMOS detectors.

[0060] S3: Collect and process the relevant knowledge and instruction documents of the optical image acquisition device determined in step S2 through the interactive information sorting subsystem and the NLP processing subsystem to obtain a knowledge base of the optical image acquisition device. Step S3 includes the following steps:

[0061] S31: The interactive information sorting subsystem systematically sorts out the relevant knowledge and classifies the content according to the equipment structure, function, operation process, technical solution, troubleshooting, etc. According to the classification results, a detailed content outline is formulated to clarify the specific content and presentation method of each chapter and each knowledge point;

[0062] S32: Collect various documents and materials of the optical image measurement equipment, including product manuals, technical manuals, maintenance reports, etc.; screen, organize and classify the collected materials, remove duplicate and outdated information, extract key knowledge points and important data, and classify the organized information according to the content outline obtained in step S31;

[0063] S33: Write the text content of the electronic interactive manual according to the content outline and the organized information. In the process of writing the text, fully consider the application requirements of NLP Cortona3D and reasonably set keywords, semantic tags, etc. Optimize the written text, check for grammatical errors, logical coherence, etc., and adjust and supplement it according to the multimedia material library to obtain the knowledge base;

[0064] S34: The NLP processing subsystem analyzes and understands the knowledge base, and adjusts the parameters of the model to enable it to learn the language patterns and semantic relationships in the information to obtain executable text, providing information support for the automatic generation of recommendations by the text generation module.

[0065] S4: Generate a three-dimensional model of the optical image acquisition device using the three-dimensional model subsystem according to the parameters input in step S2, and display the three-dimensional model in the user interface. During the modeling process, ensure the accuracy and precision of the model, including the appearance, internal structure, and details of each component of the device. The three-dimensional model at this time is a static model and cannot be modified or adjusted.

[0066] S5: The NLP processing subsystem analyzes and understands the knowledge base and query operation statements to obtain natural language text and executable text; the natural language text is displayed on the user interface, and the 3D model subsystem performs corresponding operations on the 3D model according to the executable text, and displays the process of performing corresponding operations on the 3D model in the user interface. Animation demonstrations are made based on the operation process and working principle to clearly show the operation process and operation steps of the equipment. For some key knowledge points and complex concepts, relevant pictures, videos and other multimedia materials are made to assist equipment operators in understanding.

[0067] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the disclosure of the present invention can be performed in parallel, sequentially or in different orders, as long as the desired results of the technical solution disclosed in the present invention can be achieved, and this document does not limit this.

[0068] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An electronic manual development system for an optical image measuring device, characterized in that: include: The optical device setting subsystem completes the parameter setting of the optical image acquisition device; the optical device setting subsystem includes an interface for setting the parameters of the optical image acquisition device; the interface is connected to a three-dimensional laser scanner, and the three-dimensional laser scanner is used to scan the optical image measuring device of the electronic manual to be developed; the three-dimensional laser scanner generates point cloud data of the device by measuring the distance information of each point on the surface of the optical image measuring device by emitting a laser beam and receiving reflected light; after obtaining the point cloud data, the point cloud processing software Geomagic is used for processing; finally, the point cloud data is denoised, spliced, streamlined, and the point cloud is converted into a three-dimensional mesh model, thereby obtaining the relevant parameters of the optical image acquisition device; An interactive information sorting subsystem collects and processes the instruction documents of the optical image acquisition device to obtain a content outline, a knowledge base and a multimedia material library, and forms a dynamic user interface; An NLP processing subsystem, using an NLP model to analyze and understand the knowledge base and the query operation statement input into the user interface, and obtaining a natural language text and an executable text understood by the device equipped with the electronic manual development system according to the understanding result, and the natural language text is displayed on the user interface; a three-dimensional model subsystem, which completes the construction and display of the three-dimensional model of the optical image acquisition device in the user interface according to the parameters of the optical image acquisition device, performs corresponding operations on the three-dimensional model according to the executable text, displays the process of performing corresponding operations on the three-dimensional model in the user interface using the multimedia material library, and exports the three-dimensional model after the operation; The NLP processing subsystem includes: A word segmentation module, which segments an input text into meaningful word units, wherein the input text includes the knowledge base and the query operation statement; The part-of-speech tagging module tags the corresponding part of speech for each word unit; A named entity recognition module, which identifies specific entities in the input text according to the part of speech and meaning of each word unit, and then determines the key information in the input text; A syntactic analysis module, which analyzes the sentence structure in the input text and determines the grammatical relationship between word units in the sentence; A semantic understanding module, which converts the input text into corresponding executable text using the NLP model according to the part of speech and meaning of each word unit, the determined key information, and the grammatical relationship between the word units in the sentence; A text generation module matches the executable text corresponding to the query operation statement with the executable text corresponding to the knowledge base, passes the operation content in the matching result to the three-dimensional model subsystem, converts the text content in the matching result into the natural language text, and passes the natural language text to the interactive information sorting subsystem and displays it in the user interface.

2. The electronic manual development system for an optical image measuring device according to claim 1, characterized in that: The interactive information sorting subsystem includes: A content arrangement module collects the instruction documents and classifies the instruction documents to obtain a detailed content outline; at the same time, the instruction documents are sorted and the sorted contents are classified according to the content outline, and the classified documents are the knowledge base; A multimedia processing module collects video information and audio information related to the optical image acquisition device to obtain the multimedia material library; A typesetting module, completing the page layout of the user interface; The interactive design module combines the knowledge base and the media material library to construct the user interface.

3. The electronic manual development system for an optical image measuring device according to claim 2, characterized in that: In the user interface, a hot spot area is set on the three-dimensional model, and by clicking a hot spot in the hot spot area, corresponding information pops up at a corresponding position of the three-dimensional model.

4. The electronic manual development system for an optical image measuring device according to claim 1, characterized in that: The text generation module analyzes and understands previous query operation statements and their corresponding matching results to obtain user habit patterns; when receiving executable text corresponding to a new query operation statement, the text generation module matches the executable text in combination with the user habit patterns.

5. The electronic manual development system for optical image measuring equipment according to claim 1, characterized in that: The three-dimensional model subsystem includes: A modeling module, which builds a three-dimensional model of the optical image acquisition device according to the parameters of the optical image acquisition device; An interactive module receives the operation content, performs corresponding operations on the three-dimensional model according to the operation content, transmits the result of the operation to the interactive information sorting subsystem and displays it in the user interface; Publishing module, exporting the 3D model after operation; An animation module cooperates with the interaction module to display the process of performing corresponding operations on the three-dimensional model in the user interface using the video and audio in the multimedia material library; A rendering module, cooperating with the modeling module to increase the details of the three-dimensional model; A data integration module associates the three-dimensional model with parameter information of the optical image acquisition device.

6. The electronic manual development system for an optical image measuring device according to claim 5, characterized in that: The data integration module converts external data in other formats into data in the format required by the device equipped with the electronic manual development system; and at the same time changes the format of the data exported by the publishing module.

7. A method for developing an electronic manual for an optical image measuring device, characterized in that: The following steps are involved: S1: constructing the electronic manual development system as claimed in any one of claims 1 to 6, embedding the trained NLP model into the NLP processing subsystem, embedding the 3D modeling plug-in into the 3D model subsystem, and forming the user interface; S2: Determine the optical image acquisition device for which the manual is to be developed in the optical device setting subsystem, and input its parameters; S3: collecting and processing the relevant knowledge and instruction document of the optical image acquisition device determined in step S2 by the interactive information sorting subsystem and the NLP processing subsystem to obtain a knowledge base of the optical image acquisition device; S4: using the three-dimensional model subsystem to generate a three-dimensional model of the optical image acquisition device according to the parameters input in step S2, and displaying the three-dimensional model in the user interface; S5: The NLP processing subsystem analyzes and understands the knowledge base and the query operation statement to obtain the natural language text and the executable text; The natural language text is displayed on the user interface, and the three-dimensional model subsystem performs corresponding operations on the three-dimensional model according to the executable text, and displays the process of performing corresponding operations on the three-dimensional model in the user interface.

8. The electronic manual development method of the optical image measuring device according to claim 7, characterized in that: Step S3 includes the following steps: S31: the interactive information sorting subsystem classifies the relevant knowledge into content categories to obtain the content outline; S32: the interactive information sorting subsystem extracts key knowledge points and important data from the instruction document, and classifies the sorted information according to the content outline obtained in step S31; S33: optimizing the text classified in step S32 according to the content outline and the organized information in combination with the multimedia material library to obtain the knowledge base; S34: The NLP processing subsystem analyzes and understands the knowledge base to obtain the executable text.

Images