Modeling system for virtual training of ship device

Abstract

The invention belongs to the technical field of virtual reality training, and particularly relates to a modeling system for virtual training of a ship device. Comprising a man-machine interaction layer, a data communication layer and a visual modeling layer. The man-machine interaction layer comprises a signal acquisition module, an instruction generation module, an instruction fusion module and a signal sending module; the data communication layer comprises a signal transmitting terminal and a data receiving terminal; the visual modeling layer comprises a data reading component, a parametric modeling component, a position feature editing component, a structural feature editing component and a flow editing processing component; the modeling system for virtual training of the ship device mainly provides an optimized and conceptual stock device modeling scheme based on existing software and hardware equipment of a current virtual training system of the ship device, and provides an efficient device modeling scheme based on virtual reality interaction based on the optimized and conceptual stock device modeling scheme so as to meet diversified training contents and improve the training efficiency. And a solution is provided for improving the training quality and reducing a large amount of repeated modeling operations.

Description

Technical Field

[0001] The invention belongs to the technical field of virtual reality training, and in particular relates to a modeling system for virtual training of ship devices. Background Art

[0002] In order to improve the quality of training on the principles and operation techniques of ship devices and achieve a training experience closer to actual training operations, virtual reality training technology has been introduced into the corresponding training process. Based on virtual reality training technology, it can provide students with better display effects and enable them to gain more direct understanding and feelings. With the development of virtual training for various types of devices, the pressure on modeling of massive devices and supporting equipment in the training process has gradually increased. At the same time, there is also a need for synchronous virtual training for different types of devices during the training process. At the same time, although these devices have different characteristics in the model structure, their basic structural composition and combination method are basically the same, and they have the potential for real-time editing and processing during the modeling process to achieve multi-type switching and free combination. Summary of the invention

[0003] The object of the present invention is to provide a modeling system for virtual training of ship equipment, which can be used in the virtual training process of ship equipment, has richer rapid modeling, flexible configuration of multiple types of equipment components, and has editable modeling functions.

[0004] To achieve the above purpose, the present invention adopts the following technical solution.

[0005] A modeling system for virtual training of ship equipment, consisting of a human-computer interaction layer, a data communication layer, and a visual modeling layer;

[0006] The human-computer interaction layer includes a signal acquisition module, a command generation module, a command fusion module, and a signal sending module;

[0007] The signal acquisition module refers to a human-machine interaction signal acquisition unit such as an electromyography signal acquisition unit, an eye movement signal acquisition unit, and a gesture signal acquisition unit;

[0008] The instruction generation module is used to judge the human-computer interaction signal obtained by the signal acquisition module to confirm whether it matches the interaction signal corresponding to the preset interaction instruction. If the signal matches, the corresponding interaction instruction is generated and sent to the instruction fusion module;

[0009] The instruction fusion module obtains the interactive instructions generated by the instruction generation module and collected by various signal acquisition modules based on the preset cycle or rule, and determines whether it matches the preset instruction combination or instruction rule. If it matches, it outputs the specific signal content represented by the corresponding combination or rule to the signal sending module;

[0010] The instruction fusion module stores instruction data sets that match each human-computer interaction signal acquisition unit, and establishes a multi-signal fusion rule library; outputs corresponding fusion instructions according to the multi-signal fusion rules;

[0011] The data communication layer includes a signal transmitting terminal arranged at the data processing end of each human-computer interaction signal acquisition unit and a data receiving terminal arranged at the visual modeling layer.

[0012] The interactive signal acquisition unit data processing end creates the acquisition unit address, data port, and port ID for each human-computer interaction signal acquisition unit. After the system is in place, as a client, it reads the corresponding information and establishes data communication with the data receiving terminal.

[0013] The visual modeling layer includes data reading components, parametric modeling components, location feature editing components, structural feature editing components, and process editing and processing components;

[0014] The data reading component is used to read the three-dimensional geometric data files and mesh data files that conform to the OCCT standard;

[0015] The parametric modeling component is used to read the fusion instructions extracted by the human-computer interaction layer and complete the standardized modeling by parsing them into parametric modeling data; the standardized modeling refers to completing the attribute definition of the parametric model using the acquired parametric modeling data according to the preset logic;

[0016] The position feature editing component is used to edit the position of the model obtained by input or modeling, and the position editing includes at least translation of the model, rotation of the model, etc.; specifically, it refers to generating corresponding position editing parameters according to the position editing instruction, and editing the position coordinates of the model through the OCCT position editing function interface;

[0017] The structural feature editing component is used to read the instructions extracted by the human-computer interaction layer, decode them into corresponding feature operation instructions, and complete the model structural feature editing through the OCCT standard function; the model structural feature editing at least includes local stretching deformation, corner processing, hole and slot structure editing and Boolean operations on the aforementioned editing contents;

[0018] The process processing component is used to complete the undo and redo of the aforementioned instructions, and at least includes the establishment of an instruction and data cache library for temporarily storing several editing instructions and instruction data content before and after the current editing operation, including extracting the process instruction parameters in the fusion instruction, and undoing or redoing the editing operation according to the specific content of the process instruction, and updating the instruction and data cache library in real time after each step of the operation.

[0019] A further improvement or preferred implementation of the aforementioned modeling system for virtual training of ship equipment, wherein the instruction generation module establishes a signal acquisition training process for various human-computer interaction signals, obtains various human-computer interaction signal data, and converts them into recognizable computer instructions, extracts several human-computer interaction signal data with the best identifiability as pre-selected interaction signals for interaction instructions; sorts out the pre-selected interaction signals, establishes a mapping table of pre-selected interaction signals corresponding to interaction operations, establishes instructions and instruction combinations, analyzes the feasibility of interaction operations for forming continuous instructions or instruction sets, and eliminates interaction operation combinations that are difficult to implement; the interaction operations include at least interaction gestures and eye movements.

[0020] A further improvement or preferred implementation of the aforementioned modeling system for virtual training of ship equipment, as a preferred scheme, the command combination or command matching rules include at least one or more of the following: movement instructions for simulating the target position of the mouse based on eye movement signals; selection instructions for models, entities or model elements based on a combination of eye movement and gestures; model selection, operation, import and export instructions based on electromyography signals and eye movement signals; model structure feature editing instructions based on electromyography signals and eye movement signals.

[0021] A further improvement or preferred implementation of the aforementioned modeling system for virtual training of ship equipment, wherein the parameterized model includes at least a standard cube model, a standard cylinder model, a standard truncated cone model, and a standard sphere model; for the standard cube model, its parameterized modeling data includes at least a model ID, a model position coordinate, and the length of the three-axis coordinates of the cuboid; for the standard cylinder model, its parameterized modeling data includes at least a model ID, a model position coordinate, a cylinder radius, a cylinder axis direction, and a cylinder height; for the standard truncated cone model, its parameterized modeling data includes at least a model ID, a model position coordinate, a truncated cone bottom radius, a truncated cone top radius, a truncated cone circumference, and a truncated cone height; for the standard sphere model, its parameterized modeling data includes at least a model ID, a model position coordinate, and a sphere radius.

[0022] A further improvement or preferred implementation of the aforementioned modeling system for virtual training of ship equipment, wherein the translation position editing at least includes extracting the target object ID targeted by the translation instruction in the fusion instruction, selecting and displaying it distinctively so that the user can confirm whether the target object has been successfully selected, extracting the translation distance and translation direction parameters in the fusion instruction, and generating corresponding visual navigation information so that the user can confirm whether the various parameters are consistent with the instruction; the rotation position editing at least includes extracting the target object ID targeted by the rotation instruction in the fusion instruction, selecting and displaying it distinctively so that the user can confirm whether the target object has been successfully selected, determining the corresponding rotation axis and rotation angle according to the rotation instruction parameters, and generating corresponding visual navigation information so that the user can confirm whether the various parameters are consistent with the instruction.

[0023] A further improvement or preferred embodiment of the aforementioned modeling system for virtual training of ship devices, wherein the stretch deformation editing at least includes extracting the stretch deformation instruction parameters in the fusion instruction, selecting and highlighting the stretching surface involved in the parameters, determining the corresponding stretching direction and edge angle according to the stretch deformation instruction parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether the parameters are consistent with the instruction;

[0024] The corner processing editing at least includes extracting corner processing instruction parameters in the fusion instruction, selecting and highlighting the edge line or the angle formed by several edge lines to be edited, determining the distance and size of the cutting or rounding processing according to the corner processing parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether the parameters are consistent with the instruction;

[0025] The hole slot structure editing at least includes extracting the hole slot structure instruction parameters in the fusion instruction, selecting and highlighting the punching surface and hole coordinates that need to be edited, determining the hole diameter, depth and hole type according to the hole slot structure parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether the various parameters are consistent with the instruction. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a data flow chart of a modeling system used for virtual training of ship installations; DETAILED DESCRIPTION

[0027] The present invention is described in detail below in conjunction with specific embodiments.

[0028] The modeling system for virtual training of ship equipment in the present application is mainly based on the existing software and hardware equipment of the current ship equipment virtual training system, providing an optimized and conceptual stock equipment modeling solution, and on this basis, providing an efficient equipment modeling solution based on virtual reality interaction, which is used to meet the diverse training content, and provide a solution for improving training quality and reducing repetitive large-scale modeling operations.

[0029] like Figure 1 As shown, the modeling system for virtual training of ship equipment in the present application is mainly composed of a human-computer interaction layer, a data communication layer, and a visualization modeling layer; the above layers can be constructed based on the software and hardware structure of the current virtual reality teaching system, wherein the human-computer interaction layer includes a signal acquisition module, an instruction generation module, an instruction fusion module, and a signal sending module;

[0030] The signal acquisition module refers to a human-machine interaction signal acquisition unit such as an electromyography signal acquisition unit, an eye movement signal acquisition unit, and a gesture signal acquisition unit;

[0031] The instruction generation module is used to judge the human-computer interaction signal obtained by the signal acquisition module to confirm whether it matches the interaction signal corresponding to the preset interaction instruction. If the signal matches, the corresponding interaction instruction is generated and sent to the instruction fusion module;

[0032] For various human-computer interaction signals, a signal collection training process is established to obtain various human-computer interaction signal data and convert them into recognizable computer instructions, and extract several human-computer interaction signal data with the best recognizability as pre-selected interaction signals for interaction instructions; the pre-selected interaction signals are sorted out, a mapping table of pre-selected interaction signals corresponding to interaction operations is established, instructions and instruction combinations are established, and the feasibility of interaction operations used to form continuous instructions or instruction sets is analyzed, and interaction operation combinations that are difficult to implement are eliminated; the interaction operations at least include interaction gestures and eye movement operations;

[0033] The instruction fusion module obtains the interactive instructions generated by the instruction generation module and collected by various signal acquisition modules based on the preset cycle or rule, and determines whether it matches the preset instruction combination or instruction rule. If it matches, it outputs the specific signal content represented by the corresponding combination or rule to the signal sending module;

[0034] As a preferred solution, the command combination or command matching rules of the present application include at least one or more of the following: a movement command based on eye movement signals to simulate the mouse target position; a selection command based on eye movement and gesture combination to implement a model, entity or model element; a model selection, operation, import and export command based on electromyographic signals and eye movement signals; a model structure feature editing command based on electromyographic signals and eye movement signals;

[0035] The instruction fusion module stores instruction data sets that match each human-computer interaction signal acquisition unit, and establishes a multi-signal fusion rule library; outputs corresponding fusion instructions according to the multi-signal fusion rules;

[0036] The data communication layer includes a signal transmitting terminal arranged at the data processing end of each human-computer interaction signal acquisition unit and a data receiving terminal arranged at the visual modeling layer.

[0037] The interactive signal acquisition unit data processing end creates the acquisition unit address, data port, and port ID for each human-computer interaction signal acquisition unit. After the system is in place, as a client, it reads the corresponding information and establishes data communication with the data receiving terminal.

[0038] Visual modeling layer: data reading component, parametric modeling component, position feature editing component, structural feature editing component, process editing and processing component;

[0039] The data reading component is used to read the three-dimensional geometric data files and mesh data files that conform to the OCCT standard;

[0040] The parametric modeling component is used to read the fusion instructions extracted by the human-computer interaction layer and complete the standardized modeling by parsing them into parametric modeling data; the standardized modeling refers to completing the attribute definition of the parametric model using the acquired parametric modeling data according to the preset logic;

[0041] The parametric model includes at least a standard cube model, a standard cylinder model, a standard truncated cone model, and a standard sphere model; for the standard cube model, its parametric modeling data includes at least a model ID, a model position coordinate, and the length of the three-axis coordinates of the cuboid; for the standard cylinder model, its parametric modeling data includes at least a model ID, a model position coordinate, a cylinder radius, a cylinder axis direction, and a cylinder height; for the standard truncated cone model, its parametric modeling data includes at least a model ID, a model position coordinate, a truncated cone bottom radius, a truncated cone top radius, a truncated cone circumference, and a truncated cone height; for the standard sphere model, its parametric modeling data includes at least a model ID, a model position coordinate, and a sphere radius;

[0042] The position feature editing component is used to edit the position of the model obtained by input or modeling, and the position editing includes at least translation of the model, rotation of the model, etc.; specifically, it refers to generating corresponding position editing parameters according to the position editing instruction, and editing the position coordinates of the model through the OCCT position editing function interface;

[0043] In particular, the translation position editing at least includes extracting the target object ID targeted by the translation instruction in the fusion instruction, selecting and displaying it to facilitate the user to confirm whether the target object is successfully selected, extracting the translation distance and translation direction parameters in the fusion instruction, and generating corresponding visual navigation information to facilitate the user to confirm whether the parameters are consistent with the instruction;

[0044] In particular, the rotation position editing at least includes extracting the target object ID targeted by the rotation instruction in the fusion instruction, selecting and displaying it to facilitate the user to confirm whether the target object is successfully selected, determining the corresponding rotation axis and rotation angle according to the rotation instruction parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether the various parameters are consistent with the instruction;

[0045] The structural feature editing component is used to read the instructions extracted by the human-computer interaction layer, decode them into corresponding feature operation instructions, and complete the model structural feature editing through the OCCT standard function; the model structural feature editing at least includes local stretching deformation, corner processing, hole and slot structure editing and Boolean operations on the aforementioned editing contents;

[0046] In particular, the stretch deformation editing at least includes extracting stretch deformation instruction parameters in the fusion instruction, selecting and highlighting the stretching surface involved in the parameters, determining the corresponding stretching direction and edge angle according to the stretch deformation instruction parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction;

[0047] In particular, the corner processing editing at least includes extracting corner processing instruction parameters in the fusion instruction, selecting and highlighting the edge line or the angle formed by several edge lines to be edited, determining the distance and size of the cutting or rounding processing according to the corner processing parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether the parameters are consistent with the instruction;

[0048] In particular, the hole slot structure editing at least includes extracting hole slot structure instruction parameters in the fusion instruction, selecting and highlighting the punching surface and hole coordinates to be edited, determining the hole diameter, depth and hole type according to the hole slot structure parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction;

[0049] The process processing component is used to complete the undo and redo of the aforementioned instructions, and at least includes the establishment of an instruction and data cache library for temporarily storing several editing instructions and instruction data content before and after the current editing operation, including extracting the process instruction parameters in the fusion instruction, and undoing or redoing the editing operation according to the specific content of the process instruction, and updating the instruction and data cache library in real time after each step of the operation.

[0050] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, rather than to limit the scope of protection of the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the essence and scope of the technical solution of the present invention.

Claims

1. A modeling system for virtual training of ship equipment, characterized in that: It consists of human-computer interaction layer, data communication layer, and visual modeling layer; The human-computer interaction layer includes a signal acquisition module, a command generation module, a command fusion module, and a signal sending module; The signal acquisition module refers to a human-machine interaction signal acquisition unit such as an electromyography signal acquisition unit, an eye movement signal acquisition unit, and a gesture signal acquisition unit; The instruction generation module is used to judge the human-computer interaction signal obtained by the signal acquisition module to confirm whether it matches the interaction signal corresponding to the preset interaction instruction. If the signal matches, the corresponding interaction instruction is generated and sent to the instruction fusion module; The instruction fusion module obtains the interactive instructions generated by the instruction generation module and collected by various signal acquisition modules based on the preset cycle or rule, and determines whether it matches the preset instruction combination or instruction rule. If it matches, it outputs the specific signal content represented by the corresponding combination or rule to the signal sending module; The instruction fusion module stores instruction data sets that match each human-computer interaction signal acquisition unit, and establishes a multi-signal fusion rule library; outputs corresponding fusion instructions according to the multi-signal fusion rules; The data communication layer includes a signal transmitting terminal arranged at the data processing end of each human-computer interaction signal acquisition unit and a data receiving terminal arranged at the visual modeling layer. The interactive signal acquisition unit data processing end creates the acquisition unit address, data port, and port ID for each human-computer interaction signal acquisition unit. After the system is in place, as a client, it reads the corresponding information and establishes data communication with the data receiving terminal. The visual modeling layer includes data reading components, parametric modeling components, location feature editing components, structural feature editing components, and process editing and processing components; The data reading component is used to read the three-dimensional geometric data files and mesh data files that conform to the OCCT standard; The parametric modeling component is used to read the fusion instructions extracted by the human-computer interaction layer and complete the standardized modeling by parsing them into parametric modeling data; the standardized modeling refers to completing the attribute definition of the parametric model using the acquired parametric modeling data according to the preset logic; The position feature editing component is used to edit the position of the model obtained by input or modeling, and the position editing includes at least translation of the model, rotation of the model, etc.; specifically, it refers to generating corresponding position editing parameters according to the position editing instruction, and editing the position coordinates of the model through the OCCT position editing function interface; The structural feature editing component is used to read the instructions extracted by the human-computer interaction layer, decode them into corresponding feature operation instructions, and complete the model structural feature editing through the OCCT standard function; the model structural feature editing at least includes local stretching deformation, corner processing, hole and slot structure editing and Boolean operations on the aforementioned editing contents; The process processing component is used to complete the undo and redo of the aforementioned instructions, and at least includes the establishment of an instruction and data cache library for temporarily storing several editing instructions and instruction data content before and after the current editing operation, including extracting the process instruction parameters in the fusion instruction, and undoing or redoing the editing operation according to the specific content of the process instruction, and updating the instruction and data cache library in real time after each step of the operation.

2. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: The instruction generation module establishes a signal collection training process for various human-computer interaction signals, obtains various human-computer interaction signal data, and converts them into recognizable computer instructions, extracts several human-computer interaction signal data with the best recognizability as pre-selected interaction signals for interaction instructions; sorts out the pre-selected interaction signals, establishes a mapping table of pre-selected interaction signals corresponding to interaction operations, establishes instructions and instruction combinations, analyzes the feasibility of interaction operations for forming continuous instructions or instruction sets, and eliminates interaction operation combinations that are difficult to implement; the interaction operations at least include interaction gestures and eye movement operations.

3. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: As a preferred solution, the instruction combination or instruction matching rules include at least one or more of the following: movement instructions for simulating the target position of the mouse based on eye movement signals; selection instructions for models, entities or model elements based on a combination of eye movement and gestures; model selection, operation, import and export instructions based on electromyography signals and eye movement signals; model structure feature editing instructions based on electromyography signals and eye movement signals.

4. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: The parametric model includes at least a standard cube model, a standard cylinder model, a standard truncated cone model, and a standard sphere model; for the standard cube model, its parametric modeling data includes at least a model ID, a model position coordinate, and the length of the three-axis coordinates of the cuboid; for the standard cylinder model, its parametric modeling data includes at least a model ID, a model position coordinate, a cylinder radius, a cylinder axis direction, and a cylinder height; for the standard truncated cone model, its parametric modeling data includes at least a model ID, a model position coordinate, a truncated cone bottom radius, a truncated cone top radius, a truncated cone circumference, and a truncated cone height; for the standard sphere model, its parametric modeling data includes at least a model ID, a model position coordinate, and a sphere radius.

5. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: The translation position editing at least includes extracting the target object ID targeted by the translation instruction in the fusion instruction, selecting and displaying it to facilitate the user to confirm whether the target object is successfully selected, extracting the translation distance and translation direction parameters in the fusion instruction, and generating corresponding visual navigation information to facilitate the user to confirm whether the parameters are consistent with the instruction; The rotation position editing at least includes extracting the target object ID targeted by the rotation instruction in the fusion instruction, selecting and displaying it distinctively so that the user can confirm whether the target object has been successfully selected, determining the corresponding rotation axis and rotation angle according to the rotation instruction parameters, and generating corresponding visual navigation information so that the user can confirm whether the various parameters are consistent with the instruction.

6. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: The stretch deformation editing at least includes extracting the stretch deformation instruction parameters in the fusion instruction, selecting and highlighting the stretching surface involved in the parameters, determining the corresponding stretching direction and edge angle according to the stretch deformation instruction parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction; The corner processing editing at least includes extracting corner processing instruction parameters in the fusion instruction, selecting and highlighting the edge line or the angle formed by several edge lines to be edited, determining the distance and size of the cutting or rounding processing according to the corner processing parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether the parameters are consistent with the instruction; The hole slot structure editing at least includes extracting the hole slot structure instruction parameters in the fusion instruction, selecting and highlighting the punching surface and hole coordinates that need to be edited, determining the hole diameter, depth and hole type according to the hole slot structure parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether the various parameters are consistent with the instruction.

Images