A modeling system for virtual training of ship equipment

Abstract

The present invention belongs to the technical field of virtual reality training, and particularly relates to a modeling system for virtual training of ship devices. It includes a human-computer interaction layer, a data communication layer, and a visualization modeling layer; the human-computer interaction layer includes a signal acquisition module, an instruction generation module, an instruction fusion module, and a signal transmission module; the data communication layer includes a signal emission terminal and a data reception terminal; the visualization modeling layer includes a data reading component, a parametric modeling component, a position feature editing component, a structural feature editing component, and a process editing and processing component; the modeling system for virtual training of ship devices in this application is mainly based on the existing software and hardware devices of the current virtual training system for ship devices, provides an optimized and conceptual device modeling solution, and on this basis provides an efficient device modeling solution based on virtual reality interaction, which is used to meet diverse training contents, provides a solution for improving training quality and reducing a large number of repetitive modeling operations.

Description

Technical Field

[0001] The present invention belongs to the technical field of virtual reality training, and particularly relates to a modeling system for virtual training of ship devices. Background Art

[0002] To improve the quality of training on the principles and operation techniques of ship devices and achieve a training experience closer to actual training operations, virtual reality training technology has been introduced into the corresponding training process. Based on virtual reality training technology, a better display effect can be provided for students, enabling them to obtain a more direct understanding and feeling. With the development of virtual training for various types of devices, the modeling pressure for a large number of devices and supporting equipment during the training process has gradually increased. At the same time, during the training process, there is also a need to conduct synchronous virtual training for different types of devices. Although these devices have different characteristics in terms of model structure, their basic structural compositions and combination methods are basically the same, and there is potential for real-time editing and processing during the modeling process to achieve multi-type switching and free combination. Summary of the Invention

[0003] The purpose of the present invention is to provide a modeling system for virtual training of ship devices, which can be used in the virtual training process of ship devices, has functions of more abundant rapid modeling and flexible configuration of multi-type device components, and has an editable modeling function.

[0004] To achieve the above purpose, the present invention adopts the following technical solutions.

[0005] A modeling system for virtual training of ship devices is composed of a human-computer interaction layer, a data communication layer, and a visualization modeling layer;

[0006] The human-computer interaction layer includes a signal acquisition module, an instruction generation module, an instruction fusion module, and a signal sending module;

[0007] The signal acquisition module refers to human-computer interaction signal acquisition units such as an electromyogram signal acquisition unit, an eye movement signal acquisition unit, and a gesture signal acquisition unit;

[0008] The instruction generation module is used to judge the human-computer interaction signals obtained by the signal acquisition module, confirm whether they match the interaction signals corresponding to the preset interaction instructions. If the signals match, corresponding interaction instructions are generated and sent to the instruction fusion module;

[0009] The instruction fusion module obtains the interaction instructions collected by various signal acquisition modules and generated by the instruction generation module based on a preset period or rule, and judges whether they match the preset instruction combinations or instruction rules. If they match, the specific signal content represented by the corresponding combination or rule is output to the signal sending module;

[0010] The instruction fusion module stores an instruction dataset that matches each human-computer interaction signal acquisition unit, and at the same time establishes a multi-signal fusion rule library; corresponding fusion instructions are output according to the multi-signal fusion rules;

[0011] The data communication layer includes a signal transmission terminal arranged at the data processing end of each human-computer interaction signal acquisition unit and a data receiving terminal arranged in the visualization modeling layer

[0012] The data processing end of the interaction signal acquisition unit creates an acquisition unit address, a data port, and a port ID for each human-computer interaction signal acquisition unit. After the system starts, as a client, it reads the corresponding information and establishes a data communication with the data receiving terminal

[0013] The visualization modeling layer includes a data reading component, a parametric modeling component, a position feature editing component, a structural feature editing component, and a process editing and processing component;

[0014] The data reading component is used to read 3D geometric data files and mesh data files that conform to the OCCT standard;

[0015] The parametric modeling component is used to read the fusion instructions extracted from the human-computer interaction layer and complete standardized modeling by parsing them into parametric modeling data; the standardized modeling refers to completing the attribute definition of the parametric model by using the obtained parametric modeling data according to the preset logic;

[0016] The position feature editing component is used to perform position editing on the input or modeled model. The position editing includes at least translation and rotation of the model, etc.; specifically, it means generating corresponding position editing parameters according to the position editing instructions and editing the position coordinates of the model through the OCCT position editing function interface;

[0017] The structural feature editing component is used to read the instructions extracted from the human-computer interaction layer, decode them into corresponding feature operation instructions, and complete the model structural feature editing through the OCCT standard functions; the model structural feature editing includes at least stretching and deforming of the model local part, corner processing, hole and groove structure editing, and Boolean operations on the foregoing editing contents, etc.;

[0018] The process processing component is used to complete the cancellation and redo of the foregoing instructions, at least including establishing an instruction and data cache library for temporarily saving several editing instructions and instruction data contents before and after the current editing operation, extracting the process instruction parameters in the fusion instructions, and performing cancellation or reproduction operations of the editing operations according to the specific contents of the process instructions, and updating the instruction and data cache library in real time after each operation.

[0019] For a further improvement or preferred implementation of the aforementioned modeling system for virtual training of ship devices, for each human-machine interaction signal, the instruction generation module establishes a signal acquisition training process, obtains data of each human-machine interaction signal, converts it into recognizable computer instructions, extracts several human-machine interaction signal data with the best recognizability as preselected interaction signals for interaction instructions; sorts out the preselected interaction signals, establishes a mapping table of the preselected interaction signals corresponding to interaction operations, establishes instructions and instruction combinations, and analyzes the feasibility of the interaction operations for forming continuous instructions or instruction sets, and eliminates difficult-to-implement interaction operation combinations; the interaction operations at least include interaction gestures and eye movement operations.

[0020] For a further improvement or preferred implementation of the aforementioned modeling system for virtual training of ship devices, as a preferred solution, the instruction combination or instruction matching rule at least includes one or more of the following: a movement instruction for simulating the movement of the target position of the mouse based on the participation of the eye movement signal; a selection instruction for a model or entity or model element based on the combination of eye movement and gesture; a selection, operation, import / export instruction for a model based on the electromyogram signal and the eye movement signal; a model structure feature editing instruction based on the electromyogram signal and the eye movement signal.

[0021] For a further improvement or preferred implementation of the aforementioned modeling system for virtual training of ship devices, the parametric models at least include a standard cube model, a standard cylinder model, a standard frustum model, and a standard sphere model; for the standard cube model, its parametric modeling data at least includes a model ID, model position coordinates, and the lengths of the three axes of the cuboid; for the standard cylinder model, its parametric modeling data at least includes a model ID, model position coordinates, cylinder radius, cylinder axis direction, and cylinder height; for the standard frustum model, its parametric modeling data at least includes a model ID, model position coordinates, bottom radius of the frustum, top radius of the frustum, frustum circumference, and frustum height; for the standard sphere model, its parametric modeling data at least includes a model ID, model position coordinates, and sphere radius.

[0022] For further improvements or preferred embodiments of the aforementioned modeling system for virtual training of ship devices, the translation position editing at least includes extracting the target object ID targeted by the translation instruction in the fusion instruction, selecting and differentiating the display thereof to facilitate the user to confirm whether the target object is successfully selected, extracting the translation distance and translation direction parameters in the fusion instruction, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction; the rotation position editing at least includes extracting the target object ID targeted by the rotation instruction in the fusion instruction, selecting and differentiating the display thereof to facilitate the user to confirm whether the target object is successfully selected, determining the corresponding rotation axis and rotation angle according to the rotation instruction parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction.

[0023] For further improvements or preferred embodiments of the aforementioned modeling system for virtual training of ship devices, the stretching and deforming editing at least includes extracting the stretching and deforming instruction parameters in the fusion instruction, selecting and highlighting the stretching surface involved in the parameters, determining the corresponding stretching direction and edge angle according to the stretching and deforming instruction parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction;

[0024] The corner processing editing at least includes extracting the corner processing instruction parameters in the fusion instruction, selecting and highlighting the edge line or the included angle formed by several edge lines to be edited, determining the cutting or rounding distance and size according to the corner processing parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction;

[0025] The hole and groove structure editing at least includes extracting the hole and groove structure instruction parameters in the fusion instruction, selecting and highlighting the drilling surface and hole coordinates to be edited, determining the hole diameter, depth and hole type according to the hole and groove structure parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction. Description of the Drawings

[0026] Figure 1 is the data flow diagram of the modeling system for virtual training of ship devices; Detailed Embodiments

[0027] The present invention will be described in detail below with reference to specific embodiments.

[0028] The modeling system for virtual training of ship devices in this application is mainly based on the existing software and hardware devices of the current virtual training system for ship devices, provides an optimized and conceptual device modeling solution, and based on this, provides an efficient device modeling solution based on virtual reality interaction, which is used to meet diverse training contents, and provides a solution for improving training quality and reducing a large amount of repetitive modeling operations.

[0029] like Figure 1 As shown, the modeling system for virtual training of ship equipment in the present application is mainly composed of a human-computer interaction layer, a data communication layer, and a visualization modeling layer; the above layers can be constructed based on the software and hardware structure of the current virtual reality teaching system, wherein the human-computer interaction layer includes a signal acquisition module, an instruction generation module, an instruction fusion module, and a signal sending module;

[0030] The signal acquisition module refers to a human-machine interaction signal acquisition unit such as an electromyography signal acquisition unit, an eye movement signal acquisition unit, and a gesture signal acquisition unit;

[0031] The instruction generation module is used to judge the human-computer interaction signal obtained by the signal acquisition module to confirm whether it matches the interaction signal corresponding to the preset interaction instruction. If the signal matches, the corresponding interaction instruction is generated and sent to the instruction fusion module;

[0032] For various human-computer interaction signals, a signal collection training process is established to obtain various human-computer interaction signal data and convert them into recognizable computer instructions, and extract several human-computer interaction signal data with the best recognizability as pre-selected interaction signals for interaction instructions; the pre-selected interaction signals are sorted out, a mapping table of pre-selected interaction signals corresponding to interaction operations is established, instructions and instruction combinations are established, and the feasibility of interaction operations used to form continuous instructions or instruction sets is analyzed, and interaction operation combinations that are difficult to implement are eliminated; the interaction operations at least include interaction gestures and eye movement operations;

[0033] The instruction fusion module obtains the interactive instructions generated by the instruction generation module and collected by various signal acquisition modules based on the preset cycle or rule, and determines whether it matches the preset instruction combination or instruction rule. If it matches, it outputs the specific signal content represented by the corresponding combination or rule to the signal sending module;

[0034] As a preferred solution, the command combination or command matching rules of the present application include at least one or more of the following: a movement command based on eye movement signals to simulate the mouse target position; a selection command based on eye movement and gesture combination to implement a model, entity or model element; a model selection, operation, import and export command based on electromyographic signals and eye movement signals; a model structure feature editing command based on electromyographic signals and eye movement signals;

[0035] The instruction fusion module stores instruction data sets that match each human-computer interaction signal acquisition unit, and establishes a multi-signal fusion rule library; outputs corresponding fusion instructions according to the multi-signal fusion rules;

[0036] The data communication layer includes a signal transmitting terminal arranged at the data processing end of each human-computer interaction signal acquisition unit and a data receiving terminal arranged at the visual modeling layer.

[0037] The data processing end of the interactive signal acquisition unit creates acquisition unit addresses, data ports, and port IDs for each human-computer interactive signal acquisition unit. After the system starts, as a client, it reads the corresponding information and establishes data communication with the data receiving terminal.

[0038] Visualization modeling layer: data reading component, parametric modeling component, position feature editing component, structural feature editing component, process editing and processing component;

[0039] The data reading component is used to read 3D geometric data files and mesh data files that conform to the OCCT standard;

[0040] The parametric modeling component is used to read the fusion instructions extracted from the human-computer interaction layer and complete standardized modeling by parsing them into parametric modeling data; the standardized modeling refers to defining the attributes of the parametric model according to the preset logic using the obtained parametric modeling data.

[0041] The parametric model at least includes a standard cube model, a standard cylinder model, a standard frustum model, and a standard sphere model; for the standard cube model, its parametric modeling data at least includes a model ID, model position coordinates, and the lengths of the three axes of the cuboid; for the standard cylinder model, its parametric modeling data at least includes a model ID, model position coordinates, cylinder radius, cylinder axis direction, and cylinder height; for the standard frustum model, its parametric modeling data at least includes a model ID, model position coordinates, bottom radius of the frustum, top radius of the frustum, circumference of the frustum, and height of the frustum; for the standard sphere model, its parametric modeling data at least includes a model ID, model position coordinates, and sphere radius.

[0042] The position feature editing component is used to perform position editing on the input or modeled model. The position editing at least includes translating the model, rotating the model, etc.; specifically, it means generating corresponding position editing parameters according to the position editing instructions and editing the position coordinates of the model through the OCCT position editing function interface.

[0043] In particular, the translational position editing at least includes extracting the target object ID targeted by the translation instruction in the fusion instruction, selecting and differentiating it for display to facilitate the user to confirm whether the target object is successfully selected, extracting the translation distance and translation direction parameters in the fusion instruction, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction.

[0044] Specifically, the rotation position editing at least includes extracting the target object ID targeted by the rotation instruction in the fusion instruction, selecting and differentiating the display thereof to facilitate the user to confirm whether the target object is successfully selected, determining the corresponding rotation axis and rotation angle according to the rotation instruction parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction;

[0045] The structure feature editing component is used to read the instructions extracted by the human-computer interaction layer, decode them into corresponding feature operation instructions, and complete the model structure feature editing through OCCT standard functions; the model structure feature editing at least includes stretching and deforming the local part of the model, corner processing, hole and groove structure editing, and Boolean operations on the foregoing editing contents, etc.;

[0046] Specifically, the stretching and deforming editing at least includes extracting the stretching and deforming instruction parameters in the fusion instruction, selecting and highlighting the stretching surface involved in the parameters, determining the corresponding stretching direction and edge line angle according to the stretching and deforming instruction parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction;

[0047] Specifically, the corner processing editing at least includes extracting the corner processing instruction parameters in the fusion instruction, selecting and highlighting the edge line to be edited or the included angle formed by several edge lines, determining the cutting or rounding distance and size according to the corner processing parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction;

[0048] Specifically, the hole and groove structure editing at least includes extracting the hole and groove structure instruction parameters in the fusion instruction, selecting and highlighting the punching surface and hole coordinates to be edited, determining the hole diameter, depth and hole type according to the hole and groove structure parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction;

[0049] The process processing component is used to complete the cancellation and redo of the foregoing instructions, and at least includes establishing an instruction and data cache library for temporarily storing several editing instructions and instruction data contents before and after the current editing operation, extracting the process instruction parameters in the fusion instruction, and performing cancellation or reproduction operations of the editing operations according to the specific content of the process instruction, and updating the instruction and data cache library in real time after each operation.

[0050] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting the protection scope of the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the essence and scope of the technical solutions of the present invention.

Claims

1. A modeling system for virtual training of ship equipment, characterized in that: It consists of human-computer interaction layer, data communication layer, and visual modeling layer; The human-computer interaction layer includes a signal acquisition module, a command generation module, a command fusion module, and a signal sending module; The signal acquisition module refers to the electromyography signal acquisition unit, the eye movement signal acquisition unit, the gesture signal acquisition unit and the human-computer interaction signal acquisition unit; The instruction generation module is used to judge the human-computer interaction signal obtained by the signal acquisition module to confirm whether it matches the interaction signal corresponding to the preset interaction instruction. If the signal matches, the corresponding interaction instruction is generated and sent to the instruction fusion module; The instruction fusion module obtains the interactive instructions generated by the instruction generation module and collected by various signal acquisition modules based on the preset cycle or rule, and determines whether it matches the preset instruction combination or instruction rule. If it matches, it outputs the specific signal content represented by the corresponding combination or rule to the signal sending module; The instruction fusion module stores instruction data sets that match each human-computer interaction signal acquisition unit, and establishes a multi-signal fusion rule library; outputs corresponding fusion instructions according to the multi-signal fusion rules; The data communication layer includes a signal transmitting terminal arranged at the data processing end of each human-computer interaction signal acquisition unit and a data receiving terminal arranged at the visual modeling layer. The interactive signal acquisition unit data processing end creates the acquisition unit address, data port, and port ID for each human-computer interaction signal acquisition unit. After the system is in place, as a client, it reads the corresponding information and establishes data communication with the data receiving terminal. The visual modeling layer includes data reading components, parametric modeling components, location feature editing components, structural feature editing components, and process editing and processing components; The data reading component is used to read the three-dimensional geometric data files and mesh data files that conform to the OCCT standard; The parametric modeling component is used to read the fusion instructions extracted by the human-computer interaction layer and complete the standardized modeling by parsing them into parametric modeling data; the standardized modeling refers to completing the attribute definition of the parametric model using the acquired parametric modeling data according to the preset logic; The position feature editing component is used to edit the position of the model obtained by input or modeling, and the position editing at least includes translation and rotation of the model; specifically, it refers to generating corresponding position editing parameters according to the position editing instruction, and editing the position coordinates of the model through the OCCT position editing function interface; The structural feature editing component is used to read the instructions extracted by the human-computer interaction layer, decode them into corresponding feature operation instructions, and complete the model structural feature editing through the OCCT standard function; the model structural feature editing at least includes the local stretching deformation, corner processing, hole and slot structure editing of the model and the Boolean operation of the aforementioned editing content; The process processing component is used to complete the undo and redo of the aforementioned instructions, and at least includes the establishment of an instruction and data cache library for temporarily storing several editing instructions and instruction data content before and after the current editing operation, including extracting the process instruction parameters in the fusion instruction, and undoing or redoing the editing operation according to the specific content of the process instruction, and updating the instruction and data cache library in real time after each step of the operation.

2. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: The instruction generation module establishes a signal collection training process for various human-computer interaction signals, obtains various human-computer interaction signal data, and converts them into recognizable computer instructions, extracts several human-computer interaction signal data with the best recognizability as pre-selected interaction signals for interaction instructions; sorts out the pre-selected interaction signals, establishes a mapping table of pre-selected interaction signals corresponding to interaction operations, establishes instructions and instruction combinations, analyzes the feasibility of interaction operations for forming continuous instructions or instruction sets, and eliminates interaction operation combinations that are difficult to implement; the interaction operations at least include interaction gestures and eye movement operations.

3. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: The command combination or command matching rule includes at least one or more of the following: a movement command for simulating a mouse target position based on eye movement signals; a selection command for a model, entity or model element based on a combination of eye movement and gestures; The model selection, operation, import and export instructions are implemented based on electromyographic signals and eye movement signals; the model structure feature editing instructions are implemented based on electromyographic signals and eye movement signals.

4. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: The parametric model includes at least a standard cube model, a standard cylinder model, a standard truncated cone model, and a standard sphere model; for the standard cube model, its parametric modeling data includes at least a model ID, a model position coordinate, and the length of the three-axis coordinates of the cuboid; for the standard cylinder model, its parametric modeling data includes at least a model ID, a model position coordinate, a cylinder radius, a cylinder axis direction, and a cylinder height; for the standard truncated cone model, its parametric modeling data includes at least a model ID, a model position coordinate, a truncated cone bottom radius, a truncated cone top radius, a truncated cone circumference, and a truncated cone height; for the standard sphere model, its parametric modeling data includes at least a model ID, a model position coordinate, and a sphere radius.

5. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: The translation of the model at least includes extracting the target object ID targeted by the translation instruction in the fusion instruction, selecting and displaying it in a differentiated manner so that the user can confirm whether the target object is successfully selected, extracting the translation distance and translation direction parameters in the fusion instruction, and generating corresponding visual navigation information so that the user can confirm whether the parameters are consistent with the instruction; The rotation of the model at least includes extracting the target object ID targeted by the rotation instruction in the fusion instruction, selecting and displaying it distinctively so that the user can confirm whether the target object has been successfully selected, determining the corresponding rotation axis and rotation angle according to the rotation instruction parameters, and generating corresponding visual navigation information so that the user can confirm whether the various parameters are consistent with the instruction.

6. The modeling system for virtual training of ship equipment according to claim 1, characterized in that: The stretch deformation editing at least includes extracting the stretch deformation instruction parameters in the fusion instruction, selecting and highlighting the stretching surface involved in the parameters, determining the corresponding stretching direction and edge angle according to the stretch deformation instruction parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether each parameter is consistent with the instruction; The corner processing editing at least includes extracting corner processing instruction parameters in the fusion instruction, selecting and highlighting the edge line or the angle formed by several edge lines to be edited, determining the distance and size of the cutting or rounding processing according to the corner processing parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether the parameters are consistent with the instruction; The hole slot structure editing at least includes extracting the hole slot structure instruction parameters in the fusion instruction, selecting and highlighting the punching surface and hole coordinates that need to be edited, determining the hole diameter, depth and hole type according to the hole slot structure parameters, and generating corresponding visual navigation information to facilitate the user to confirm whether the various parameters are consistent with the instruction.

Images