Virtual reality training system for ship device

By designing a virtual reality training system for ship devices that integrates scene virtual, training simulation, real-time rendering, three-dimensional scenes and virtual interaction modules, the problem that existing systems are difficult to meet the needs of refined operation training is solved, detailed virtual reality training for ship devices is realized, the training process is optimized, and the training focus is discovered.

CN119673020AActive Publication Date: 2025-03-21NAVAL UNIV OF ENG PLA

Patent Information

Application Number
CN202411708961.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-27
Publication Date
2025-03-21
Estimated Expiration
2044-11-27

AI Technical Summary

Technical Problem

The existing virtual reality training system is difficult to meet the refined operation training needs of ship devices, and mainly focuses on three-dimensional model display and animation simulation, and cannot effectively optimize the training process and discover training priorities.

Method used

A virtual reality training system for ship devices is designed, including scene virtual modules, training simulation modules, real-time rendering control modules, three-dimensional scene modules and virtual interaction modules. Through the combination of these modules, detailed virtual reality training for ship devices is realized, including creating training scenario models, ship device models, collecting human-computer interaction information, generating model interaction content and providing virtual feedback information.

Benefits of technology

The refined operation training of ship equipment was achieved, the training process was optimized, the training focus was discovered and emphasized, and the training effect and efficiency were improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure FDA0005155179920000031
    Figure FDA0005155179920000031
  • Figure FDA0005155179920000041
    Figure FDA0005155179920000041
Patent Text Reader

Abstract

The invention belongs to the technical field of ship device training, and particularly relates to a ship device virtual reality training system. Comprising a scene virtual module, a training simulation module, a real-time rendering control module, a three-dimensional scene module and a virtual interaction module. The scene virtual module creates a culture model; the training simulation module provides a training interaction algorithm and generates interaction content; the three-dimensional scene module is used for tracking the three-dimensional posture of the motion camera and positioning the visual angle of a virtual scene; the virtual interaction module is used for generating tracking data according to the human-computer interaction information and generating virtual feedback information according to interaction content; the auxiliary module is used for generating training data according to training requirements and providing generation and output of contents such as training effects, notification information and evaluation information; the virtual reality training system for the ship device is mainly used for further improving the virtual reality training effect of the ship device and providing a technical route for expanding training content and optimizing a training scheme.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the technical field of ship equipment training, and in particular relates to a ship equipment virtual reality training system. Background Art

[0002] The normal operation of ship equipment is the basic guarantee for ships to maintain healthy navigation. The maintenance and operation of ship equipment involves a large number of control devices and hardware facilities. Most of the equipment themselves are large in size and have many related structures. It is difficult to observe and understand them independently and intuitively and effectively in actual ships. Usually, theoretical teaching can only be carried out using equipment models or through video teaching. However, in order to meet application needs, a large amount of complete equipment operation training is also an indispensable part. At present, some training institutions have launched virtual reality training for large equipment such as equipment based on virtual reality technologies such as VR and AR, but currently they mainly focus on 3D model display and 3D animation simulation based on virtual reality scenes, which cannot further meet the needs of various operation training for more refined equipment. Summary of the invention

[0003] The purpose of the present invention is to provide a virtual reality training system for realizing virtual reality training of ship equipment, enriching the training content and optimizing the training process according to specific matters of equipment training, and discovering the key points of training.

[0004] To achieve the above purpose, the present invention adopts the following technical solution.

[0005] A virtual reality training system for ship equipment, comprising a scene virtualization module, a training simulation module, a real-time rendering control module, a three-dimensional scene module, and a virtual interaction module;

[0006] The scene virtualization module is used to obtain and create training scene models and ship equipment models; the training simulation module provides training interaction algorithms, collects human-computer interaction information, and generates model interaction content;

[0007] The 3D scene module is used to track the 3D posture of the motion camera and locate the virtual scene perspective; the virtual interaction module is used to generate tracking data based on human-computer interaction information and generate virtual feedback information based on the interaction content; the auxiliary module is used to generate training data based on training needs and provide the generation and output of training effects, notification information, evaluation information, etc.

[0008] The scene virtualization module is used to obtain and create training scene models and ship device models; the training scene model is used to provide virtual scenes of training space, external environment of ship device equipment and other environments; the ship device model is used to provide virtual scenes of ship devices such as ship device systems and supporting control panels;

[0009] The training simulation module provides a training interaction algorithm, collects human-computer interaction information, and generates model interaction content; the training simulation module is used to generate model interaction content including:

[0010] Establishing a ship device training task element set, wherein the ship device training task element set includes a training task goal, a training task action, a training tool set, and a training environment set;

[0011] The training task objectives refer to the equipment, components and other operated objects targeted by the ship equipment training tasks; the training task actions refer to a series of necessary operation contents configured to complete the ship equipment training tasks; the training tool set refers to the necessary equipment and tools required to complete the ship equipment training tasks; the training environment set refers to the corresponding element information used to construct the specific environment or situational background of the ship equipment training tasks;

[0012] The training simulation module is used to collect human-computer interaction information, including: obtaining human-computer interaction information through a virtual reality interaction system, obtaining the types of subsequent ship equipment training tasks required by actively obtaining interaction intentions and autonomous judgment, etc.; according to the type of ship equipment training tasks that need to be performed, the corresponding task code is retrieved and the corresponding task data information is generated.

[0013] For further improvement or specific implementation of the aforementioned ship device virtual reality training system, in order to create a virtual scene, at least the following steps need to be completed:

[0014] a1. Search for the necessary target information and environment information corresponding to the corresponding virtual scene, and analyze the interaction information between the corresponding targets and between the targets and the environment;

[0015] a2. According to the specific contents of target information, environmental information and interactive information, obtain and collect basic data such as pictures and videos used to reproduce the aforementioned virtual information contents;

[0016] a3. Perform necessary image processing on basic data such as pictures and videos to extract texture mapping information;

[0017] a4. Use 3D modeling software to complete the creation of three-dimensional model units in the virtual scene;

[0018] a5. Use the 3D engine platform to construct the environmental information in the virtual scene, and introduce the three-dimensional model unit established in the previous steps into the virtual environment; use the training simulation module and the virtual interaction module to build a user interaction interface in the three-dimensional scene.

[0019] A further improvement or specific implementation of the aforementioned ship device virtual reality training system, wherein the training simulation module is used to create an interactive algorithm based on at least the following steps:

[0020] b1. Generate interactive operation data according to the ship device training content, the interactive operation data includes the interactive data between the individual and each unit of the ship device during the virtual reality training process, and the corresponding action and attribute change data of the ship device body and the related structures of the ship device under the influence of each interactive operation. The interactive data and the action or attribute change data are reflected through the dynamic change of the model, the dynamic data of the visualization interface, etc.;

[0021] b2. Generate and extract dynamic characteristic data of ship equipment according to the operation characteristics and attributes of ship equipment, wherein the motion characteristic data includes motion attribute data, static and dynamic structure data, and power-related data; establish a dynamic characteristic database of ship equipment, and update the dynamic characteristic database of ship equipment according to the training content of ship equipment;

[0022] b3. Establish a corresponding data interaction and retrieval process based on the ship equipment training content, obtain the specific content of the ship equipment training from the human-computer interaction information, extract the necessary feature data from the ship equipment dynamic feature database according to the training content, and send it to the scene virtual module to output the corresponding virtual device dynamic or static information.

[0023] For further improvement or specific implementation of the aforementioned ship equipment virtual reality training system, in order to obtain the ship equipment training task element set, at least the following steps need to be completed:

[0024] C1. Dismantle the ship equipment training task operation steps to obtain corresponding sub-steps, wherein the sub-steps are composed of executing a single training task action for the training task target and the required training tool elements and training environment elements; the ship equipment training task is composed of several sub-steps;

[0025] C2. Establish a sub-step identification table, wherein the sub-step identification table is a table consisting of a task target ID, a single training task action ID, a training tool element ID, and a training environment element ID;

[0026] C3. Establish a directed network that expresses the ship equipment training task through an ordered combination of sub-steps, wherein the directed network is composed of network vertices and directed line segments between the vertices, wherein the network vertices are composed of sub-steps, and a number of sub-steps connected by a number of directed line segments constitute a complete ship equipment training task, wherein the graphics composed of directed line segments mark the logical relationship between the directional sub-steps; wherein the direction of the directed line segments indicates the order in which the sub-steps are executed, and a number of line segments connecting any two sub-steps represent a number of different processing steps that can be selected for the ship equipment training task, and a cross line segment passing through any sub-step indicates that the ship equipment training task needs to select the content of the next sub-step after passing through the sub-step;

[0027] C4. Establish a sign symbol for representing the logical relationship of the aforementioned directed line segments, and establish a directed table containing the logical relationship of sub-steps in combination with the directed network representing each ship equipment training task, and complete the coding of the ship equipment training task expressed by the sub-steps and the logical relationship of the sub-steps.

[0028] Further improvements or specific implementations of the aforementioned ship equipment virtual reality training system, for the aforementioned directed network, whose vertices are sub-step data sets l = {1, 2.....N} consisting of N sub-steps, for any sub-step i, j∈l, if sub-step i is a prerequisite step for sub-step j to execute, then the directed edge association e ij =1 otherwise e ij =0;

[0029] In order to analyze whether the sub-step distribution in the directed network is reasonable, the network density of the vertices in the directed graph is used to express the closeness of the connection between the vertices in the directed network. Assuming that the directed edge correlation e ij = 1 is M, then the network density can be expressed as After determining the network density r, the exercise intensity between the sub-steps represented by the vertices in the directed network can be preliminarily judged. If the network density is too small, it means that the sub-steps are divided too finely, and the number of sub-steps into which the ship equipment training task is divided is too large, which will lead to too much total data used to express the ship equipment training task, and some sub-steps need to be merged. On the contrary, it means that the number of sub-steps is too small, and the details of the ship equipment training task cannot be sufficiently decomposed, which is not conducive to ensuring the training effect, and further step decomposition is required;

[0030] In order to improve the quality of training, we should identify the more important key sub-steps among the sub-steps decomposed from a large number of ship equipment training tasks. As a common processing method, we can use the correlation value of the corresponding vertex of each sub-step and other associated vertices to represent; by associating the value f i A preliminary analysis is performed on the importance of sub-step i to determine the sub-steps with the highest importance, so that the training weights of the corresponding sub-steps can be increased according to the associated values ​​during the training process.

[0031] Further improvements or specific implementation methods of the aforementioned ship equipment virtual reality training system, in order to optimize the process steps of the ship equipment training task, in addition to the training content of the pre-set fixed steps, in order to facilitate the enhanced training of a certain target sub-step during the training process, it is necessary to establish a training sequence with a relatively smaller number of sub-steps and a relatively shorter preparation step time, that is, for a certain sub-step k that is desired to be trained, it is necessary to determine a sub-step sequence {k1, k2...k n ...k x}, where sub-step k n-1 is sub-step k n Prerequisite step, sub-step k x It is the prerequisite step of sub-step k, so that the objective function goal = min[ω1x+ω2(t1+t2....+t x )] to obtain the minimum value.

[0032] A further improvement or specific implementation of the aforementioned ship device virtual reality training system, wherein the environmental information in the virtual scene includes surface structure information of the space where the device is located, other non-interactive device information of the space where the ship device is located, and path navigation information;

[0033] The surface structure information generates the corresponding surface structure based on the terrain editing tool and the spatial structure editing tool, and completes the filling and optimization of the surface structure related data by acquiring and collecting the basic data to complete the surface structure information.

[0034] The non-interactive device information generates three-dimensional scene information of the non-interactive device based on a structure or building editing tool or a texture mapping tool;

[0035] The path navigation information generates different path nodes and routes between path nodes based on the road modeling tool and the path finding auxiliary tool, and completes the editing of the operable range of the routes and nodes by obtaining and collecting information such as the actual path width and length.

[0036] A further improvement or specific implementation method of the aforementioned ship installation virtual reality training system is that the three-dimensional model unit completes the creation of the corresponding local unit model through the three-dimensional modeling software according to the interactive area and functional module involved, converts it into a three-dimensional model that can be recognized by the 3D engine platform through a format conversion tool, and then inputs it into the 3D engine platform for loading and mapping configuration, assigns relevant dynamic and static properties to the corresponding local unit model through the 3D engine platform property configuration tool, and establishes corresponding feedback models under different interactive contents according to the feedback information provided by the virtual interaction module. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] This application does not have any drawings. DETAILED DESCRIPTION

[0038] The present invention is described in detail below in conjunction with specific embodiments.

[0039] The present application provides a virtual reality training system for ship equipment, which is mainly used to further improve the effect of virtual reality training for ship systems and provide a technical route for expanding training content and optimizing training programs.

[0040] The ship device virtual reality training system of the present application is mainly composed of a scene virtual module, a training simulation module, a real-time rendering control module, a three-dimensional scene module, and a virtual interaction module;

[0041] The scene virtualization module is used to obtain and create training scene models and ship equipment models; the training simulation module provides training interaction algorithms, collects human-computer interaction information, and generates model interaction content; the three-dimensional scene module is used to track the three-dimensional posture of the motion camera and locate the virtual scene perspective; the virtual interaction module is used to generate tracking data based on human-computer interaction information and generate virtual feedback information based on the interaction content; the auxiliary module is used to generate training data based on training needs and provide the generation and output of training effects, notification information, evaluation information, etc.

[0042] The scene virtualization module is used to obtain and create training scene models and ship equipment models; the training scene model is used to provide virtual scenes of training space, external environment of ship equipment and other environments; the ship equipment model is used to provide virtual scenes of ship equipment such as ship equipment systems and supporting control panels; to create a virtual scene, at least the following steps need to be completed:

[0043] a1. Search for the necessary target information and environment information corresponding to the corresponding virtual scene, and analyze the interaction information between the corresponding targets and between the targets and the environment;

[0044] a2. According to the specific contents of target information, environmental information and interactive information, obtain and collect basic data such as pictures and videos used to reproduce the aforementioned virtual information contents;

[0045] a3. Perform necessary image processing on basic data such as pictures and videos to extract texture mapping information;

[0046] a4. Use 3D modeling software to complete the creation of three-dimensional model units in the virtual scene;

[0047] a5. Use the 3D engine platform to construct the environment information in the virtual scene, and introduce the three-dimensional model unit established in the previous steps into the virtual environment; use the training simulation module and the virtual interaction module to build a user interaction interface in the three-dimensional scene;

[0048] In particular, the environmental information in the virtual scene includes surface structure information of the space where the ship device is located, other non-interactive device information of the space where the ship device is located, and path navigation information;

[0049] The surface structure information generates the corresponding surface structure based on the terrain editing tool and the spatial structure editing tool, and completes the filling and optimization of the surface structure related data by acquiring and collecting the basic data to complete the surface structure information.

[0050] Wherein the non-interactive device information generates three-dimensional scene information of the non-interactive device based on a structure or building editing tool or a texture mapping tool;

[0051] The path navigation information generates different path nodes and routes between path nodes based on the road modeling tool and the path finding auxiliary tool, and completes the editing of the operable range of routes and nodes by obtaining and collecting information such as the actual path width and length;

[0052] In particular, the three-dimensional model unit completes the creation of the corresponding local unit model through the three-dimensional modeling software according to the interactive area and functional module involved, converts it into a three-dimensional model recognizable by the 3D engine platform through the format conversion tool, and then inputs it into the 3D engine platform for loading and mapping configuration, assigns relevant dynamic and static properties to the corresponding local unit model through the 3D engine platform property configuration tool, and establishes corresponding feedback models under different interactive contents according to the feedback information provided by the virtual interactive module;

[0053] The training simulation module provides a training interaction algorithm, collects human-computer interaction information, and generates model interaction content; wherein the training simulation module is used to create an interaction algorithm based on at least the following steps:

[0054] b1. Generate interactive operation data according to the ship device training content, where the interactive operation data includes the interactive data between individuals and various units of the ship device during the virtual reality training process, as well as the corresponding actions and attribute change data of the ship device body and related structures of the ship device under the influence of each interactive operation, where the interactive data and action or attribute change data are reflected through dynamic changes of the model, dynamic data of the visualization interface, etc.;

[0055] b2. Generate and extract dynamic characteristic data of ship equipment according to the operation characteristics and attributes of ship equipment, where the motion characteristic data includes motion attribute data, static and dynamic structure data, and power-related data; establish a dynamic characteristic database of ship equipment, and update the dynamic characteristic database of ship equipment according to the training content of ship equipment;

[0056] b3. Establish a corresponding data interaction and retrieval process based on the ship device training content, obtain the specific content of the ship device training from the human-computer interaction information, extract the necessary feature data from the ship device dynamic feature database according to the training content, and send it to the scene virtual module to output the corresponding virtual device dynamic or static information;

[0057] The training simulation module is used to generate the interactive content of the model, including: establishing a ship equipment training task element set, wherein the ship equipment training task element set includes training task objectives, training task actions, training tool sets, and training environment sets; training task objectives refer to the equipment, components and other operated objects targeted by the ship equipment training task; training task actions refer to a series of necessary operation contents configured to complete the ship equipment training task; training tool sets refer to the necessary equipment and tools required to complete the ship equipment training task; training environment sets refer to the corresponding element information used to construct a specific environment or situational background for the ship equipment training task;

[0058] To obtain the ship installation training task element set, at least the following steps need to be completed:

[0059] C1. Dismantle the ship equipment training task operation steps to obtain corresponding sub-steps, where the sub-steps are composed of a single training task action executed for the training task target and the required training tool elements and training environment elements; the ship equipment training task is composed of several sub-steps;

[0060] C2. Establish a sub-step identification table, wherein the sub-step identification table is composed of a task target ID, a single training task action ID, a training tool element ID, and a training environment element ID;

[0061] C3. Establish a directed network that expresses the ship equipment training task through an ordered combination of sub-steps, wherein the directed network is composed of network vertices and directed line segments between the vertices, wherein the network vertices are composed of sub-steps, and several sub-steps connected by several directed line segments constitute a complete ship equipment training task, wherein the graphics composed of directed line segments mark the logical relationship between the directional sub-steps; wherein the direction of the directed line segments indicates the order in which the sub-steps are executed, and several line segments connecting any two sub-steps represent several different processing steps that can be selected for the ship equipment training task, and the intersecting line segments passing through any sub-step indicate that the ship equipment training task needs to select the content of the next sub-step after passing through the sub-step;

[0062] C4. Establishing a symbol for representing the logical relationship of the directed line segments, establishing a directed table containing the logical relationship of the sub-steps in combination with the directed network representing each ship equipment training task, and completing the coding of the ship equipment training task expressed by the sub-steps and the logical relationship of the sub-steps;

[0063] The training simulation module is used to collect human-computer interaction information, including: obtaining human-computer interaction information through the virtual reality interaction system, obtaining the type of subsequent ship equipment training tasks required by actively obtaining interaction intentions and autonomous judgment, etc.; according to the type of ship equipment training tasks that need to be performed, the corresponding task code is retrieved and the corresponding task data information is generated;

[0064] For the directed network above, the vertices of which are the sub-step data set l = {1, 2.....N} consisting of N sub-steps, for any sub-step i, j∈l, if sub-step i is the prerequisite step for sub-step j to execute, then the directed edge association e ij =1 otherwise e ij =0;

[0065] In order to analyze whether the sub-step distribution in the directed network is reasonable, the network density of the vertices in the directed graph is used to express the closeness of the connection between the vertices in the directed network. Assuming that the directed edge correlation e ij = 1 is M, then the network density can be expressed as After determining the network density r, the exercise intensity between the sub-steps represented by the vertices in the directed network can be preliminarily judged. If the network density is too small, it means that the sub-steps are divided too finely, and the number of sub-steps into which the ship equipment training task is divided is too large, which will lead to too much total data used to express the ship equipment training task, and some sub-steps need to be merged. On the contrary, it means that the number of sub-steps is too small, and the details of the ship equipment training task cannot be sufficiently decomposed, which is not conducive to ensuring the training effect, and further step decomposition is required;

[0066] In order to improve the quality of training, we should identify the more important key sub-steps among the sub-steps decomposed from a large number of ship equipment training tasks. As a common processing method, we can use the correlation value of the corresponding vertex of each sub-step and other associated vertices to represent; by associating the value f i A preliminary analysis is performed on the importance of sub-step i to determine the sub-steps with the highest importance, so that the training weights of the corresponding sub-steps can be increased according to the associated values ​​during the training process.

[0067] Furthermore, in order to optimize the process steps of the ship equipment training task, in addition to the training content of the pre-set fixed steps, in order to facilitate the enhanced training of a certain target sub-step during the training process, it is necessary to establish a training sequence with a relatively smaller number of sub-steps and a relatively shorter preparation step time. That is, for a sub-step k that is desired to be trained, it is necessary to determine a sub-step sequence {k1, k2...k n ...k x}, where sub-step k n-1 is sub-step k n Prerequisite step, sub-step k x It is the prerequisite step of sub-step k, so that the objective function goal = min[ω1x+ω2(t1+t2....+t x )]Get the minimum value

[0068] According to the aforementioned objective function and indicators, the rationality of the distribution of the device training system composed of sub-steps can be judged and analyzed, and then the distribution method of the sub-steps can be optimized. At the same time, the key sub-step items that are difficult to find can be determined according to the correlation, providing a reference for optimizing the planning of device training content.

[0069] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, rather than to limit the scope of protection of the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the essence and scope of the technical solution of the present invention.

Claims

1. A virtual reality training system for ship equipment, characterized in that: It includes scene virtualization module, training simulation module, real-time rendering control module, 3D scene module and virtual interaction module; The scene virtualization module is used to obtain and create training scene models and ship equipment models; the training simulation module provides training interaction algorithms, collects human-computer interaction information, and generates model interaction content; The 3D scene module is used to track the 3D posture of the motion camera and locate the virtual scene perspective; the virtual interaction module is used to generate tracking data based on human-computer interaction information and generate virtual feedback information based on the interaction content; The auxiliary module is used to generate training data according to training needs, and provide the generation and output of training effects, notification information, evaluation information, etc. The scene virtualization module is used to obtain and create training scene models and ship device models; the training scene model is used to provide virtual scenes of training space, external environment of ship device equipment and other environments; the ship device model is used to provide virtual scenes of ship devices such as ship device systems and supporting control panels; The training simulation module provides training interaction algorithms, collects human-computer interaction information, and generates model interaction content; The training simulation module is used to generate model interaction content including: Establishing a ship device training task element set, wherein the ship device training task element set includes a training task goal, a training task action, a training tool set, and a training environment set; The training task objectives refer to the equipment, components and other operated objects targeted by the ship equipment training tasks; the training task actions refer to a series of necessary operation contents configured to complete the ship equipment training tasks; the training tool set refers to the necessary equipment and tools required to complete the ship equipment training tasks; the training environment set refers to the corresponding element information used to construct the specific environment or situational background of the ship equipment training tasks; The training simulation module is used to collect human-computer interaction information, including: obtaining human-computer interaction information through a virtual reality interaction system, obtaining the types of subsequent ship equipment training tasks required by actively obtaining interaction intentions and autonomous judgment, etc.; according to the type of ship equipment training tasks that need to be performed, the corresponding task code is retrieved and the corresponding task data information is generated.

2. The ship device virtual reality training system according to claim 1, characterized in that: To create a virtual scene, at least the following steps need to be completed: a1. Search for the necessary target information and environment information corresponding to the corresponding virtual scene, and analyze the interaction information between the corresponding targets and between the targets and the environment; a2. According to the specific contents of target information, environmental information and interactive information, obtain and collect basic data such as pictures and videos used to reproduce the aforementioned virtual information contents; a3. Perform necessary image processing on basic data such as pictures and videos to extract texture mapping information; a4. Use 3D modeling software to complete the creation of three-dimensional model units in the virtual scene; a5. Use the 3D engine platform to construct the environmental information in the virtual scene, and introduce the three-dimensional model unit established in the previous steps into the virtual environment; use the training simulation module and the virtual interaction module to build a user interaction interface in the three-dimensional scene.

3. The ship device virtual reality training system according to claim 1, characterized in that: The training simulation module is used to create an interactive algorithm based on at least the following steps: b1. Generate interactive operation data according to the ship device training content, the interactive operation data includes the interactive data between the individual and each unit of the ship device during the virtual reality training process, and the corresponding action and attribute change data of the ship device body and the related structures of the ship device under the influence of each interactive operation. The interactive data and the action or attribute change data are reflected through the dynamic change of the model, the dynamic data of the visualization interface, etc.; b2. Generate and extract dynamic characteristic data of ship equipment according to the operation characteristics and attributes of ship equipment, wherein the motion characteristic data includes motion attribute data, static and dynamic structure data, and power-related data; establish a dynamic characteristic database of ship equipment, and update the dynamic characteristic database of ship equipment according to the training content of ship equipment; b3. Establish a corresponding data interaction and retrieval process based on the ship equipment training content, obtain the specific content of the ship equipment training from the human-computer interaction information, extract the necessary feature data from the ship equipment dynamic feature database according to the training content, and send it to the scene virtual module to output the corresponding virtual device dynamic or static information.

4. The ship device virtual reality training system according to claim 1, characterized in that: To obtain the ship installation training task element set, at least the following steps need to be completed: C1. Dismantle the ship equipment training task operation steps to obtain corresponding sub-steps, wherein the sub-steps are composed of executing a single training task action for the training task target and the required training tool elements and training environment elements; the ship equipment training task is composed of several sub-steps; C2. Establish a sub-step identification table, wherein the sub-step identification table is a table consisting of a task target ID, a single training task action ID, a training tool element ID, and a training environment element ID; C3. Establish a directed network that expresses the ship equipment training task through an ordered combination of sub-steps, wherein the directed network is composed of network vertices and directed line segments between the vertices, wherein the network vertices are composed of sub-steps, and a number of sub-steps connected by a number of directed line segments constitute a complete ship equipment training task, wherein the graphics composed of directed line segments mark the logical relationship between the directional sub-steps; wherein the direction of the directed line segments indicates the order in which the sub-steps are executed, and a number of line segments connecting any two sub-steps represent a number of different processing steps that can be selected for the ship equipment training task, and a cross line segment passing through any sub-step indicates that the ship equipment training task needs to select the content of the next sub-step after passing through the sub-step; C4. Establish a sign symbol for representing the logical relationship of the aforementioned directed line segments, and establish a directed table containing the logical relationship of sub-steps in combination with the directed network representing each ship equipment training task, and complete the coding of the ship equipment training task expressed by the sub-steps and the logical relationship of the sub-steps.

5. The ship device virtual reality training system according to claim 4, characterized in that: For the directed network above, the vertices of which are the sub-step data set l = {1, 2.....N} consisting of N sub-steps, for any sub-step i, j∈l, if sub-step i is the prerequisite step for sub-step j to execute, then the directed edge association e ij =1 otherwise e ij =0; In order to analyze whether the sub-step distribution in the directed network is reasonable, the network density of the vertices in the directed graph is used to express the closeness of the connection between the vertices in the directed network. Assuming that the directed edge correlation e ij = 1 is M, then the network density can be expressed as After determining the network density r, the exercise intensity between the sub-steps represented by the vertices in the directed network can be preliminarily judged. If the network density is too small, it means that the sub-steps are divided too finely, and the number of sub-steps into which the ship equipment training task is divided is too large, which will lead to too much total data used to express the ship equipment training task, and some sub-steps need to be merged. On the contrary, it means that the number of sub-steps is too small, and the details of the ship equipment training task cannot be sufficiently decomposed, which is not conducive to ensuring the training effect, and further step decomposition is required; In order to improve the quality of training, we should identify the more important key sub-steps among the sub-steps decomposed from a large number of ship equipment training tasks. As a common processing method, we can use the correlation value of the corresponding vertex of each sub-step and other associated vertices to represent; by associating the value f i A preliminary analysis is performed on the importance of sub-step i to determine the sub-steps with the highest importance, so that the training weights of the corresponding sub-steps can be increased according to the associated values ​​during the training process.

6. The ship device virtual reality training system according to claim 5, characterized in that: In order to optimize the process steps of the ship equipment training task, in addition to the training content of the pre-set fixed steps, in order to facilitate the enhanced training of a certain target sub-step during the training process, it is necessary to establish a training sequence with a relatively smaller number of sub-steps and a relatively shorter preparation step time. That is, for a sub-step k that is expected to be trained, it is necessary to determine a sub-step sequence {k1, k2...k n ...k x }, where sub-step k n-1 is sub-step k n Prerequisite step, sub-step k x It is the prerequisite step of sub-step k, so that the objective function goal = min[ω1x+ω2(t1+t2....+t x )] to obtain the minimum value.

7. The ship device virtual reality training system according to claim 2, characterized in that: The environmental information in the virtual scene includes surface structure information of the space where the device is located, other non-interactive device information of the space where the ship device is located, and path navigation information; The surface structure information generates the corresponding surface structure based on the terrain editing tool and the spatial structure editing tool, and completes the filling and optimization of the surface structure related data by acquiring and collecting the basic data to complete the surface structure information. The non-interactive device information generates three-dimensional scene information of the non-interactive device based on a structure or building editing tool or a texture mapping tool; The path navigation information generates different path nodes and routes between path nodes based on the road modeling tool and the path finding auxiliary tool, and completes the editing of the operable range of the routes and nodes by obtaining and collecting information such as the actual path width and length.

8. The ship device virtual reality training system according to claim 7, characterized in that: The three-dimensional model unit completes the creation of the corresponding local unit model through the three-dimensional modeling software according to the interactive area and functional module involved, converts it into a three-dimensional model that can be recognized by the 3D engine platform through the format conversion tool, and then inputs it into the 3D engine platform for loading and mapping configuration. The corresponding local unit model is assigned relevant dynamic and static properties through the 3D engine platform property configuration tool, and the corresponding feedback model under different interactive contents is established according to the feedback information provided by the virtual interaction module.

Citation Information

Patent Citations

  • Method, device and system for interactively combining real-time scene in real world with virtual reality scene

    CN101174332A

  • VR electric power training method and system

    CN113178111A

  • Training system based on Internet virtual reality

    CN115756157A

  • Task scheduling method and device of multi-engine computing system and storage medium

    CN116820730A

  • Multi-AUV digital twin system and equipment based on mixed reality and storage medium

    CN118015228A

Cited By

  • Police tactical training system and method based on virtual reality

    CN120340333A

  • Sensitive roll-on and roll-off practical training simulation system and method

    CN122224030A