Dynamically configurable interactive training system and application method

By designing a dynamically configured interactive training system, the problem of fixed content of the existing VR training system is solved, the dynamic construction of virtual scenes and the scalability of training content is realized, and the training effect and cost-effectiveness are improved.

CN117271549BActive Publication Date: 2025-08-12BEIJING AEROSPACE INST FOR METROLOGY & MEASUREMENT TECH
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210674260.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-14
Publication Date
2025-08-12
Estimated Expiration
2042-06-14

AI Technical Summary

Technical Problem

The training content of the existing VR training system is fixed, and the trainees are prone to path dependence, and cannot dynamically expand and switch training content and virtual scenes, and cannot conduct combination and targeted training and assessment of specific training content. Instructors cannot obtain and analyze the training content and assessment results of each trainee. Each update of the virtual training scenario requires re-release and update of the software system.

Method used

Design an interactive training system including basic support units, database units, model library units, simulation training support units and application platforms to support user permission management and dynamic scenario configuration. Through JSON files, the dynamic construction of virtual scenes and the scalability of training content is realized.

Benefits of technology

It realizes the diversity of training scenarios and the scalability of training logic, and can conduct combination training and assessment for specific training content, which reduces costs, improves training results, and supports effective intervention and results display in the training process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117271549B_ABST
    Figure CN117271549B_ABST
Patent Text Reader

Abstract

A dynamically configurable interactive training system includes a basic support unit, a database unit, a model library unit, a simulation training support unit, and an application platform. The database unit includes a user information table, a resource information table, and an operating procedure table; the model library unit includes various scenario models, normal equipment models, hidden danger equipment models, and worker models; the simulation training support unit and the application platform complete the user authority configuration, and dynamically configure the scenario and construct the virtual scenario according to the user's job type and the list of hidden dangers to be trained. The present invention supports teaching, learning, training, and assessment, and can display the assessment results. The present invention also discloses an application method of the system. Based on dynamic loading technology, the present invention realizes the diversity of training scenarios and the scalability of training logic. Compared with the traditional single training path and solidified training content, it greatly improves the training effect, reduces costs, and realizes the purpose of a set of systems to achieve a variety of safety hazard training.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an interactive training system capable of dynamic configuration and an application method, belonging to the field of production safety training. Background Art

[0002] Currently, the most widely used VR training systems mainly provide targeted training in a specific field. They usually adopt the form of stand-alone software and the training content and process are relatively fixed. Trainees participating in the training are prone to path dependence, and training new content requires the redevelopment of a corresponding software system, which will lead to repetitive function development.

[0003] Existing VR training systems are typically hard-coded, with the 3D content and training control flow already defined at launch. Implementation typically involves creating the virtual 3D scene using 3dsMax, and then using game engines (such as Unity and Unreal) to drive the scene's interactions.

[0004] The existing technical solutions have the following problems:

[0005] The training content is fixed, which makes trainees prone to path dependence and reduces the training effect;

[0006] Instructors are unable to obtain and analyze the training content and assessment results of each trainee;

[0007] It is impossible to conduct combined targeted training and assessment on specific training content;

[0008] Every update of the virtual training scenario requires the re-release and update of the software system;

[0009] Unable to dynamically expand and switch training content and virtual scenarios;

[0010] It is impossible to effectively intervene in the training process to improve the training effect. Summary of the Invention

[0011] The technical problem solved by the present invention is to overcome the deficiencies of the prior art and propose an interactive training system capable of dynamic configuration and an application method.

[0012] The solution of the present invention is:

[0013] A dynamically configurable interactive training system includes a basic support unit, a database unit, a model library unit, a simulation training support unit, and an application platform;

[0014] Basic support unit: provides the necessary software and hardware support environment for the operation of the interactive training system;

[0015] Database unit: includes a user information table, a resource information table, and an operating procedure table; the user information table is used to store the basic information, permissions, and job types of all users; the resource information table is used to store information on various scenarios involved in safe production, information on each device involved in each scenario, the location information of each device in each scenario, information on potential hazards involved in each scenario, and training results for trainees; the operating procedure table is used to store the operating procedures for each user group, including administrators and various job types of client units;

[0016] Model library unit: includes various scenario models involved in safe production, normal equipment models, potential equipment models, and worker models. Each model corresponds one-to-one with the corresponding information in the resource information table in the database unit through the index field;

[0017] Simulation training support unit: supports user authority management; dynamically configures scenarios based on user job types and the list of hidden dangers to be trained; generates assessment results based on assessment data;

[0018] Application platform: includes system administrator module, customer unit guidance module and student training module. The system administrator module is the highest configuration unit, which can configure and manage the database unit and model library unit; the customer unit guidance module is a secondary configuration unit, which is used to configure the list of hidden dangers to be trained for different types of work in the unit during each training and send it to the simulation training support unit; the student training module completes the construction of the virtual scene according to the dynamic configuration information of the scene, and conducts teaching, learning, training and assessment. During the assessment, the assessment data is recorded and sent to the simulation training support unit.

[0019] Preferably, the scenario model corresponds one-to-one with the scenario information in the resource information table through field ID, the normal device model corresponds one-to-one with the device information in the resource information table through field ID, and the hidden danger device model corresponds one-to-one with the hidden danger information in the resource information table through field ID.

[0020] Preferably, the simulation training support unit includes a virtual scene reconstruction module, a user role and authority management module, an information explanation module, a collaborative teaching module and a training result generation module;

[0021] User role and authority management module: supports administrators to configure user roles and authorities;

[0022] Virtual scene reconstruction module: This module determines the virtual scene to be represented by the current system based on the user's job type and the list of hidden dangers to be trained. It uses the resource information table in the database unit to obtain the scene model ID, normal equipment model ID, hidden danger equipment model ID, and worker model ID in the virtual scene to be represented. It then configures the resource IDs on the web side, binds the aforementioned model resources to the control logic required for overall virtual scene teaching, learning, training, or assessment, generates a JSON file, and completes the dynamic configuration of the scene.

[0023] Information explanation module: After the virtual scene is built, the hidden dangers in the scene are explained. The explanation includes the basis for determining the hidden dangers, the classification of the hidden dangers, and the hidden danger rectification measures;

[0024] Collaborative teaching module: can simultaneously control the display content of each client and explain the selected hidden danger knowledge points;

[0025] Training result generation module: Generates training results based on assessment data and displays them.

[0026] Preferably, the student training module completes the construction of the virtual scene according to the scene dynamic configuration information in the following manner:

[0027] The student training module reads the resource information in the JSON file and determines whether the required model resources exist locally;

[0028] If so, load the corresponding model resource; otherwise, obtain the server location of the model library unit, download the model resource on the server, save it locally, and load the resource at the same time;

[0029] Repeat the above steps to traverse all resource information in the JSON file and complete the dynamic loading of model resources into the scene;

[0030] After loading is completed, the positions and angles of normal equipment and equipment with hidden dangers are configured according to the production status of the workshop, and the corresponding equipment is dynamically instantiated to the specified position to complete the three-dimensional construction of the virtual scene.

[0031] Preferably, the collaborative teaching module needs to build a network collaborative environment, and the client unit guidance module and the client use network synchronization to interact, all ports are connected to the same network server, and the server is responsible for data distribution between the ports.

[0032] Preferably, the collaborative teaching module uses RPC remote calls to synchronize model states between different clients.

[0033] Preferably, the system administrator module and the client unit guidance module are both configured and service released on the Web side.

[0034] An application method of a dynamically configurable interactive training system, comprising:

[0035] The administrator on the server side assigns roles and configures permissions for the client units that currently want to conduct interactive training;

[0036] The administrator of the client unit configures the list of hidden dangers to be trained for different types of work in the client unit on the client unit;

[0037] After the client's user logs into the system, the system determines the virtual scene to be displayed by the current system based on the user's job type and the list of hidden dangers to be trained. It uses the database unit and model library unit to obtain the 3D model resource link, binds the control logic, extracts the corresponding 3D model, and dynamically loads it into the training scene to complete the construction of the virtual scene.

[0038] If the user selects the teaching mode, the user's perspective will be locked to the customer unit administrator's perspective. From the customer unit administrator's perspective, the system will explain the hidden dangers in the current virtual scene one by one, and teach the methods of troubleshooting and rectifying the hidden dangers.

[0039] If the user selects the learning mode, the user can click on the hidden danger on the interface to learn the content of the hidden danger and the rectification method; the hidden danger content includes the basis for determining the hidden danger and the classification of the hidden danger;

[0040] If the user selects the training mode, the user will roam autonomously in the virtual scene, find potential hazards in the virtual scene and make corrections. The system will display the current training progress in real time. During the training, the user can select the "Help" function to prompt the potential hazards that have not yet been discovered in the current virtual scene, and correct them one by one to complete the training.

[0041] If the user selects the assessment mode, the user will roam autonomously in the virtual scene, find potential hazards in the scene and make corrections within a limited time. After the assessment is completed, the system will record the assessment data and generate the assessment results.

[0042] Preferably, the virtual scene construction process is as follows:

[0043] Determine the virtual scene to be displayed by the current system based on the user's job type and the list of hidden dangers to be trained. Use the resource information table in the database unit to obtain the scene model ID, normal equipment model ID, hidden danger equipment model ID, and worker model ID in the virtual scene to be displayed. Configure the resource ID on the web side, bind the above-mentioned various model resources with the control logic required for the overall virtual scene teaching, learning, training, or assessment, and generate a JSON file.

[0044] Model resources are extracted based on the resource information in the JSON file and dynamically loaded into the scene. After loading is completed, the positions and angles of normal equipment and equipment with hidden dangers are configured according to the production status of the workshop, and the corresponding equipment is dynamically instantiated to the specified position to complete the three-dimensional construction of the virtual scene.

[0045] Preferably, the model resource is extracted according to the JSON file resource information and dynamically loaded into the scene as follows:

[0046] Determine whether the required model resources exist locally based on the JSON file resource information;

[0047] If so, load the corresponding model resource; otherwise, obtain the server location of the model library unit, download the model resource on the server, save it locally, and load the resource at the same time;

[0048] Repeat the above steps to traverse all resource information in the JSON file and complete the dynamic loading of model resources into the scene.

[0049] The beneficial effects of the present invention compared with the prior art are:

[0050] (1) The present invention is based on dynamic loading technology to achieve the diversity of training scenarios and the scalability of training logic, thereby improving the adaptability of the system in different training scenarios. Virtual training scenarios can be published and updated as needed, and training content and virtual scenarios can be dynamically expanded and switched at any time according to demand. The training content is not fixed, and combined targeted training and assessment can be carried out for specific training content. Compared with the traditional single training path and solidified training content, the present invention can effectively intervene in the training process, greatly improve the training effect, and reduce costs at the same time, achieving the purpose of a set of systems to achieve multiple safety hazard training.

[0051] (2) The present invention supports the administrator of the client unit to select the training or assessment content and display the assessment results.

[0052] (3) The present invention manages the potential danger points and models independently and dynamically binds them through management logic, thereby providing better system scalability while retaining the original basic information of the potential danger points and models. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 Schematic diagram of the system of the present invention;

[0054] Figure 2 To dynamically load the flow chart;

[0055] Figure 3 This is a schematic diagram of the network collaborative environment architecture;

[0056] Figure 4This is a data transmission flow chart. DETAILED DESCRIPTION

[0057] The present invention will be further described below with reference to the accompanying drawings.

[0058] The system of the present invention uses the database as the intermediate node, adopts the combination of B / S and C / S, and fully utilizes the management convenience of Web services and the performance advantages of local operation. Administrators can remotely manage system resources through web services, and users can access system functions through local terminals. The overall framework of the system is as follows Figure 1 Each client obtains the current training scene resource list by accessing the database unit and the model library unit, and downloads and loads the corresponding 3D resources from the server to dynamically compose the training scene.

[0059] like Figure 1 As shown in the figure, the overall hierarchical structure of the system is divided into "basic support unit", "database unit, model library unit", "simulation training support unit" and "application platform". In addition, in order to ensure the security and reliability of the system operation and the subsequent scalability of the system, the system system also includes standards and normative documents such as "usage specifications" and "security assurance" mechanisms.

[0060] Basic support unit: It supports and guarantees the safe and reliable operation of the system, and provides the necessary software and hardware support environment for the operation of the interactive training system. The hardware environment consists of two parts. One part is the hardware environment running on the management side, including computer room infrastructure, hardware and network, security and disaster recovery, etc.; the other part is the hardware environment running in each customer unit, mainly including servers, routers, switches, etc. Among them, the computer room infrastructure includes the power distribution system, air conditioning and fresh air system, fire alarm system, weak current control system, cabinet system and lightning protection system required for the construction of the data center computer room. Hardware and network include servers, networks, storage, backup equipment, etc. Security and disaster recovery include storage backup equipment, security and confidentiality systems, and off-site disaster recovery solutions. The software environment running on the management side and running in each customer unit includes operating system, database, and VR operating environment.

[0061] The database unit and model library unit are the foundation of this system. The database unit stores various types of information in the form of fields, including a user information table, a resource information table, and an operating procedure table. The user information table is used to store all users' basic information (name, unit, phone number), permissions, and job titles. The resource information table is used to store information on various scenarios involved in safe production, information on the various devices involved in each scenario, information on potential hazards involved in each scenario, and information on the training results of trainees. The operating procedure table is used to store the operating procedures for each user group, including administrators and various job titles of client units.

[0062] Database units usually use tablespaces, data tables, fields, attributes, etc. to store and manage related data. The database in the system mainly consists of data tables and their dependencies, views, and other auxiliary functions.

[0063] The model library unit includes various scenario models involved in safe production, models of normal equipment, models of equipment with potential hazards, and worker models. These models are typically stored in the form of files, including white models, textures, maps, animations, audio, video, and 3D landscape data. Scenario models correspond one-to-one with scene information in the resource information table via field IDs. Normal equipment models correspond one-to-one with equipment information in the resource information table via field IDs. And potential hazard equipment models correspond one-to-one with potential hazard information in the resource information table via field IDs.

[0064] The model library mainly stores and manages the relevant resource files required for system operation in the form of files. The dependencies between various resource files in the model library are usually uniformly planned and managed in the form of Json files and database property tables (indexes).

[0065] The simulation training support unit is the core of the system's development. Using the platform portal system as a unified access interface, it provides data and functional service interfaces. Users can use the functions provided by the simulation training support unit to complete related teaching, training, and assessment tasks. They can also utilize the interface functions retained by the simulation training support unit to complete operations such as data addition and user and permission management. The simulation training support unit dynamically configures scenarios based on the user's job type and a list of potential training hazards, generating training results based on actual training data.

[0066] The simulation training support unit is the core of the system, built on the .NET framework. It utilizes either the Microsoft.NET or Mono.NET runtime library, depending on the operating system and work environment of the user's existing server. The system's 3D scene browsing, interaction, and feature delivery are developed using Unity3D, a popular 3D virtual reality engine.

[0067] The simulation training support unit is the core of the system's functional modules, and all user interfaces are based on it. To ensure system flexibility, the independence of functional modules is maintained as much as possible during system design, and the coupling between modules is reduced.

[0068] The simulation training support unit includes a virtual scene reconstruction module, a user role and authority management module, an information explanation module, a collaborative teaching module, and a training result generation module.

[0069] The user role and permission management module supports administrators to configure user roles and permissions;

[0070] The virtual scene reconstruction module determines the virtual scene to be presented by the current system based on the user's job type and the list of hidden dangers to be trained. It uses the database unit and the model library unit to obtain the 3D model resource link, extracts the corresponding 3D model, dynamically loads it into the training scene, and binds the control logic to complete the virtual scene construction.

[0071] After the virtual scene is constructed in the information explanation module, the hidden dangers in the scene are explained, including the basis for determining the hidden dangers, the classification of the hidden dangers, and the hidden danger rectification measures;

[0072] The collaborative teaching module can simultaneously control the display content of each client and explain the selected hidden danger knowledge points;

[0073] The training result generation module generates training results based on the assessment data and displays them.

[0074] The application platform is built on the simulation training support unit and is divided into three parts based on user type: the system administrator module, the customer unit guidance module, and the student training module. Different modules can provide different functions.

[0075] The main functions of the system administrator module include: database unit configuration management, model library unit configuration management, and local server management. Database unit configuration management includes adding, reducing, modifying, and deleting various types of information. Model library unit configuration management includes adding, reducing, modifying, and deleting various models.

[0076] The main functions of the customer unit guidance module include: user management, hidden danger list configuration management, and assessment and scoring management.

[0077] The main functions of the student training module include: independent learning, virtual training, and virtual assessment.

[0078] The system's database, model library management, and Web service publishing functions are based on the software system's architecture and related software configuration solutions, and are updated and improved accordingly. The 3D model data involved is collected using on-site photos, created in 3ds Max, and stored in a unified format.

[0079] Both the system administrator module and the client unit guidance module are configured and service released on the web. This is intuitive and easy to manage, eliminating the need to log in to the executable program for dynamic configuration each time, improving system stability.

[0080] The simulation training support unit mainly performs dynamic scene configuration through the virtual scene reconstruction module based on the user's job type and the list of hidden dangers to be trained.

[0081] The virtual scene reconstruction module first determines the virtual scene to be represented by the current system and uses the resource information table stored in the database to obtain the 3D model ID content in the virtual scene. It then combines the scene resource ID stored in the database to obtain the corresponding 3D model resource link. Finally, the virtual scene is recreated by dynamically loading the 3D model into the virtual scene.

[0082] (1) Scene Content Acquisition. This system can adapt to different virtual scenes, which are composed of model resources and their locations. Resources are stored as files, and each resource is maintained in the database as a file link. Scene content acquisition involves obtaining a list of all resources in the scene and their locations and angles within the virtual scene. This operation can directly access the relevant data through the database.

[0083] (2) Resource index acquisition. The database unit stores the access link of each resource in the model library unit. The system obtains the index of the resource required by the scene based on the obtained scene content resource ID, and obtains the file access address of the corresponding resource through the index.

[0084] (3) Dynamic loading of resources. By obtaining the files of resources required for the scene, determine whether the current local client has the resource. If the resource exists locally, load the corresponding resource from the local client. If the resource does not exist locally, download the resource through the network and save the resource to the local folder so that it can be loaded directly from the local next time to improve the loading speed. After loading the resource into the scene, obtain the location of the resource in the scene and dynamically instantiate the resource to the specified location. When all resources are dynamically loaded to the specified location in the scene, the three-dimensional reproduction of the virtual scene is completed. The dynamic resource loading process is as follows: Figure 2 As shown, the details are as follows:

[0085] Determine whether the required model resources exist locally based on the ID information;

[0086] If so, load the corresponding model resource; otherwise, obtain the server location of the model library unit, download the model resource on the server, save it locally, and load the resource at the same time;

[0087] Repeat the above steps to traverse all required model resources and complete the dynamic loading of model resources into the scene.

[0088] (4) Scene logic linking. In addition to display functions, various resources dynamically loaded into the scene also have dynamic control requirements. They must be associated with the overall scene logic. The logic of individual resources must be bound to the control logic required for the overall scene training to achieve automatic monitoring of the learning, training, and assessment processes.

[0089] The collaborative teaching module controls the display content of each client and selects a specific knowledge point to focus on. During the teaching process, the model status displayed on each client and the viewing angle of each model can be controlled.

[0090] The network collaborative environment is built. The interaction between the controller and the client is controlled by network synchronization. All participating terminals are connected to the same network server, and the server is responsible for data distribution between the clients. This system uses the mature network server - Photon Server as the collaborative server. Its architecture is as follows Figure 3 This system uses the UDP protocol to synchronize network status between clients, reducing network bandwidth pressure while ensuring network timeliness.

[0091] Model state synchronization. During collaborative teaching, the model state explained by each client should be consistent, and the model state displayed by the client should be controllable. Since the model state only changes when the state is switched, this system uses RPC remote calls to synchronize the model state between different clients to improve network efficiency. RPC, which stands for Remote Procedure Call, is an inter-process communication method that allows a program to call a procedure or function in another address space (usually on another machine on a shared network) without the program explicitly encoding the details of the remote call.

[0092] Viewpoint synchronization. When an instructor is giving a lecture, the viewpoints of each client need to be aligned with the instructor's client so that users can understand what the instructor is saying. To achieve this, the virtual viewpoints of each client and the instructor need to be synchronized. The system uses a real-time synchronization solution to update the position and angle of the client's virtual viewpoint in real time.

[0093] The data flow of the present invention is as follows Figure 4 As shown, Figure 4 In the process, existing role and permission management data and safety hazard data are extracted from the database unit. Scenario content data is extracted based on the various safety production scene equipment components for local training. 3D modeling materials, 2D images, and audio and video data from various safety production scenarios are integrated and processed into 3D model files, texture files, and audio and video files. Assessment results are then used for training and display.

[0094] The simulation training support unit dynamically configures the scene through the web. The application platform receives the dynamic configuration information of the web scene, completes the construction of the virtual scene, and conducts teaching, learning, training and assessment.

[0095] A method for applying a dynamically configurable interactive training system comprises the following steps:

[0096] The administrator on the server side assigns roles and configures permissions for the client units that currently want to conduct interactive training;

[0097] The administrator of the client unit configures the list of hidden dangers to be trained for different types of work in the client unit on the client unit;

[0098] After the client's user logs in to the system, the system determines the virtual scene to be displayed by the current system based on the user's job type and the list of hidden dangers to be trained. It uses the database unit and model library unit to obtain the 3D model resource link, extracts the corresponding 3D model, dynamically loads it into the training scene, and binds the control logic to complete the virtual scene construction.

[0099] If the user selects the teaching mode, the user's perspective will be locked to the customer unit administrator's perspective. From the customer unit administrator's perspective, the system will explain the hidden dangers in the current virtual scene one by one, and teach the methods of troubleshooting and rectifying the hidden dangers.

[0100] If the user selects the learning mode, the user can click on the hidden danger on the interface to learn the content of the hidden danger and the rectification method; the hidden danger content includes the basis for determining the hidden danger and the classification of the hidden danger;

[0101] If the user selects the training mode, the user will roam autonomously in the virtual scene, find potential hazards in the virtual scene and make corrections. The system will display the current training progress in real time. During the training, the user can select the "Help" function to prompt the potential hazards that have not yet been discovered in the current virtual scene, and correct them one by one to complete the training.

[0102] If the user selects the assessment mode, the user will roam autonomously in the virtual scene, find potential hazards in the scene and make corrections within a limited time. After the assessment is completed, the system will record the assessment data and generate the assessment results.

[0103] The virtual scene construction process is as follows:

[0104] The virtual scene reconstruction module determines the virtual scene to be displayed by the current system based on the user's job type and the list of hidden dangers to be trained. It uses the resource information table in the database unit to obtain the scene model ID, normal equipment model ID, hidden danger equipment model ID, and worker model ID in the virtual scene to be displayed. It configures the resource ID on the web side and binds the above-mentioned various model resources with the control logic required for the overall virtual scene teaching, learning, training or assessment to generate a JSON file.

[0105] The student training module extracts model resources based on the JSON file resource information and dynamically loads them into the scene. After loading is completed, the position and angle of normal equipment and hidden danger equipment are configured according to the production status of the workshop, and the corresponding equipment is dynamically instantiated to the specified position to complete the three-dimensional construction of the virtual scene.

[0106] The process of extracting model resources based on JSON file resource information and dynamically loading them into the scene in the student training module is as follows:

[0107] Determine whether the required model resources exist locally based on the resource information in the JSON file;

[0108] If so, load the corresponding model resource; otherwise, obtain the server location of the model library unit, download the model resource on the server, save it locally, and load the resource at the same time;

[0109] Repeat the above steps to traverse all resource information in the JSON file and complete the dynamic loading of model resources into the scene.

[0110] In the present invention, each production field has a hidden danger resource library, which serves as a question bank for interactive training of client units. According to the training or assessment plan, the client unit administrator extracts content from the question bank and configures a list of hidden dangers to be trained for a certain type of work as training (teaching, learning, training) or assessment content.

[0111] Example:

[0112] The content of the present invention is explained by taking the application of the interactive training system of the present invention to realize the practical training of safety hazard identification and elimination in a certain unit as an example.

[0113] Unit nature: Mechanical processing manufacturer

[0114] Training targets: Safety officers of machining enterprises, workshop team leaders, and front-line production staff

[0115] System usage process:

[0116] 1. Server Administrator:

[0117] Assign roles to the unit and configure permissions, including the customer unit administrator role, which provides background management permissions; roles related to mechanical processing production, and open mechanical processing production-related interfaces including production workshop scenes and hidden danger resource library interfaces.

[0118] 2. Client Unit Administrator:

[0119] 1. Personnel Management

[0120] Open accounts for the unit's trainees and classify their work types and permissions based on their positions and work types.

[0121] 2. Management of hidden danger list to be trained

[0122] In the configured hidden danger resource library, new lists of hidden dangers to be trained for different types of work are created to support subsequent personnel training. Based on the type of hidden dangers and difficulty level, multiple sets of hidden danger lists to be trained can be set up for the same type of work for training.

[0123] 3. Training Management

[0124] (1) Training plan: According to the unit's training arrangements, a list of hidden dangers to be trained is issued to each type of work or team member, and a training time is set. A training plan is generated and sent to the trainee's account.

[0125] (2) Training records: Record the training process and results and form a record sheet. The recorded information includes: the job type of the trained user, training plan, start time, end time, training score, etc.

[0126] 3. User Training

[0127] 1. Login and Personal Information Management

[0128] Log in to the system, enter the personal information page, and modify the initial password.

[0129] 2. Training plan selection

[0130] Among the training plans issued by the unit administrator received by the account, select a designated or arbitrary plan for learning and training according to requirements.

[0131] 3. Port selection

[0132] Depending on the hardware support environment of the training scenario, you can choose to conduct training on a PC or VR device. Based on the user's job type and the list of potential hazards to be trained, the system determines the virtual scene to be presented. It then uses database and model library units to obtain links to 3D model resources, binds control logic, extracts the corresponding 3D model, and dynamically loads it into the training scenario, completing the construction of the virtual scene.

[0133] 4. Training mode:

[0134] 4.1 Teaching Model

[0135] If the user selects the teaching mode, the user's perspective will be uniformly locked to the customer unit administrator's perspective. From the customer unit administrator's perspective, the system will explain the hidden dangers of the current virtual scene one by one, and teach the methods of detecting and rectifying the hidden dangers.

[0136] 4.2 Learning Mode

[0137] If the user selects the learning mode, the user can click on the hidden danger on the interface to learn the content of the hidden danger and the rectification method; the hidden danger content includes the basis for determining the hidden danger and the classification of the hidden danger;

[0138] 4.3 Training Mode

[0139] If the user selects the training mode, the user will roam autonomously in the virtual scene, find potential hazards in the virtual scene and make corrections. The system will display the current training progress in real time. During the training process, the user can select the "Help" function to prompt the potential hazards that have not yet been discovered in the current virtual scene, and correct them one by one to complete the training.

[0140] 4.4 Assessment Mode

[0141] If the user selects the assessment mode, the user will roam autonomously in the virtual scene, find potential hazards in the scene and make corrections within a limited time. After the assessment is completed, the system will record the assessment data and generate the assessment results.

[0142] The technologies not disclosed in the present invention are common knowledge to those skilled in the art.

Claims

1. A dynamically configurable interactive training system, characterized by: It includes basic support unit, database unit, model library unit, simulation training support unit and application platform; Basic support unit: provides the necessary software and hardware support environment for the operation of the interactive training system; Database unit: including user information table, resource information table and operation procedure table; the user information table is used to store the basic information, permissions and job types of all users; The resource information table is used to store various scenario information involved in safe production, information about each device involved in each scenario, location information of each device in each scenario, hidden danger information involved in each scenario, and training result information of trainees; The operation procedure table is used to store the operation process of each user group, and the user groups include administrators and various types of work of client units; Model library unit: includes various scenario models involved in safe production, normal equipment models, potential equipment models, and worker models. Each model corresponds one-to-one with the corresponding information in the resource information table in the database unit through the index field; Simulation training support unit: supports user authority management; dynamically configures scenarios based on user job types and the list of hidden dangers to be trained; generates assessment results based on assessment data; Application platform: includes a system administrator module, a client unit guidance module, and a student training module. The system administrator module is the highest configuration unit, capable of configuring and managing the database unit and model library unit. The client unit guidance module is a secondary configuration unit, used to configure a list of hidden dangers to be trained for different types of work in the unit during each training session and send it to the simulation training support unit. The student training module completes the construction of virtual scenarios based on the dynamic configuration information of the scenarios, and conducts teaching, learning, training, and assessment. During the assessment, the assessment data is recorded and sent to the simulation training support unit. The simulation training support unit includes a virtual scene reconstruction module, a user role and authority management module, an information explanation module, a collaborative teaching module and a training result generation module; User role and authority management module: supports administrators to configure user roles and authorities; Virtual scene reconstruction module: Determines the virtual scene to be displayed by the current system based on the user's job type and the list of hidden dangers to be trained. Uses the resource information table in the database unit to obtain the scene model ID, normal equipment model ID, hidden danger equipment model ID, and worker model ID in the virtual scene to be displayed. Configures resource IDs on the web side, binds various model resources to the control logic required for overall virtual scene teaching, learning, training, or assessment, generates a JSON file, and completes dynamic scene configuration. Information explanation module: After the virtual scene is built, the hidden dangers in the scene are explained. The explanation includes the basis for determining the hidden dangers, the classification of the hidden dangers, and the hidden danger rectification measures; Collaborative teaching module: can simultaneously control the display content of each client and explain the selected hidden danger knowledge points; Training result generation module: Generates training results based on assessment data and displays them.

2. The dynamically configurable interactive training system according to claim 1, characterized in that: The scene model corresponds to the scene information in the resource information table through the field ID, the normal device model corresponds to the device information in the resource information table through the field ID, and the hidden danger device model corresponds to the hidden danger information in the resource information table through the field ID.

3. The dynamically configurable interactive training system according to claim 1, characterized in that: The student training module completes the construction of the virtual scene based on the dynamic configuration information of the scene as follows: a. The student training module reads the resource information in the JSON file and determines whether the required model resources exist locally; b. If yes, load the corresponding model resource; otherwise, obtain the server location of the model library unit, download the model resource on the server, save it locally and load the model resource at the same time; c. Repeat steps ab above to traverse all resource information in the JSON file and complete the dynamic loading of model resources into the scene; After the loading is completed, the positions and angles of normal equipment and equipment with hidden dangers are configured according to the production status of the workshop, and the corresponding equipment is dynamically instantiated to the specified position to complete the three-dimensional construction of the virtual scene.

4. The dynamically configurable interactive training system according to claim 1, characterized in that: The collaborative teaching module requires the establishment of a network collaborative environment. The client unit guidance module and the client interact using network synchronization. All ports are connected to the same network server, and the server is responsible for data distribution between ports.

5. The dynamically configurable interactive training system according to claim 4, characterized in that: The collaborative teaching module uses RPC remote calls to synchronize the model status between different clients.

6. The dynamically configurable interactive training system according to claim 1, characterized in that: The system administrator module and the customer unit guidance module are both configured and service released on the Web side.

7. An application method of a dynamically configurable interactive training system, characterized in that: include: Assign roles and configure permissions for the client units that will currently be conducting interactive training; Configure the hidden danger list to be trained for different types of work on the client; After the user logs in to the system, the system determines the virtual scene to be displayed by the current system based on the user's job type and the list of hidden dangers to be trained. It uses the database unit and model library unit to obtain the 3D model resource link, binds the control logic, extracts the corresponding 3D model and dynamically loads it into the training scene to complete the virtual scene construction; If the user selects the teaching mode, the user's perspective will be locked to the administrator's perspective. The system will explain the hidden dangers in the current virtual scene one by one, and teach the methods of troubleshooting and rectifying the hidden dangers. If the user selects the learning mode, the user can click on the hidden danger on the interface to learn the content of the hidden danger and the rectification method; the hidden danger content includes the basis for determining the hidden danger and the classification of the hidden danger; If the user selects the training mode, the user will roam autonomously in the virtual scene, find potential hazards in the virtual scene and make corrections. The system will display the current training progress in real time. During the training process, users can select the "Help" function to prompt potential hazards that have not yet been discovered in the current virtual scene, and correct them one by one to complete the training; If the user selects the assessment mode, the user will roam autonomously in the virtual scene, find potential hazards in the scene and make corrections within a limited time. After the assessment is completed, the system will record the assessment data and generate the assessment results. The virtual scene construction process is as follows: Determine the virtual scene to be displayed by the current system based on the user's job type and the list of hidden dangers to be trained. Use the resource information table in the database unit to obtain the scene model ID, normal equipment model ID, hidden danger equipment model ID, and worker model ID in the virtual scene to be displayed. Configure the resource ID on the web side, bind various model resources with the control logic required for the overall virtual scene teaching, learning, training, or assessment, and generate a JSON file. Model resources are extracted based on the resource information in the JSON file and dynamically loaded into the scene. After loading is completed, the positions and angles of normal equipment and equipment with hidden dangers are configured according to the production status of the workshop, and the corresponding equipment is dynamically instantiated to the specified position to complete the three-dimensional construction of the virtual scene.

8. The method for applying a dynamically configurable interactive training system according to claim 7, characterized in that: The implementation method of extracting model resources based on JSON file resource information and dynamically loading them into the scene is as follows: a. Determine whether the required model resources exist locally based on the JSON file resource information; b. If yes, load the corresponding model resource; otherwise, obtain the server location of the model library unit, download the model resource on the server, save it locally and load the model resource at the same time; c. Repeat steps ab above to traverse all resource information in the JSON file and complete the dynamic loading of model resources into the scene.

Citation Information

Patent Citations

  • VR-based safety production scene hidden danger troubleshooting training system and method, and device

    CN111179680A

  • System for providing dynamic simulation based on BIM data and method thereof

    KR102292769B1