A VR-based virtual training system and method for continuous casting steel pouring operations

Abstract

This invention belongs to the field of factory training technology and discloses a VR-based virtual training system and method for continuous casting steel pouring operations. The system includes a VR device, a 3D dynamic model construction unit, a basic data storage unit, a virtual training engine unit, and a continuous casting steel pouring operation training application unit. The method includes the following steps: initializing the virtual training system for continuous casting steel pouring operations; constructing a 3D dynamic model of continuous casting steel pouring; logging into the continuous casting steel pouring operation training application platform using the VR device; collecting user interaction data, selecting the continuous casting steel pouring operation training application, calling model metadata for rendering, and returning the interaction results; collecting interaction data, conducting virtual training on continuous casting steel pouring operations, and returning the interaction results. This invention solves the problems of existing technologies, such as lack of immersion in a real-world scenario, low learning efficiency, lack of effective guidance, inability to monitor learning progress in real time, slow actual training progress, and poor training results.

Description

Technical Field

[0001] This invention belongs to the field of factory training technology, specifically relating to a VR-based virtual training system and method for continuous casting steel pouring operations. Background Technology

[0002] Continuous casting is a crucial process in steel production, transforming molten steel from a liquid state into slabs. Due to the complexity of the continuous casting process, it heavily relies on the experience and skills of the operators to ensure production completion. During continuous casting (such as tundish start-up and online nozzle replacement), operators need to be present 24 / 7 to maintain continuous production. However, varying levels of experience and skill among operators often lead to fluctuations in production quality and even accidents. Furthermore, the harsh working environment of continuous casting presents a significant challenge to operators. The complex and inherently dangerous working conditions require operators to spend considerable time familiarizing themselves with the environment, equipment locations, functions, and operating procedures.

[0003] Currently, steel companies typically use text or video methods to train and improve the skills of continuous casting operators. Text-based methods mainly involve creating work instructions. Video methods primarily involve producing demonstration animations, constructing realistic-size models, and establishing virtual environments for continuous casting operations, allowing operators to quickly understand and learn the process by watching videos.

[0004] In practical applications, existing technologies for continuous casting operation training, primarily using text and video, fail to meet the training needs of operators. They lack an immersive, real-world scenario, resulting in low learning efficiency for operators. Because continuous casting involves significant fluctuations and equipment malfunctions are frequent, traditional training methods cannot realistically simulate equipment operation and personnel handling during unexpected failures, thus failing to effectively guide operators in correctly handling equipment malfunctions and accidents. Furthermore, on-site training for operators presents numerous challenges, including high costs and safety risks. Additionally, traditional training methods cannot monitor operators' learning progress in real time, leading to slow training progress and poor training effectiveness. Summary of the Invention

[0005] To address the problems of existing technologies, such as lack of immersion in real-world scenarios, low learning efficiency, lack of effective guidance, inability to monitor learning progress in real time, slow actual training progress, and poor training results, the present invention aims to provide a VR-based virtual training system and method for continuous casting steel pouring operations.

[0006] The technical solution adopted in this invention is as follows: A VR-based virtual training system for continuous casting steel pouring operation includes a VR device, a three-dimensional dynamic model construction unit, a basic data storage unit, a virtual training engine unit, and a continuous casting steel pouring operation training application unit. The VR device is connected to the continuous casting steel pouring operation training application unit, the virtual training engine unit is connected to the continuous casting steel pouring operation training application unit, and the basic data storage unit is connected to the three-dimensional dynamic model construction unit, the continuous casting steel pouring operation training application unit, and the virtual training engine unit, respectively. VR equipment is used to show users the continuous casting operation training application platform and the virtual training engine unit rendered by the continuous casting operation training application platform and the virtual training engine unit, as well as to collect user interaction data and show users the interaction results returned by the interaction data in virtual interaction with the continuous casting operation training application platform and the continuous casting operation training three-dimensional dynamic model. The continuous casting operation training application unit is used to provide a continuous casting operation training application platform to VR devices. Based on the user's interaction data with the continuous casting operation training application platform, it calls the virtual training engine unit to return the interaction results of the virtual interaction to the VR devices and records the interaction data and its results. The basic data storage unit is used to store site data and equipment data of the continuous casting steel pouring area, metadata of the three-dimensional dynamic model of continuous casting steel pouring, interactive data sent by VR equipment, interactive results returned by virtual interaction, and training videos corresponding to the continuous casting steel pouring operation training application. The three-dimensional dynamic model construction unit is used to call the site data and equipment data of the continuous casting steel pouring area stored in the basic data storage unit to construct the model, obtain the three-dimensional dynamic model of continuous casting steel pouring, and store the metadata of the three-dimensional dynamic model of continuous casting steel pouring to the basic data storage unit. The virtual training engine unit is used to call the metadata of the continuous casting steel 3D dynamic model for model rendering, display the obtained continuous casting steel 3D dynamic model to the VR device through the continuous casting steel operation training application platform, perform virtual interaction with the continuous casting steel 3D dynamic model based on the interaction data sent by the VR device, and return the interaction results of the virtual interaction to the VR device through the continuous casting steel operation training application platform.

[0007] Furthermore, the three-dimensional dynamic model of continuous casting includes a three-dimensional static model of the continuous casting area based on site data of the continuous casting area and a three-dimensional dynamic model of the continuous casting equipment based on equipment data of the continuous casting area. The three-dimensional dynamic model of the continuous casting equipment is added to the three-dimensional static model of the continuous casting area to obtain the three-dimensional dynamic model of continuous casting.

[0008] Furthermore, the site data for the continuous casting steel pouring area includes architectural drawings of the continuous casting steel pouring area, coordinates of several work area roaming points, and 3D scanning videos of the site collected based on the work area roaming points. The equipment data in the continuous casting steel pouring area includes equipment drawings, 3D scanning videos of the equipment, equipment information and operation guides, triggering components for operation actions, equipment operation data under various working conditions, and on-site equipment operation videos under various working conditions; Operating conditions include normal conditions, abnormal conditions, and malfunctions.

[0009] Furthermore, the continuous casting steel pouring operation training application platform includes a continuous casting steel pouring equipment operation module, a continuous casting steel pouring work area roaming module, a continuous casting steel pouring fault diagnosis operation module, a continuous casting steel pouring safety accident emergency response operation module, and a continuous casting steel pouring operation learning management module. The continuous casting equipment operation module is used to provide continuous casting equipment operation training functions, return continuous casting equipment operation training videos to VR devices, call the virtual training engine unit to render the three-dimensional dynamic model of the continuous casting equipment, and record the user's interaction data and interaction results with the three-dimensional dynamic model of the continuous casting equipment under this function. The continuous casting steel pouring work area roaming module is used to provide the continuous casting steel pouring work area roaming function, return the continuous casting steel pouring work area video to the VR device, call the virtual training engine unit to render the three-dimensional static model of the continuous casting steel pouring area, and record the user's interaction data and interaction results with the three-dimensional static model of the continuous casting steel pouring area under this function. The continuous casting steel pouring fault diagnosis and operation module is used to provide continuous casting steel pouring fault diagnosis and operation training functions, return continuous casting steel pouring fault diagnosis and training videos to VR devices, call the virtual training engine unit to render the three-dimensional dynamic model of the continuous casting steel pouring equipment, and record the user's interaction data and interaction results with the three-dimensional dynamic model of the continuous casting steel pouring equipment under this function. The continuous casting steel pouring safety accident emergency response operation module is used to provide training functions for emergency response operations in continuous casting steel pouring safety accidents. It returns training videos on emergency response operations in continuous casting steel pouring safety accidents to VR devices, calls the virtual training engine unit to render a three-dimensional dynamic model of the continuous casting steel pouring equipment, and records the interaction data and interaction results between the user and the three-dimensional dynamic model of the continuous casting steel pouring equipment under this function. The continuous casting steel pouring operation learning and management module is used to provide continuous casting steel pouring operation learning and management functions. It performs learning management based on the recorded interaction data and interaction results between the user and the three-dimensional dynamic model of the continuous casting steel pouring equipment under each function.

[0010] Furthermore, the VR device includes a VR headset, a wireless communication module, a VR interaction module, a VR eye-tracking mouse module, a spatial locator, and a force feedback controller. The VR headset is connected to the wireless communication module, the VR interaction module, the VR eye-tracking mouse module, the spatial locator, and the force feedback controller, respectively. The wireless communication module is connected to the continuous casting steel pouring operation training application unit. The VR headset is used to show users the continuous casting operation training application platform provided by the continuous casting operation training application unit, the three-dimensional dynamic model of continuous casting rendered by the virtual training engine unit, and the interaction results returned by the virtual interaction, and to receive the interaction data generated by the VR interaction module. The VR eye-tracking mouse module is used to provide a VR eye-tracking mouse to the VR headset, and the VR eye-tracking mouse collects data on the user's eye focus. Spatial locator, used to capture posture and position data of VR headset; Force feedback controller is used to collect the user's grip force data and vibrate based on the force feedback data returned from the interaction results; The VR interaction module is used to generate interaction data based on eye focus data, VR headset posture and position data, and grip strength data. The wireless communication module is used to send interactive data to the continuous casting steel pouring operation training application platform and receive the interactive results returned by the continuous casting steel pouring operation training application platform.

[0011] Furthermore, the 3D dynamic model building unit includes a 3D model building module, a 3D model correction module, a model adding module, and a data adding module. The 3D model building module is connected to the basic data storage unit, the 3D model correction module, the model adding module, and the data adding module, respectively. The 3D model building module is used to build a 3D static model of the continuous casting area based on the architectural drawings of the continuous casting area, and to build a 3D static model of the continuous casting equipment based on the equipment drawings and 3D scanning videos of the equipment. The data addition module is used to add the work area roaming point to the 3D static model of the continuous casting steel pouring area based on the coordinates of the work area roaming point, and to add equipment information, operation guide, triggering components for operation actions, and equipment operation data under various working conditions to the 3D static model of the continuous casting steel pouring equipment, so as to obtain the 3D dynamic model of the continuous casting steel pouring equipment. The 3D model correction module is used to correct the 3D static model of the continuous casting steel pouring area under different view coordinates based on the 3D scanning video of the site corresponding to the roaming point of the work area, and to correct the 3D dynamic model of the continuous casting steel pouring equipment based on the equipment operation video of the on-site equipment under various working conditions. The model adding module is used to add a three-dimensional dynamic model of the continuous casting equipment to the three-dimensional static model of the continuous casting area, thus obtaining a three-dimensional dynamic model of the continuous casting equipment.

[0012] A virtual training method for continuous casting steel pouring operations, based on a virtual training system for continuous casting steel pouring operations, includes the following steps: Initialize the virtual training system for continuous casting steel pouring operations; Construct a three-dimensional dynamic model of continuous casting steel and store the metadata of the three-dimensional dynamic model of continuous casting steel; Log in to the continuous casting steel pouring operation training application platform using VR equipment; The VR device is used to collect the interaction data between the user and the continuous casting steel pouring operation training application platform. Based on the interaction data, the continuous casting steel pouring operation training application is selected, the metadata of the continuous casting steel pouring 3D dynamic model is called for rendering, and the content of the continuous casting steel pouring operation training application and the continuous casting steel pouring 3D dynamic model are returned to the VR device as the interaction result. VR devices are used to collect interaction data between users and the three-dimensional dynamic model of continuous casting. Based on the interaction data, virtual training on continuous casting operation is conducted, and the interaction results of the virtual training on continuous casting operation are returned to the VR devices.

[0013] Furthermore, a three-dimensional dynamic model of continuous casting steel is constructed and its metadata is stored, including the following steps: Based on the architectural drawings of the continuous casting steel pouring area, construct a three-dimensional static model of the continuous casting steel pouring area; Based on the coordinates of the working area roaming points, add the working area roaming points in the 3D static model of the continuous casting steel pouring area; Based on the 3D scanning video of the site corresponding to the roaming point in the work area, the 3D static model of the continuous casting steel pouring area under different view coordinates is corrected. Based on the equipment drawings and 3D scanning video of the continuous casting steel pouring equipment, a 3D static model of the continuous casting steel pouring equipment is constructed. Add equipment information, operation guidelines, triggering components for operation actions, and equipment operation data under various working conditions to the three-dimensional static model of the continuous casting steel pouring equipment to obtain the three-dimensional dynamic model of the continuous casting steel pouring equipment. The three-dimensional dynamic model of the continuous casting steel pouring equipment was corrected based on the equipment operation videos under various working conditions on site. Add a three-dimensional dynamic model of the continuous casting equipment to the three-dimensional static model of the continuous casting area to obtain a three-dimensional dynamic model of the continuous casting. Store metadata of the three-dimensional dynamic model of continuous casting steel.

[0014] Furthermore, based on the 3D scanning video of the site corresponding to the roaming points in the work area, the 3D static model of the continuous casting steel pouring area under different viewpoint coordinates is corrected, including the following steps: The 3D scanning video of the site corresponding to the roaming point in the work area is framed to obtain a continuous frame of 3D scanning image; Based on the viewpoint coordinates of several arbitrary and discontinuous frames of 3D scan images, obtain the viewpoint coordinates of the roaming points in the working area. Based on historical VR headset posture and position data, the viewpoint coordinates of the VR device are obtained; Align the view coordinates of the roaming points in the work area according to the view coordinates of the VR device; The three-dimensional static model of the continuous casting area is corrected based on the view coordinates of the current roaming point in the working area. The system iterates through all the working area roaming points and corrects the 3D static model of the continuous casting steel pouring area under different viewpoint coordinates.

[0015] Furthermore, the continuous casting operation training application includes: the continuous casting equipment operation training function returns continuous casting equipment operation training videos to the VR device; the continuous casting work area roaming function returns continuous casting work area videos to the VR device; the continuous casting fault diagnosis operation training function returns continuous casting fault diagnosis training videos to the VR device; the continuous casting safety accident emergency response operation training function returns continuous casting safety accident emergency response operation training videos to the VR device; and the continuous casting operation learning management function performs learning management based on the recorded interaction data and interaction results between the user and the three-dimensional dynamic model of the continuous casting equipment under each function. The interactive results of the virtual training for continuous casting operation include: selecting a roaming point in the work area based on the interactive data, obtaining a 3D static model of the continuous casting area with corresponding viewpoint coordinates; selecting a 3D dynamic model of the continuous casting equipment based on the interactive data, obtaining the corresponding equipment information and operation guide; and selecting a triggering component of the continuous casting equipment based on the interactive data, obtaining the running actions, working conditions, and equipment operation data of the running actions under that working condition.

[0016] The beneficial effects of this invention are as follows: This invention provides a VR-based virtual training system and method for continuous casting steel pouring operations. It constructs a 3D dynamic model of continuous casting steel pouring using a 3D dynamic model building unit, and uses VR equipment for virtual reality interactive training, providing operators with a greater sense of immersion and ensuring higher learning efficiency. The continuous casting steel pouring operation training application unit provides a continuous casting steel pouring operation training application platform, capable of conducting simulated training on common typical equipment fault diagnosis and emergency response to safety accidents in practical situations such as high safety risks and difficulty in mastering certain operations. This provides effective guidance for operators. Through a comprehensive experience involving sight, hearing, and touch, operators can clearly remember key operational points, improving their technical capabilities in production operations and emergency response to safety accidents. Furthermore, based on recorded interactive data and its results, the system collects operator learning data, and by analyzing the data, it can understand the operator's learning progress, ensuring the actual training progress and improving training effectiveness.

[0017] Other beneficial effects of the present invention will be further explained in the specific embodiments. Attached Figure Description

[0018] Figure 1 This is a structural block diagram of the VR-based virtual training system for continuous casting steel pouring operations in this invention.

[0019] Figure 2 This is a flowchart of the VR-based virtual training method for continuous casting steel pouring operations in this invention. Detailed Implementation

[0020] The present invention will be further explained below with reference to the accompanying drawings and specific embodiments.

[0021] Example 1: like Figure 1 As shown, this embodiment provides a VR-based virtual training system for continuous casting steel pouring operations, including a VR device, a three-dimensional dynamic model construction unit, a basic data storage unit, a virtual training engine unit, and a continuous casting steel pouring operation training application unit. The VR device is connected to the continuous casting steel pouring operation training application unit, the virtual training engine unit is connected to the continuous casting steel pouring operation training application unit, and the basic data storage unit is connected to the three-dimensional dynamic model construction unit, the continuous casting steel pouring operation training application unit, and the virtual training engine unit, respectively. VR equipment is used to show users the continuous casting operation training application platform and the virtual training engine unit rendered by the continuous casting operation training application platform and the virtual training engine unit, as well as to collect user interaction data and show users the interaction results returned by the interaction data in virtual interaction with the continuous casting operation training application platform and the continuous casting operation training three-dimensional dynamic model. The continuous casting operation training application unit is used to provide a continuous casting operation training application platform to VR devices. Based on the user's interaction data with the continuous casting operation training application platform, it calls the virtual training engine unit to return the interaction results of the virtual interaction to the VR devices and records the interaction data and its results. The basic data storage unit is used to store site data and equipment data of the continuous casting steel pouring area, metadata of the three-dimensional dynamic model of continuous casting steel pouring, interactive data sent by VR equipment, interactive results returned by virtual interaction, and training videos corresponding to the continuous casting steel pouring operation training application. The three-dimensional dynamic model construction unit is used to call the site data and equipment data of the continuous casting steel pouring area stored in the basic data storage unit to construct the model, obtain the three-dimensional dynamic model of continuous casting steel pouring, and store the metadata of the three-dimensional dynamic model of continuous casting steel pouring to the basic data storage unit. The virtual training engine unit is used to call the metadata of the continuous casting steel 3D dynamic model for model rendering, display the obtained continuous casting steel 3D dynamic model to the VR device through the continuous casting steel operation training application platform, perform virtual interaction with the continuous casting steel 3D dynamic model based on the interaction data sent by the VR device, and return the interaction results of the virtual interaction to the VR device through the continuous casting steel operation training application platform.

[0022] The 3D dynamic model construction unit calls the site data and equipment data of the continuous casting area stored in the basic data storage unit to build a 3D dynamic model of the continuous casting area. The metadata of the 3D dynamic model is then stored in the basic data storage unit for easy model portability and rendering. The VR device communicates with the continuous casting operation training application unit, logs into the continuous casting operation training application platform, and collects interaction data between the user and the platform. The user selects a training application and the corresponding training video is returned to the VR device, enabling training. Furthermore, based on the user's selection, the continuous casting operation training application unit calls the virtual training engine unit to render the metadata of the 3D dynamic model and displays it to the user's VR device. The VR device collects interaction information between the user and the 3D dynamic model, enabling virtual interaction, including user interaction data and corresponding results. The continuous casting operation training application platform records and analyzes the interaction data and results, allowing for monitoring and management of the user's learning progress.

[0023] As a preferred embodiment, the three-dimensional dynamic model of continuous casting includes a three-dimensional static model of the continuous casting area based on site data of the continuous casting area and a three-dimensional dynamic model of the continuous casting equipment based on equipment data of the continuous casting area. The three-dimensional dynamic model of the continuous casting equipment is added to the three-dimensional static model of the continuous casting area to obtain the three-dimensional dynamic model of continuous casting.

[0024] Different continuous casting steel pouring operation training applications have different areas of focus for the 3D dynamic model of continuous casting steel pouring. Therefore, for different training applications, partially rendering the corresponding 3D static model of the continuous casting steel pouring area or the 3D dynamic model of the continuous casting steel pouring equipment can meet the requirements, thus improving the training effect and rendering efficiency.

[0025] As a preferred option, the site data for the continuous casting steel pouring area includes architectural drawings of the continuous casting steel pouring area, coordinates of several work area roaming points, and 3D scanning video of the site collected based on the work area roaming points. The equipment data in the continuous casting steel pouring area includes equipment drawings, 3D scanning videos of the equipment, equipment information and operation guides, triggering components for operation actions, equipment operation data under various working conditions, and on-site equipment operation videos under various working conditions; Operating conditions include normal conditions, abnormal conditions, and malfunctions.

[0026] As a preferred option, the continuous casting steel pouring operation training application platform includes a continuous casting steel pouring equipment operation module, a continuous casting steel pouring work area roaming module, a continuous casting steel pouring fault diagnosis operation module, a continuous casting steel pouring safety accident emergency response operation module, and a continuous casting steel pouring operation learning management module. The continuous casting equipment operation module provides operation training functions for continuous casting equipment. It returns operation training videos of the continuous casting equipment to VR devices, calls the virtual training engine unit to render a 3D dynamic model of the continuous casting equipment, and records the interaction data and results between the user and the 3D dynamic model of the continuous casting equipment under this function. The continuous casting equipment operation module enables operators to conduct standardized operation training of the corresponding equipment, and to learn about the structure and process principles of the unit equipment in a virtual scene, achieving seamless integration with actual work. The continuous casting steel pouring work area roaming module provides roaming functionality for the continuous casting steel pouring work area. It returns video of the continuous casting steel pouring work area to VR devices, calls the virtual training engine unit to render a 3D static model of the continuous casting steel pouring area, and records the user's interaction data and results with the 3D static model of the continuous casting steel pouring area. The continuous casting steel pouring work area roaming module can bring more immersion to operators and allow them to become familiar with their daily work area more safely. The continuous casting steel pouring fault diagnosis and operation module is used to provide continuous casting steel pouring fault diagnosis and operation training functions, return continuous casting steel pouring fault diagnosis and training videos to VR devices, call the virtual training engine unit to render the three-dimensional dynamic model of the continuous casting steel pouring equipment, and record the user's interaction data and interaction results with the three-dimensional dynamic model of the continuous casting steel pouring equipment under this function. The continuous casting steel pouring safety accident emergency response operation module is used to provide training functions for emergency response operations in continuous casting steel pouring safety accidents. It returns training videos on emergency response operations in continuous casting steel pouring safety accidents to VR devices, calls the virtual training engine unit to render a three-dimensional dynamic model of the continuous casting steel pouring equipment, and records the interaction data and interaction results between the user and the three-dimensional dynamic model of the continuous casting steel pouring equipment under this function. The continuous casting steel pouring fault diagnosis operation module and the continuous casting steel pouring safety accident emergency response operation module can conduct common typical equipment fault diagnosis and safety accident emergency response simulation training for situations where the continuous casting steel pouring operation has high safety risks and is difficult to operate in practice. This improves the technical capabilities of operators in production operation, equipment maintenance and safety accident emergency response. Inexperienced operators can learn the correct safety accident handling and prevention methods through repeated operation training in a virtual environment for unexpected and abnormal situations, and can quickly grow into skilled talents who meet the needs of actual positions. The continuous casting steel pouring operation learning management module provides continuous casting steel pouring operation learning management functions. It manages learning based on the recorded interaction data and results between users and the three-dimensional dynamic model of the continuous casting steel pouring equipment under various functions. The continuous casting steel pouring operation learning management module can collect data on operators' learning progress, set assessment benchmarks, and conduct virtual operation scoring, which can better supervise operators' learning and improve their skill level.

[0027] As a preferred embodiment, the VR device includes a VR headset, a wireless communication module, a VR interaction module, a VR eye-tracking mouse module, a spatial locator, and a force feedback controller. The VR headset is connected to the wireless communication module, the VR interaction module, the VR eye-tracking mouse module, the spatial locator, and the force feedback controller, respectively. The wireless communication module is connected to the continuous casting steel pouring operation training application unit. The VR headset is used to show users the continuous casting operation training application platform provided by the continuous casting operation training application unit, the three-dimensional dynamic model of continuous casting rendered by the virtual training engine unit, and the interaction results returned by the virtual interaction, and to receive the interaction data generated by the VR interaction module. The VR eye-tracking mouse module is used to provide a VR eye-tracking mouse to VR headsets. The VR eye-tracking mouse collects data on the user's eye focus points and provides a convenient means of virtual reality interaction, allowing interaction through the movement of the eye focus points. Spatial locators are used to capture the posture and position data of VR headsets, enabling the first-person view content within the VR headset to change with the user's posture and position, providing the user with a 360° free 3D visual experience. Force feedback controller is used to collect the user's grip force data and vibrate based on the force feedback data returned from the interaction results; it is used to provide multi-degree-of-freedom force tactile perception, operate the triggering components of the continuous casting steel pouring equipment based on the user's grip force data, support real-time synchronous operation of virtual scenes, and provide real-time feedback based on force feedback data to provide tactile sensation; The VR interaction module is used to generate interaction data based on eye focus data, VR headset posture and position data, and grip strength data. The wireless communication module is used to send interactive data to the continuous casting steel pouring operation training application platform and receive the interactive results returned by the continuous casting steel pouring operation training application platform.

[0028] The user wears a VR headset, and the spatial locator collects the user's posture and position data, improving the interactive effect of the virtual reality scene. The VR eye-tracking mouse module collects the user's eye focus data, facilitating the user's movement and object selection in the virtual reality scene. The force feedback controller collects the user's grip force data to determine the user's interaction confirmation with virtual scene entities. The VR interaction module converts the eye focus data, VR headset posture and position data, and grip force data into interaction data, which is then sent to the continuous casting steel pouring operation training application unit via the wireless communication module, ensuring a data transmission channel between the VR device and the continuous casting steel pouring operation training application unit.

[0029] Preferably, the three-dimensional dynamic model building unit includes a three-dimensional model building module, a three-dimensional model correction module, a model adding module, and a data adding module. The three-dimensional model building module is connected to the basic data storage unit, the three-dimensional model correction module, the model adding module, and the data adding module, respectively. The 3D model building module is used to build a 3D static model of the continuous casting area based on the architectural drawings of the continuous casting area, and to build a 3D static model of the continuous casting equipment based on the equipment drawings and 3D scanning videos of the equipment. The data addition module is used to add the work area roaming point to the 3D static model of the continuous casting steel pouring area based on the coordinates of the work area roaming point, and to add equipment information, operation guide, triggering components for operation actions, and equipment operation data under various working conditions to the 3D static model of the continuous casting steel pouring equipment, so as to obtain the 3D dynamic model of the continuous casting steel pouring equipment. The 3D model correction module is used to correct the 3D static model of the continuous casting steel pouring area under different view coordinates based on the 3D scanning video of the site corresponding to the roaming point of the work area, and to correct the 3D dynamic model of the continuous casting steel pouring equipment based on the equipment operation video of the on-site equipment under various working conditions. The model adding module is used to add a three-dimensional dynamic model of the continuous casting equipment to the three-dimensional static model of the continuous casting area, thus obtaining a three-dimensional dynamic model of the continuous casting equipment.

[0030] Example 2: like Figure 2 As shown, this embodiment provides a virtual training method for continuous casting steel pouring operations, based on a virtual training system for continuous casting steel pouring operations, including the following steps: Initialize the virtual training system for continuous casting operation; including testing the normal operation of all functions of the VR device, testing the data transmission channel between the VR device and the continuous casting operation training application unit, ensuring that the VR device can log in to the continuous casting operation training application platform, and clearing the continuous casting 3D dynamic model, historical interactive data and its interactive results. Constructing a three-dimensional dynamic model of continuous casting steel and storing its metadata includes the following steps: Based on the architectural drawings of the continuous casting steel pouring area, construct a three-dimensional static model of the continuous casting steel pouring area; Based on the coordinates of the working area roaming points, add the working area roaming points in the 3D static model of the continuous casting steel pouring area; Based on the 3D scanning video of the site corresponding to the roaming points in the work area, the 3D static model of the continuous casting steel pouring area under different view coordinates is corrected, including the following steps: The 3D scanning video of the site corresponding to the roaming point in the work area is framed to obtain a continuous frame of 3D scanning image; Based on the viewpoint coordinates of several arbitrary and discontinuous frames of 3D scan images, obtain the viewpoint coordinates of the roaming points in the working area. Based on historical VR headset posture and position data, the viewpoint coordinates of the VR device are obtained; Align the view coordinates of the roaming points in the work area according to the view coordinates of the VR device; The three-dimensional static model of the continuous casting area is corrected based on the view coordinates of the current roaming point in the working area. Traverse all working area roaming points and correct the three-dimensional static model of the continuous casting steel pouring area under different view coordinates; Based on the equipment drawings and 3D scanning video of the continuous casting steel pouring equipment, a 3D static model of the continuous casting steel pouring equipment is constructed. Add equipment information, operation guidelines, triggering components for operation actions, and equipment operation data under various working conditions to the three-dimensional static model of the continuous casting steel pouring equipment to obtain the three-dimensional dynamic model of the continuous casting steel pouring equipment. The three-dimensional dynamic model of the continuous casting steel pouring equipment was corrected based on the equipment operation videos under various working conditions on site. Add a three-dimensional dynamic model of the continuous casting equipment to the three-dimensional static model of the continuous casting area to obtain a three-dimensional dynamic model of the continuous casting. Store metadata of the three-dimensional dynamic model of continuous casting steel pouring; Log in to the continuous casting steel pouring operation training application platform using VR equipment; The VR device is used to collect the interaction data between the user and the continuous casting steel pouring operation training application platform. Based on the interaction data, the continuous casting steel pouring operation training application is selected, the metadata of the continuous casting steel pouring 3D dynamic model is called for rendering, and the content of the continuous casting steel pouring operation training application and the continuous casting steel pouring 3D dynamic model are returned to the VR device as the interaction result. The continuous casting steel pouring operation training application includes: continuous casting steel pouring equipment operation training function, which returns continuous casting steel pouring equipment operation training videos to VR devices; continuous casting steel pouring work area roaming function, which returns continuous casting steel pouring work area videos to VR devices; continuous casting steel pouring fault diagnosis operation training function, which returns continuous casting steel pouring fault diagnosis training videos to VR devices; continuous casting steel pouring safety accident emergency response operation training function, which returns continuous casting steel pouring safety accident emergency response operation training videos to VR devices; and continuous casting steel pouring operation learning management function, which manages learning based on the recorded interaction data and interaction results between users and the three-dimensional dynamic model of continuous casting steel pouring equipment under each function. The VR device is used to collect the interaction data between the user and the three-dimensional dynamic model of continuous casting steel pouring. Based on the interaction data, virtual training on continuous casting steel pouring operation is carried out, and the interaction results of the virtual training on continuous casting steel pouring operation are returned to the VR device. The interactive results of the virtual training for continuous casting operation include: selecting a roaming point in the work area based on the interactive data, obtaining a 3D static model of the continuous casting area with corresponding viewpoint coordinates; selecting a 3D dynamic model of the continuous casting equipment based on the interactive data, obtaining the corresponding equipment information and operation guide; and selecting a triggering component of the continuous casting equipment based on the interactive data, obtaining the running actions, working conditions, and equipment operation data of the running actions under that working condition.

[0031] This invention provides a VR-based virtual training system and method for continuous casting steel pouring operations. It constructs a 3D dynamic model of continuous casting steel pouring using a 3D dynamic model building unit, and uses VR equipment for virtual reality interactive training, providing operators with a greater sense of immersion and ensuring higher learning efficiency. The continuous casting steel pouring operation training application unit provides a continuous casting steel pouring operation training application platform, capable of conducting simulated training on common typical equipment fault diagnosis and emergency response to safety accidents in practical situations such as high safety risks and difficulty in mastering certain operations. This provides effective guidance for operators. Through a comprehensive experience involving sight, hearing, and touch, operators can clearly remember key operational points, improving their technical capabilities in production operations and emergency response to safety accidents. Furthermore, based on recorded interactive data and its results, the system collects operator learning data, and by analyzing the data, it can understand the operator's learning progress, ensuring the actual training progress and improving training effectiveness.

[0032] This invention is not limited to the optional embodiments described above, and anyone can derive other various forms of products based on the inspiration of this invention. The specific embodiments described above should not be construed as limiting the scope of protection of this invention; the scope of protection of this invention should be determined by the claims, and the specification can be used to interpret the claims.

Claims

1. A VR-based virtual training system for continuous casting steel pouring operations, characterized in that: It includes a VR device, a 3D dynamic model building unit, a basic data storage unit, a virtual training engine unit, and a continuous casting steel pouring operation training application unit. The VR device is connected to the continuous casting steel pouring operation training application unit, the virtual training engine unit is connected to the continuous casting steel pouring operation training application unit, and the basic data storage unit is connected to the 3D dynamic model building unit, the continuous casting steel pouring operation training application unit, and the virtual training engine unit, respectively. VR equipment is used to show users the continuous casting operation training application platform and the virtual training engine unit rendered by the continuous casting operation training application platform and the virtual training engine unit, as well as to collect user interaction data and show users the interaction results returned by the interaction data in virtual interaction with the continuous casting operation training application platform and the continuous casting operation training three-dimensional dynamic model. The VR device includes a VR headset, a wireless communication module, a VR interaction module, a VR eye-tracking mouse module, a spatial locator, and a force feedback controller. The VR headset is connected to the wireless communication module, the VR interaction module, the VR eye-tracking mouse module, the spatial locator, and the force feedback controller. The wireless communication module is connected to the continuous casting steel pouring operation training application unit. The VR headset is used to show users the continuous casting operation training application platform provided by the continuous casting operation training application unit, the three-dimensional dynamic model of continuous casting rendered by the virtual training engine unit, and the interaction results returned by the virtual interaction, and to receive the interaction data generated by the VR interaction module. The VR eye-tracking mouse module is used to provide a VR eye-tracking mouse to the VR headset, and the VR eye-tracking mouse collects data on the user's eye focus. Spatial locator, used to capture posture and position data of VR headset; Force feedback controller is used to collect the user's grip force data and vibrate based on the force feedback data returned from the interaction results; The VR interaction module is used to generate interaction data based on eye focus data, VR headset posture and position data, and grip strength data. The wireless communication module is used to send interactive data to the continuous casting steel pouring operation training application platform and receive the interactive results returned by the continuous casting steel pouring operation training application platform. The three-dimensional dynamic model of continuous casting steel pouring includes a three-dimensional static model of the continuous casting steel pouring area based on the site data of the continuous casting steel pouring area and a three-dimensional dynamic model of the continuous casting steel pouring equipment based on the equipment data of the continuous casting steel pouring area. The three-dimensional dynamic model of the continuous casting steel pouring equipment is added to the three-dimensional static model of the continuous casting steel pouring area to obtain the three-dimensional dynamic model of continuous casting steel pouring. The site data for the continuous casting steel pouring area includes architectural drawings of the continuous casting steel pouring area, coordinates of several work area roaming points, and 3D scanning video of the site collected based on the work area roaming points. The equipment data in the continuous casting steel pouring area includes equipment drawings, 3D scanning videos of the equipment, equipment information and operation guides, triggering components for operation actions, equipment operation data under various working conditions, and equipment operation videos of the on-site equipment under various working conditions; Operating conditions include normal conditions, abnormal conditions, and malfunction conditions; The continuous casting operation training application unit is used to provide a continuous casting operation training application platform to VR devices. Based on the user's interaction data with the continuous casting operation training application platform, it calls the virtual training engine unit to return the interaction results of the virtual interaction to the VR devices and records the interaction data and its results. The continuous casting steel pouring operation training application platform includes a continuous casting steel pouring equipment operation module, a continuous casting steel pouring work area roaming module, a continuous casting steel pouring fault diagnosis operation module, a continuous casting steel pouring safety accident emergency response operation module, and a continuous casting steel pouring operation learning management module. The continuous casting equipment operation module is used to provide continuous casting equipment operation training functions, return continuous casting equipment operation training videos to VR devices, call the virtual training engine unit to render the three-dimensional dynamic model of the continuous casting equipment, and record the user's interaction data and interaction results with the three-dimensional dynamic model of the continuous casting equipment under this function. The continuous casting steel pouring work area roaming module is used to provide the continuous casting steel pouring work area roaming function, return the continuous casting steel pouring work area video to the VR device, call the virtual training engine unit to render the three-dimensional static model of the continuous casting steel pouring area, and record the user's interaction data and interaction results with the three-dimensional static model of the continuous casting steel pouring area under this function. The continuous casting steel pouring fault diagnosis and operation module is used to provide continuous casting steel pouring fault diagnosis and operation training functions, return continuous casting steel pouring fault diagnosis and training videos to VR devices, call the virtual training engine unit to render the three-dimensional dynamic model of the continuous casting steel pouring equipment, and record the user's interaction data and interaction results with the three-dimensional dynamic model of the continuous casting steel pouring equipment under this function. The continuous casting steel pouring safety accident emergency response operation module is used to provide training functions for emergency response operations in continuous casting steel pouring safety accidents. It returns training videos on emergency response operations in continuous casting steel pouring safety accidents to VR devices, calls the virtual training engine unit to render a three-dimensional dynamic model of the continuous casting steel pouring equipment, and records the interaction data and interaction results between the user and the three-dimensional dynamic model of the continuous casting steel pouring equipment under this function. The continuous casting steel pouring operation learning and management module is used to provide continuous casting steel pouring operation learning and management functions. It performs learning management based on the recorded interaction data and interaction results between the user and the three-dimensional dynamic model of the continuous casting steel pouring equipment under each function. The basic data storage unit is used to store site data and equipment data of the continuous casting steel pouring area, metadata of the three-dimensional dynamic model of continuous casting steel pouring, interactive data sent by VR equipment, interactive results returned by virtual interaction, and training videos corresponding to the continuous casting steel pouring operation training application. The three-dimensional dynamic model construction unit is used to call the site data and equipment data of the continuous casting steel pouring area stored in the basic data storage unit to construct the model, obtain the three-dimensional dynamic model of continuous casting steel pouring, and store the metadata of the three-dimensional dynamic model of continuous casting steel pouring to the basic data storage unit. The three-dimensional dynamic model building unit includes a three-dimensional model building module, a three-dimensional model correction module, a model adding module, and a data adding module. The three-dimensional model building module is connected to the basic data storage unit, the three-dimensional model correction module, the model adding module, and the data adding module, respectively. The 3D model building module is used to build a 3D static model of the continuous casting area based on the architectural drawings of the continuous casting area, and to build a 3D static model of the continuous casting equipment based on the equipment drawings and 3D scanning videos of the equipment. The data addition module is used to add the work area roaming point to the 3D static model of the continuous casting steel pouring area based on the coordinates of the work area roaming point, and to add equipment information, operation guide, triggering components for operation actions, and equipment operation data under various working conditions to the 3D static model of the continuous casting steel pouring equipment, so as to obtain the 3D dynamic model of the continuous casting steel pouring equipment. The 3D model correction module is used to correct the 3D static model of the continuous casting steel pouring area under different view coordinates based on the 3D scanning video of the site corresponding to the roaming point of the work area, and to correct the 3D dynamic model of the continuous casting steel pouring equipment based on the equipment operation video of the on-site equipment under various working conditions. The model adding module is used to add a three-dimensional dynamic model of the continuous casting equipment to the three-dimensional static model of the continuous casting area, so as to obtain a three-dimensional dynamic model of the continuous casting area. The virtual training engine unit is used to call the metadata of the continuous casting steel 3D dynamic model for model rendering, display the obtained continuous casting steel 3D dynamic model to the VR device through the continuous casting steel operation training application platform, perform virtual interaction with the continuous casting steel 3D dynamic model based on the interaction data sent by the VR device, and return the interaction results of the virtual interaction to the VR device through the continuous casting steel operation training application platform.

2. A virtual training method for continuous casting steel pouring operations, based on the virtual training system for continuous casting steel pouring operations as described in claim 1, characterized in that: Includes the following steps: Initialize the virtual training system for continuous casting steel pouring operations; Constructing a three-dimensional dynamic model of continuous casting steel and storing its metadata includes the following steps: Based on the architectural drawings of the continuous casting steel pouring area, construct a three-dimensional static model of the continuous casting steel pouring area; Based on the coordinates of the working area roaming points, add the working area roaming points in the 3D static model of the continuous casting steel pouring area; Based on the 3D scanning video of the site corresponding to the roaming points in the work area, the 3D static model of the continuous casting steel pouring area under different view coordinates is corrected, including the following steps: The 3D scanning video of the site corresponding to the roaming point in the work area is framed to obtain a continuous frame of 3D scanning image; Based on the viewpoint coordinates of several arbitrary and discontinuous frames of 3D scan images, obtain the viewpoint coordinates of the roaming points in the working area. Based on historical VR headset posture and position data, the viewpoint coordinates of the VR device are obtained; Align the view coordinates of the roaming points in the work area according to the view coordinates of the VR device; The three-dimensional static model of the continuous casting area is corrected based on the view coordinates of the current roaming point in the working area. Traverse all working area roaming points and correct the three-dimensional static model of the continuous casting steel pouring area under different view coordinates; Based on the equipment drawings and 3D scanning video of the continuous casting steel pouring equipment, a 3D static model of the continuous casting steel pouring equipment is constructed. Add equipment information, operation guidelines, triggering components for operation actions, and equipment operation data under various working conditions to the three-dimensional static model of the continuous casting steel pouring equipment to obtain the three-dimensional dynamic model of the continuous casting steel pouring equipment. The three-dimensional dynamic model of the continuous casting steel pouring equipment was corrected based on the equipment operation videos under various working conditions on site. Add a three-dimensional dynamic model of the continuous casting equipment to the three-dimensional static model of the continuous casting area to obtain a three-dimensional dynamic model of the continuous casting. Store metadata of the three-dimensional dynamic model of continuous casting steel pouring; Log in to the continuous casting steel pouring operation training application platform using VR equipment; The VR device is used to collect the interaction data between the user and the continuous casting steel pouring operation training application platform. Based on the interaction data, the continuous casting steel pouring operation training application is selected, the metadata of the continuous casting steel pouring 3D dynamic model is called for rendering, and the content of the continuous casting steel pouring operation training application and the continuous casting steel pouring 3D dynamic model are returned to the VR device as the interaction result. The continuous casting steel pouring operation training application includes: a continuous casting steel pouring equipment operation training function that returns continuous casting steel pouring equipment operation training videos to VR devices; a continuous casting steel pouring work area roaming function that returns continuous casting steel pouring work area videos to VR devices; a continuous casting steel pouring fault diagnosis operation training function that returns continuous casting steel pouring fault diagnosis training videos to VR devices; a continuous casting steel pouring safety accident emergency response operation training function that returns continuous casting steel pouring safety accident emergency response operation training videos to VR devices; and a continuous casting steel pouring operation learning management function that performs learning management based on the recorded interaction data and interaction results between users and the three-dimensional dynamic model of the continuous casting steel pouring equipment under each function. The interactive results of the virtual training for continuous casting operation include: selecting a roaming point in the work area based on the interactive data, obtaining a three-dimensional static model of the continuous casting area with corresponding view coordinates; selecting a three-dimensional dynamic model of the continuous casting equipment based on the interactive data, obtaining the corresponding equipment information and operation guide; and selecting a triggering component of the continuous casting equipment based on the interactive data, obtaining the running actions, working conditions, and equipment operation data of the running actions under the working conditions. VR devices are used to collect interaction data between users and the three-dimensional dynamic model of continuous casting. Based on the interaction data, virtual training on continuous casting operation is conducted, and the interaction results of the virtual training on continuous casting operation are returned to the VR devices.

Images