A virtual simulation training system and method for the tobacco industry
The virtual simulation training system has solved the problems of insufficient coverage and effectiveness of safety training in the tobacco industry, achieving efficient training with full coverage and multi-person collaboration, and improving training effectiveness and assessment accuracy.
Patent Information
- Application Number
- CN202610507024.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-04-16
- Publication Date
- 2026-08-25
AI Technical Summary
Existing safety training in the tobacco industry suffers from limited coverage, difficulty in simulating real hazardous work environments, and difficulty in quantifying and evaluating training effectiveness.
This paper presents a virtual simulation training system for the tobacco industry, which includes a 3D scene construction module, a multimodal interaction module, a work behavior recognition module, a real-time feedback module, and an evaluation report module. It is controlled through a cloud-based teaching management platform to achieve full coverage training of the tobacco industry's production process.
It achieves full coverage training of the tobacco industry's production process, improves training effectiveness, supports multi-person collaborative and mutually influential scenario training, and has a high degree of immersion and intelligent evaluation capabilities.
Smart Images
Figure CN122633017A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of safety training technology in the tobacco industry, specifically a virtual simulation training system and method for the tobacco industry. Background Technology
[0002] With the accelerated pace of high-quality development in the tobacco industry, safety training faces an urgent need to transform from traditional models to digital and intelligent approaches. Currently, the industry's safety training system has significant shortcomings in terms of effectiveness, coverage, and resource utilization. These shortcomings are mainly reflected in the following aspects.
[0003] First, traditional safety training is mainly conducted on the production line, which requires the entire production line to be shut down for training, affecting production efficiency. Furthermore, due to the limited space, equipment, and single scenario, it is difficult to simulate real dangerous working environments, resulting in insufficient practical skills among trainees and making it difficult to quantify and evaluate the training effect.
[0004] Secondly, the tobacco industry involves numerous processes and equipment, and traditional safety training methods are insufficient to cover multi-dimensional risks, so employees' ability to identify potential hazards and respond to emergencies needs to be improved.
[0005] In summary, existing safety training technologies for the tobacco industry's production processes suffer from limited coverage. Summary of the Invention
[0006] To address the shortcomings of existing technologies, this invention provides a virtual simulation training system and method for the tobacco industry. It can fully cover all aspects of the tobacco industry's production process, provide comprehensive and extensive training for trainees, and conduct training in scenarios involving multiple people collaborating and influencing each other, resulting in better training outcomes.
[0007] To achieve the above objectives, the specific solution adopted by the present invention is as follows:
[0008] A virtual simulation training system for the tobacco industry includes:
[0009] A 3D scene construction module is used to generate a virtual simulation environment based on a tobacco industry production scene. The virtual simulation environment includes at least one workstation, at least one production device, and a work process for associating the workstation and the production device.
[0010] A multimodal interaction module is provided for trainees to interact with the virtual simulation environment through voice, gestures, and / or actions.
[0011] The operation behavior recognition module is used to acquire operation behavior during the interaction between the trainee and the virtual simulation environment, and to determine whether the operation behavior complies with the preset safety specifications.
[0012] The real-time feedback module is used to generate warning information and warning feedback when the operation does not comply with the safety specifications;
[0013] The evaluation report module is used to generate personalized evaluation reports for trainees based on the operational behavior and the warning feedback.
[0014] The cloud-based teaching management platform is used to control the 3D scene construction module, the multimodal interaction module, and the evaluation report module.
[0015] Preferably, the three-dimensional scene construction module includes a tobacco industry knowledge base unit and multiple scene construction units. The scene construction units are used to acquire industry knowledge from the tobacco industry knowledge base and generate the virtual simulation environment based on the industry knowledge.
[0016] Preferably, the scene construction unit includes an AR device, and the multimodal interaction module includes multiple interaction units connected to the AR device.
[0017] Preferably, the work behavior recognition module includes multiple data acquisition units, which are used to collect the operational behaviors of trainees, including voice operation behaviors, gesture operation behaviors, and action operation behaviors.
[0018] Preferably, the operation behavior recognition module includes a safety judgment unit, which is used to determine whether the operation behavior conforms to the preset safety specifications. The real-time feedback unit includes a warning unit, which is used to generate warning information and warning feedback when the safety judgment unit determines that the operation behavior does not conform to the safety specifications. The warning information is transmitted to the trainees.
[0019] Preferably, the cloud-based teaching management platform includes a start / stop control unit, a scene control unit, and an interaction control unit. The start / stop control unit is used to generate end information and start information corresponding to the trainees based on the personalized evaluation report uploaded by the evaluation report module. The start information is used to activate the scene control unit and the interaction control unit. After the scene control unit and the interaction control unit are activated, they correspondingly control the 3D scene construction module and the multimodal interaction module to match with the new trainees and start the training.
[0020] A virtual simulation training method for the tobacco industry, based on the aforementioned virtual simulation training system for the tobacco industry, includes the following steps:
[0021] Training projects are generated based on the identities of the trainees;
[0022] The virtual simulation environment is generated using the 3D scene construction module based on the training project.
[0023] The multimodal interaction module allows trainees to interact with the virtual simulation scenario.
[0024] The operation behavior recognition module is used to acquire the operation behavior during the interaction between the trainee and the virtual simulation scene, and to determine whether the operation behavior complies with the safety specifications.
[0025] The real-time feedback module generates warning messages and warning feedback when the operation does not comply with the safety specifications;
[0026] The evaluation report module generates a personalized evaluation report for each trainee based on the operational behavior and the warning feedback.
[0027] After a trainee completes their training, the cloud-based teaching management platform is used to control the 3D scene construction module, the multimodal interaction module, and the evaluation report module.
[0028] Preferably, when using the multimodal interaction module to allow trainees to interact with the virtual simulation scene, trainees can interact through voice, gestures, and / or actions.
[0029] Preferably, the virtual simulation environment includes at least one operable object, and the operable object can be included in multiple virtual simulation environments simultaneously.
[0030] Preferably, after receiving the personalized evaluation report sent by the evaluation report module, the cloud-based teaching management platform terminates the current trainee's training process and initializes the 3D scene construction module and the multimodal interaction module.
[0031] This invention can fully cover all aspects of the tobacco industry's production process, providing comprehensive and extensive training for trainees. It can also train trainees in scenarios involving multiple people collaborating and influencing each other, resulting in better training outcomes. Attached Figure Description
[0032] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0033] Figure 1 This is a structural block diagram of the system of the present invention;
[0034] Figure 2 This is a flowchart of the method of the present invention. Detailed Implementation
[0035] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0036] like Figure 1 As shown, the present invention first provides a virtual simulation training system for the tobacco industry, the specific structure of which is as follows.
[0037] The 3D scene construction module is used to generate a virtual simulation environment based on tobacco industry production scenarios. The virtual simulation environment includes at least one workstation, at least one production piece of equipment, and a workflow for linking the workstation and the production equipment. More specifically, the 3D scene construction module includes a tobacco industry knowledge base unit and multiple scene construction units. The scene construction units are used to acquire industry knowledge from the tobacco industry knowledge base and generate the virtual simulation environment based on that knowledge.
[0038] The multimodal interaction module allows trainees to interact with the virtual simulation environment through voice, gestures, and / or actions. More specifically, the scene building unit includes an AR device, and the multimodal interaction module includes multiple interaction units connected to the AR device.
[0039] The work behavior recognition module is used to acquire operational behaviors during the interaction between trainees and the virtual simulation environment, and to determine whether the operational behaviors comply with preset safety specifications. More specifically, the work behavior recognition module includes multiple data acquisition units, which are used to collect the operational behaviors of trainees, including voice operations, gesture operations, and action operations.
[0040] The real-time feedback module generates warning messages and feedback when operational behaviors do not comply with safety regulations. Based on this, the work behavior recognition module includes a safety judgment unit to determine whether operational behaviors comply with preset safety regulations. The real-time feedback unit includes a warning unit to generate warning messages and feedback when the safety judgment unit determines that operational behaviors do not comply with safety regulations. The warning messages are then transmitted to the trainees.
[0041] The assessment report module is used to generate personalized assessment reports for trainees based on operational behavior and warning feedback.
[0042] The cloud-based teaching management platform controls the 3D scene construction module, multimodal interaction module, and evaluation report module. More specifically, the platform includes a start / stop control unit, a scene control unit, and an interaction control unit. The start / stop control unit generates end and start information corresponding to the trainees based on the personalized evaluation reports uploaded by the evaluation report module. The start information activates the scene control unit and the interaction control unit. Once activated, the scene control unit and the interaction control unit control the corresponding 3D scene construction module and the multimodal interaction module to match the new trainee and begin the training.
[0043] The present invention further provides a virtual simulation training method for the tobacco industry, based on the above-mentioned virtual simulation training system for the tobacco industry, the method comprising S1 to S7.
[0044] S1. Generate training projects based on the trainees' identities. The tobacco industry production process involves multiple stages, and different trainees participate in different stages. Different stages require different equipment, and consequently, the potential safety risks also differ. Therefore, it is necessary to set up different virtual simulation environments for different stages to make the safety training process more targeted and effectively improve its effectiveness.
[0045] S2. Based on the training project, a virtual simulation environment is generated using a 3D scene construction module. Each virtual simulation environment includes at least one operable object, and operable objects can be included in multiple virtual simulation environments simultaneously.
[0046] In one embodiment of the present invention, the virtual simulation environment includes a cigarette storage scenario, a cigarette sorting scenario, and a cigarette delivery scenario.
[0047] The cigarette warehousing scenario mainly corresponds to the cigarette warehousing process. In the actual tobacco industry's production and sales process, a region not only sells locally produced cigarettes but also cigarettes produced in other regions. To complete tobacco production more efficiently, cigarette warehouses need to be established to store cigarettes transported from various places. During the warehousing process, in order to ensure the quality of the cigarettes, it is necessary to precisely control environmental parameters such as temperature and humidity in the warehouse. Accordingly, temperature control equipment and humidity control equipment are required. In the cigarette warehousing scenario, there may be specific safety risks, including abnormal temperature.
[0048] The cigarette sorting scenario primarily corresponds to the cigarette sorting process. In actual cigarette sales, different stores receive varying quantities and varieties of cigarettes based on their brand and grade. Before centralized distribution, all cigarettes corresponding to each store need to be sorted and packaged to ensure fast and accurate delivery. The equipment used in cigarette sorting mainly includes cigarette storage bins, conveyor systems, sorting equipment, and packaging equipment. Cigarette storage bins temporarily store cigarettes retrieved from the warehouse, conveyor systems transport cigarettes, sorting equipment distributes cigarettes to different locations, and packaging equipment groups multiple cigarettes distributed to the same location. The main specific safety risks in cigarette sorting scenarios are equipment malfunctions.
[0049] The cigarette delivery scenario mainly corresponds to the cigarette delivery process. In the cigarette delivery process, the delivery route needs to be planned in advance according to the location distribution of stores. Then, the packaged cigarettes are loaded into the transport vehicle based on the delivery route so that the packaged cigarettes corresponding to the nearby stores are closer to the transport vehicle door, making it easier to retrieve the packaged cigarettes. The specific safety risks that may exist in the cigarette delivery scenario include abnormal loading order.
[0050] It should be noted that the equipment involved in the three virtual simulation environments mentioned above are all conventional equipment produced in the tobacco industry, and their structure and principles will not be elaborated upon here. Furthermore, in addition to the specific safety risks, there are also common safety risks in the three scenarios, such as fire risks.
[0051] Furthermore, the scope of scenarios in various stages of tobacco production is often vast. For example, in the cigarette sorting process, the cigarette storage area, conveying equipment, sorting equipment, and packaging equipment all occupy a significant amount of space. To enable users to conduct safety training in a smaller space and improve the efficiency of safety training, a virtual simulation environment comprises multiple virtual simulation environments interconnected through connectivity. When a virtual simulation environment is invoked, one virtual simulation environment is used; when updating a virtual simulation environment, a new one is invoked based on the connectivity. For instance, in the cigarette sorting process, the first virtual simulation environment primarily displays the cigarette storage area, the second primarily displays the conveying and sorting equipment, and the third primarily displays the packaging equipment. By decomposing the virtual simulation environment into multiple virtual simulation environments, users can conduct different safety training sessions by switching between virtual simulation environments without moving their own location, resulting in higher efficiency and saving space by eliminating the need for large activity spaces.
[0052] Among various safety risks, emergency operation of equipment is a crucial means of ensuring the safety of personnel and property. For example, in a cigarette sorting scenario, when the conveyor equipment malfunctions and jams, quickly cutting off the power to the conveyor equipment is essential to prevent large-scale damage to cigarettes. To allow users to fully train in emergency operation of various equipment in a virtual simulation environment, each virtual simulation environment includes at least one operable object, and this operable object can be included in multiple virtual simulation environments simultaneously. During the demonstration of the virtual simulation environment to the user, operational feedback data is generated based on the state changes of the operable object. By setting operable objects in the virtual simulation environment, the system can determine whether the user has performed the correct emergency operation based on their actions on the operable object, thus enabling accurate user evaluation. Considering that some equipment spans a large area, such as the conveyor equipment in a cigarette sorting scenario needing to connect to the cigarette bins and packaging equipment, operable objects are allowed to span multiple virtual simulation environments.
[0053] More specifically, the method for generating operation feedback data based on the state changes of operable objects includes: continuously monitoring the state of operable objects within a preset time threshold; when a user operates on an operable object, recording the operation time, the state of the operable object after the operation, and the user's identity information to generate an operation record; and integrating all operation records of each user to generate operation feedback data.
[0054] Safety risks caused by equipment malfunctions can be addressed through emergency equipment procedures. However, common safety risks such as fire hazards require more consideration of personnel evacuation. Therefore, the virtual simulation environment includes at least one emergency route, which connects at least two virtual simulation environments. During the demonstration of the virtual simulation environment to users, the activation of the emergency route is determined based on the training program. If activated, the user's training location is recorded in real time, and a corresponding actual route is generated based on that location, integrated into the operational feedback data. When the training program includes training on common safety risks such as fire hazards, the emergency route can be activated, and the user's location can be used to determine whether they have evacuated according to the emergency route, thus training on personnel evacuation procedures under large-scale safety risks.
[0055] S3. Utilize a multimodal interaction module to allow trainees to interact with the virtual simulation scene. When using the multimodal interaction module to allow trainees to interact with the virtual simulation scene, trainees can interact through voice, gestures, and / or actions.
[0056] S4. Use the operation behavior recognition module to obtain the operation behavior during the interaction between the trainee and the virtual simulation scene, and determine whether the operation behavior complies with the safety specifications.
[0057] S5. Use the real-time feedback module to generate warning messages and warning feedback when the operation does not comply with safety regulations.
[0058] S6. Use the assessment report module to generate personalized assessment reports for trainees based on operational behavior and warning feedback.
[0059] S7. After a trainee completes their training, the cloud-based teaching management platform controls the 3D scene construction module, multimodal interaction module, and evaluation report module. Upon receiving the personalized evaluation report from the evaluation report module, the cloud-based teaching management platform terminates the current trainee's training process and initializes the 3D scene construction module and multimodal interaction module.
[0060] In practice, due to the need for multi-person collaboration, if someone performs the correct emergency procedure when a safety risk arises, others can skip that procedure. For example, in the cigarette sorting process, if the conveyor equipment malfunctions and jams, it's necessary to disconnect the power to both the conveyor equipment and the cigarette bin. If two users are undergoing safety training and each user disconnects the power to the nearest operable object in the conveyor equipment and cigarette bin, then both emergency procedures are successfully completed through their cooperation, without requiring each user to perform both procedures independently. Accordingly, to reflect this mutual influence, this invention establishes operation-related data. Again, taking the need to disconnect the power to the conveyor equipment and cigarette bin as an example, when two users are undergoing safety training simultaneously, once one user completes the power disconnection operation, a completion marker for the power disconnection operation is added to the other user's operation feedback data.
[0061] Furthermore, in some processes, the actual actions of personnel may affect each other's safety. For example, in the cigarette delivery process, if someone is loading packaged cigarettes into a transport vehicle and the vehicle is started by someone else, it could endanger the person loading the cigarettes. Such situations can also be reflected through operation-related data. For instance, in a cigarette delivery scenario, if the first user is moving the packaged cigarettes and the second user starts the transport vehicle, a dangerous operation flag will be added to the second user's operation feedback data, lowering their evaluation score in subsequent processes.
[0062] Furthermore, after generating the first and second evaluation results for the user, a basic evaluation result corresponding to the user and the virtual simulation environment is generated based on the first and second evaluation results. And after all virtual simulation environments have been invoked, a final evaluation result corresponding to the user is generated based on all basic evaluation results. Based on the basic and final evaluation results, the user's performance during the training process in each virtual simulation environment and throughout the entire training process can be fully evaluated, with a broader scope and a better reflection of whether the user's safety awareness is adequate and whether their safe operating procedures are correct.
[0063] In another embodiment of the present invention, to avoid the rigidity of user operation caused by repeatedly conducting safety training in a fixed virtual simulation environment, thus leading to a decline in training effectiveness, the present invention also introduces artificial intelligence technology to generate new virtual simulation environments based on existing ones. The method for generating new virtual simulation environments includes the following steps.
[0064] First, the various devices, operable objects, and emergency routes in the existing virtual simulation environment are decomposed into digital model units, and a model material library is built based on all digital model units.
[0065] Second, textual constraints are established for the existing virtual simulation environment. These constraints are mainly used to constrain the logical relationships between the various digital model units in the virtual simulation environment. For example, in a cigarette sorting scenario, the cigarette bins, conveying equipment, sorting equipment, and packaging equipment must be combined in a fixed order.
[0066] Third, the pre-trained semantic parsing model is used to parse the constraints, and more constraints are generated based on the existing constraints. The newly generated constraints can be called extended conditions. In this invention, the semantic parsing model can utilize existing mature models such as Long Short-Term Memory (LSTM) networks or Transformers, which are all existing technologies. Their structure, principles, and training processes will not be elaborated here.
[0067] Fourth, the constraints, extension conditions, and model material library are used as inputs to generate a new virtual simulation environment using a pre-trained scene generation model. In this invention, the scene generation model can use Generative Adversarial Networks (GANs), which are also mature existing technologies and will not be elaborated further here.
[0068] After generating a new virtual simulation environment, users can be continuously trained on safety using this new environment, thereby effectively eliminating the problem of rigid user operation and ensuring that each safety training session achieves good results.
[0069] Furthermore, after generating a new virtual simulation environment, users can be continuously trained in safety using this new environment, thereby effectively eliminating the problem of rigid user operation and ensuring that each safety training session achieves good results.
[0070] Furthermore, in another embodiment of the present invention, the cloud-based teaching management platform further includes a data synchronization unit and a training recording unit. The data synchronization unit is used to synchronize the operational behaviors of each trainee in real time to the same virtual simulation environment when multiple trainees are simultaneously conducting collaborative training, ensuring that each trainee can observe the operational results of others. The training recording unit is used to record the entire training process, generating training process playback data for trainees to review and self-evaluate after the training. Through the above settings, the present invention can effectively support safety training in multi-person collaborative work scenarios, further enhancing the realism and interactivity of the training.
[0071] Meanwhile, the evaluation report module also includes a multi-dimensional analysis unit and a comparative analysis unit. The multi-dimensional analysis unit generates quantitative scores based on multiple dimensions, such as trainees' operational behavior, warning feedback, training duration, and operational accuracy, and presents the personalized evaluation report in chart form. The comparative analysis unit compares the current trainee's evaluation results with historical training records or the average performance of other trainees in the same position, generating comparative analysis results that allow trainees and managers to intuitively understand training effectiveness and skill gaps.
[0072] To further enhance the realism and immersion of the virtual simulation environment, the 3D scene construction module also includes an environment simulation unit. This unit dynamically generates changes in lighting, weather, equipment operating sounds, and / or background noise within the virtual simulation environment, and automatically adjusts environmental parameters according to different training projects. By introducing the environment simulation unit, trainees can conduct training under conditions close to real production sites, enhancing their adaptability and emergency response capabilities to unexpected situations.
[0073] At the methodological level, this invention also provides a virtual simulation training method based on the above-mentioned system, further comprising the following steps: During the interaction between the trainee and the virtual simulation environment, real-time collection of the trainee's physiological data, including heart rate, eye movement trajectory, and / or hand movement trajectory; correlation analysis of the physiological data with operational behavior to generate an attention distribution map and operational stress assessment results for the trainee; integration of the attention distribution map and operational stress assessment results into a personalized assessment report to assist in analyzing the trainee's psychological state and level of concentration during safe operation. By introducing physiological data analysis, this invention can more comprehensively assess the trainee's actual performance in the virtual simulation environment, further improving the accuracy and reliability of the assessment results.
[0074] In summary, the virtual simulation training system and method for the tobacco industry provided by this invention, through the collaborative work of multiple functional modules such as 3D scene construction, multimodal interaction, work behavior recognition, real-time feedback, evaluation report generation, and cloud-based teaching management, can fully cover all aspects of the tobacco industry's production process, support single-person and multi-person collaborative training, and has a high degree of immersion, intelligent evaluation capabilities, and flexible scalability, resulting in training effects that are significantly better than traditional methods.
[0075] It should be understood that, in various embodiments of the present invention, the order of the above-mentioned process numbers does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
[0076] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.
[0077] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the devices, apparatuses, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0078] In the several embodiments provided by this invention, it should be understood that the disclosed devices, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.
[0079] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0080] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0081] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0082] This invention provides a readable storage medium comprising: storing a program or instructions on the readable storage medium, wherein when the program or instructions are executed by a processor, the program or instructions implement the steps of the above-described intelligent early warning method for dust explosion prevention, and can achieve the same technical effect. To avoid repetition, this invention will not elaborate further.
[0083] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, and are not intended to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in the present invention should be included within the protection scope of the present invention.
Claims
1. A virtual simulation training system for the tobacco industry, characterized in that, include: A 3D scene construction module is used to generate a virtual simulation environment based on a tobacco industry production scene. The virtual simulation environment includes at least one workstation, at least one production device, and a work process for associating the workstation and the production device. A multimodal interaction module is provided for trainees to interact with the virtual simulation environment through voice, gestures, and / or actions. The operation behavior recognition module is used to acquire operation behavior during the interaction between the trainee and the virtual simulation environment, and to determine whether the operation behavior complies with the preset safety specifications. The real-time feedback module is used to generate warning information and warning feedback when the operation does not comply with the safety specifications; The evaluation report module is used to generate personalized evaluation reports for trainees based on the operational behavior and the warning feedback. The cloud-based teaching management platform is used to control the 3D scene construction module, the multimodal interaction module, and the evaluation report module.
2. The virtual simulation training system for the tobacco industry as described in claim 1, characterized in that, The three-dimensional scene construction module includes a tobacco industry knowledge base unit and multiple scene construction units. The scene construction units are used to acquire industry knowledge from the tobacco industry knowledge base and generate the virtual simulation environment based on the industry knowledge.
3. The virtual simulation training system for the tobacco industry as described in claim 2, characterized in that, The scene construction unit includes an AR device, and the multimodal interaction module includes multiple interaction units connected to the AR device.
4. The virtual simulation training system for the tobacco industry as described in claim 1, characterized in that, The operation behavior recognition module includes multiple data acquisition units, which are used to collect the operation behaviors of trainees, including voice operation behaviors, gesture operation behaviors, and action operation behaviors.
5. A virtual simulation training system for the tobacco industry as described in claim 4, characterized in that, The operation behavior recognition module includes a safety judgment unit, which is used to determine whether the operation behavior conforms to the preset safety specifications. The real-time feedback unit includes a warning unit, which is used to generate warning information and warning feedback when the safety judgment unit determines that the operation behavior does not conform to the safety specifications. The warning information is transmitted to the trainees.
6. The virtual simulation training system for the tobacco industry as described in claim 1, characterized in that, The cloud-based teaching management platform includes a start / stop control unit, a scene control unit, and an interaction control unit. The start / stop control unit is used to generate end and start information corresponding to the trainees based on the personalized assessment report uploaded by the assessment report module. The start information is used to activate the scene control unit and the interaction control unit. After the scene control unit and the interaction control unit are activated, they control the 3D scene construction module and the multimodal interaction module to match with the new trainees and start the training.
7. A virtual simulation training method for the tobacco industry, characterized in that, Based on the virtual simulation training system for the tobacco industry as described in any one of claims 1-6, the method includes the following steps: Training projects are generated based on the identities of the trainees; The virtual simulation environment is generated using the 3D scene construction module based on the training project. The multimodal interaction module allows trainees to interact with the virtual simulation scenario. The operation behavior recognition module is used to acquire the operation behavior during the interaction between the trainee and the virtual simulation scene, and to determine whether the operation behavior complies with the safety specifications. The real-time feedback module generates warning messages and warning feedback when the operation does not comply with the safety specifications; The evaluation report module generates a personalized evaluation report for each trainee based on the operational behavior and the warning feedback. After a trainee completes their training, the cloud-based teaching management platform is used to control the 3D scene construction module, the multimodal interaction module, and the evaluation report module.
8. The virtual simulation training method for the tobacco industry as described in claim 7, characterized in that, When trainees interact with the virtual simulation scene using the multimodal interaction module, they can interact through voice, gestures, and / or actions.
9. A virtual simulation training method for the tobacco industry as described in claim 8, characterized in that, The virtual simulation environment includes at least one operable object, and the operable object can be included in multiple virtual simulation environments simultaneously.
10. A virtual simulation training method for the tobacco industry as described in claim 7, characterized in that, After receiving the personalized evaluation report sent by the evaluation report module, the cloud-based teaching management platform ends the training process of the current trainee and initializes the 3D scene construction module and the multimodal interaction module.