Simulation environment interaction training method, electronic equipment, storage medium and program product
By modeling target objects in both the real and virtual worlds to generate virtual models, and combining this with the generation of a simulation environment and the transmission of change results, the problem of interaction between the simulation environment and the real or virtual environment is solved, enabling real-time interactive simulation training.
Patent Information
- Application Number
- CN202510763515.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-09
- Publication Date
- 2025-11-11
AI Technical Summary
In existing technologies, simulation environments struggle to achieve effective interaction with the real world or virtual environments, making it impossible to conduct interactive training such as simulated collisions and combat with real-world devices. Furthermore, virtual scenes cannot cause changes in objects in real-world scenes.
By modeling target objects in the real world and the virtual world, first and second virtual models are generated and configured in a standardized platform. Combined with the generated simulation environment, the changes are transmitted to the target objects in real time to achieve interaction.
It enables real-time interaction between changes in the simulation environment and the real or virtual world, achieving a simulation effect of real-time interactive changes and supporting personnel to train in a virtual-real combined environment.
Smart Images
Figure CN120932518A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of virtual reality technology, specifically relating to a simulation environment interactive training method, electronic device, storage medium, and program product. Background Technology
[0002] In current virtual interaction training scenarios, objects in the virtual world can be extracted and then presented in a simulated training environment. However, during simulation training in such scenarios, it is difficult to achieve interaction with and alteration of the real-world environment. These simulation training scenarios cannot cause changes to real-world objects such as vehicles and buildings, nor can they achieve interaction with and alteration of the virtual environment. In other scenarios, information from real-world devices can be collected and transmitted to the simulation environment for interaction. However, this method also fails to achieve interactive training with real-world devices. For example, simulation collision and combat training techniques also struggle to alter the virtual environment for simulated interactive training. In conclusion, during simulation training in current environments, changes in the simulation environment rarely achieve interaction with either the real world or the virtual environment. Summary of the Invention
[0003] This application provides a simulation environment interactive training method, electronic device, storage medium, and program product, which can solve the problem that when users conduct simulation training in a simulation environment, changes in the simulation environment are difficult to achieve interaction with the real world or virtual environment.
[0004] In a first aspect, embodiments of this application provide a simulation environment interactive training method, the method comprising: combining a first virtual model and a second virtual model to obtain a simulation environment, wherein the first virtual model is generated based on a first target object in the real world, and the second virtual model is generated based on a second target object in the virtual world, and the simulation environment is used for user training; when the first virtual model or the second virtual model in the simulation environment changes, the change result is transmitted to the first target object or the second target object, so that the first target object or the second target object generates a response result corresponding to the change result.
[0005] Secondly, embodiments of this application provide a simulation environment interactive training device, which includes: a simulation module for combining a first virtual model and a second virtual model to obtain a simulation environment, wherein the first virtual model is generated based on a first target object in the real world, and the second virtual model is generated based on a second target object in the virtual world, and the simulation environment is used for user training; and an interaction module for transmitting changes in the first virtual model or the second virtual model in the simulation environment to the first target object or the second target object, so that the first target object or the second target object generates a response result corresponding to the changes.
[0006] Thirdly, embodiments of this application provide an electronic device including a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the method described in the first aspect.
[0007] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.
[0008] Fifthly, embodiments of this application provide a computer program product, the computer program product including a computer program stored on a non-transitory computer-readable storage medium, the computer program including program instructions, which, when executed by a computer, cause the computer to perform the steps of the method described in the first aspect.
[0009] In this embodiment, a simulation environment is obtained by combining a first virtual model and a second virtual model. The first virtual model is generated based on a first target object in the real world, and the second virtual model is generated based on a second target object in the virtual world. The simulation environment is used for user training. When the first virtual model or the second virtual model in the simulation environment changes, the change result is transmitted to the first target object or the second target object so that the first target object or the second target object generates a response result corresponding to the change result, thereby realizing the interaction between the real world and the virtual world in the simulation environment. Attached Figure Description
[0010] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0011] Figure 1 This is a schematic diagram of the architecture of a simulation environment interactive training system provided in an embodiment of this application; Figure 2 This is a flowchart illustrating an interactive training method for a simulation environment provided in an embodiment of this application; Figure 3 This is a flowchart illustrating another simulation environment interactive training method provided in an embodiment of this application; Figure 4 This is a schematic diagram of the structure of a simulation environment interactive training device provided in an embodiment of this application; Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0012] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0013] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0014] Current virtual scene training methods present virtual scenes in the real world through devices. However, this approach makes it difficult to alter the real-world environment or conduct simulated interactive training, as virtual scenes cannot cause changes to vehicles, buildings, or other elements in the real world. Furthermore, while collecting information from real-world devices and transmitting it to the simulation environment for interaction, it lacks interactive training techniques such as simulated collisions and combat. The virtual-real integration relies on collecting and simulating positioning and attitude data, without other interactive functions. Simulation reasoning based on deep learning lacks the effect of real-time interactive simulation. To address these issues, this application provides a simulation environment interactive training method, electronic device, storage medium, and program product. The system architecture of the simulation environment interactive training method provided in this application is as follows: Figure 1 As shown, it includes a scanning modeling system, a standardized platform, a virtual modeling system, a virtual-real combined simulation environment, and a virtual-real combined large model.
[0015] like Figure 1 As shown, in real-world scenarios, such as terrain, buildings, and vehicles, models are created using a scanning modeling system and mapped to the virtual world. A standardized platform is used to standardize the configuration of the virtual models mapping real-world objects. In virtual world scenarios, such as virtual terrain, buildings, and vehicles, models are created using a virtual modeling system. A standardized platform is used to standardize the configuration of these virtual models. After standardization on the platform, real-world objects and virtual models are combined in a hybrid virtual-real simulation environment. Here, all simulation element models interact and change, with the virtual models and real-world objects synchronously influencing each other's states. The virtual-real integration of the simulation environment is completed, and the data is stored in a hybrid virtual-real standard database. The virtual-real large-scale model platform uses the hybrid virtual-real standard database as training data and the standards of the standardized platform as prompts, allowing direct generation of simulated element models in the virtual simulation environment using these prompts.
[0016] Figure 2 and Figure 3 The following is a flowchart illustrating the interactive training method for a simulation environment provided in an embodiment of this application. Figure 2 and Figure 3 The simulation environment interactive training method provided in this application will be specifically described through specific embodiments and application scenarios. The method includes the following steps: Step S201: Combine the first virtual model and the second virtual model to obtain the simulation environment.
[0017] In this embodiment, the first virtual model can be generated by mapping a first target object from the real world onto the simulation environment. This first target object can be any object in the real world, such as terrain features, buildings, people, vehicles, etc. In this embodiment, a second virtual model can also be generated based on a second target object in the virtual data. This second target object can be any object in the virtual world, such as virtual characters, virtual terrain features, buildings, virtual vehicles, etc.
[0018] In one embodiment, before combining the first virtual model and the second virtual model to obtain the simulation environment, the method further includes: modeling the first target object to obtain the first modeling model; and configuring the first virtual model according to the first modeling model and the virtual-real combination standard to obtain the first virtual model.
[0019] In this embodiment, a first target object in the real world, such as a real-world site or object, can be scanned using devices such as drones or panoramic cameras. The first target object is then modeled using a scanning modeling platform to obtain a first modeling model. In this embodiment, sensors, audio-visual equipment, vibration devices, etc., can also be installed on the first target object corresponding to the first modeling model in the real world as needed to collect data from the first target object or change its state.
[0020] After modeling the first target object, the first virtual model can be configured according to the virtual-real integration standard of the standardized platform, based on the first modeling model. This includes configuring the input parameters, transmission, and change results of the first virtual model. In this way, the first virtual model can be obtained.
[0021] In one embodiment, before combining the first virtual model and the second virtual model to obtain the simulation environment, the method further includes: modeling the second target object to obtain a second modeling model; and configuring the second virtual model according to the second modeling model and the virtual-real combination standard to obtain the second virtual model.
[0022] In this embodiment, a virtual modeling system can be used to model a second target object in a virtual world to obtain a second modeling model. Virtual elements can then be added to the virtual world constructed based on the real world as needed. The second virtual model can then be configured according to the virtual-real integration standards required by the standardized platform, for example, configuring the input parameters, transmission, and change results of the second virtual model.
[0023] In one embodiment, the virtual-real integration standard includes: input parameters, the change results corresponding to the input parameters, and model characteristics.
[0024] Specifically, after obtaining the first and second virtual models, the input parameters, characteristics, and change results of the first and second virtual models can be developed and configured according to the virtual-real integration standard of the standardized platform, as shown in Table 1 below:
[0025] This application embodiment sets a unified standard for combining virtual and real elements for the modeled objects, including object characteristics, interactively changing input parameters, and the corresponding changes in the input parameters, thereby quickly generating simulated scenarios and objects.
[0026] After configuring the first and second virtual models, they can be added to the simulation environment. Combining the first and second virtual models in the simulation environment will yield the simulation environment for user training.
[0027] Step S202: If the first virtual model or the second virtual model in the simulation environment changes, the change result is transmitted to the first target object or the second target object.
[0028] In this embodiment of the application, if the user causes changes to the first virtual model or the second virtual model in the simulation environment during training, the changes can be transmitted to the first target object or the second target object so that the first target object or the second target object can generate a response result corresponding to the changes.
[0029] In this embodiment, a first target object from the real world is modeled in the simulation environment, and real-world objects requiring real-time interaction are mapped to the simulation environment in real time. For example, a real-world vehicle is modeled in the simulation environment, and sensors, positioning devices, and transmission equipment are installed on the vehicle to display its dynamic changes in real time. Another example is a collision between a virtual vehicle and a real vehicle. Yet another example is user-generated changes in a virtual machine-constructed vehicle or a real vehicle mapped to the simulation environment.
[0030] The primary target object in the real world is presented and interacted with in the simulation environment. For example, trainees can operate in a VR cockpit, and the corresponding element models in the simulation environment change synchronously. The first virtual model can be generated based on a real-world vehicle. Driver A can drive a virtual vehicle in the simulation environment through the VR cockpit, while driver B drives a real vehicle (the first virtual model) equipped with positioning, sensors, and a display terminal, which has been mapped and modeled in the virtual environment. If driver A's virtual vehicle collides and destroys the first virtual model in the simulation environment, the sensors of the real-world car will send a vibration alarm, indicating that the vehicle has been destroyed and can no longer move. Similarly, for example, a second target object in the virtual world can be interacted with in the simulation environment. The second virtual model can be a vehicle model. If a user collides with the virtual vehicle model in the simulation environment, the result of the collision, such as the vehicle being destroyed, can be transmitted to the virtual world, and the vehicle in the virtual world will also respond that it has been destroyed.
[0031] This application implements real-time interaction combining virtual and real elements, and the objects in the corresponding simulation environment change in real time according to the interaction process. The embodiments of this application set a unified virtual-real combination standard for the target object being modeled, including the characteristics of the target object, the input parameters that can be interacted with, and the change results corresponding to the input parameters. When a corresponding supportable interactive change event occurs, it is used as the input parameter for the interaction to generate the corresponding change result, thereby achieving a simulation effect of real-time interactive change.
[0032] The simulation environment interactive training method provided in this application combines a first virtual model and a second virtual model to obtain a simulation environment. The first virtual model is generated based on a first target object in the real world, and the second virtual model is generated based on a second target object in the virtual world. The simulation environment is used for user training. When the first virtual model or the second virtual model in the simulation environment changes, the change result is transmitted to the first target object or the second target object so that the first target object or the second target object generates a response result corresponding to the change result. By simulating the first target object in the real world, simulating the second target object in the virtual world, and combining the first virtual model and the second virtual model to generate the simulation environment, personnel can be trained in the simulation environment.
[0033] Furthermore, in this embodiment, a unified virtual-real integration standard is set for the modeling target, including the characteristics of things, input parameters that can undergo interactive changes, and the results of changes. When a corresponding supportable interactive change event occurs, it serves as the input parameter for the interactive change, generating the corresponding change result, achieving a simulation effect of real-time interactive changes, and realizing the interaction between changes in the simulation environment and the real world or the virtual world. Personnel can operate the virtual model and operate real things in the simulation environment, simulate training in the virtual-real integration simulation environment, synchronize real things and virtual models, and change states according to the configured virtual-real interaction standard.
[0034] In one embodiment, when the first virtual model or the second virtual model in the simulation environment changes, the change result is transmitted to the first target object or the second target object so that the first target object or the second target object generates a response result corresponding to the change result. This includes: when the first virtual model in the simulation environment changes in accordance with a first input parameter, generating a change result corresponding to the first parameter, wherein the first input parameter is generated when the first virtual model is generated according to the virtual-real combination standard; and transmitting the change result to the first target object so that the first target object generates a response result corresponding to the change result.
[0035] In this embodiment of the application, when a user is training in a simulation environment, if the first virtual model in the simulation environment produces a change corresponding to the first input parameter, a change result corresponding to the first parameter can be generated. Then, the change result can be transmitted to the first target object so that the first target object produces a response result corresponding to the change result.
[0036] As an example, trainees can operate in a VR cockpit, and the corresponding element models in the simulation environment change synchronously. The first virtual model can be generated based on a real-world vehicle. Driver A can drive a virtual vehicle in the simulation environment through the VR cockpit, while driver B drives a real vehicle (the first virtual model) that is equipped with positioning, sensors, and a display terminal and has been mapped and modeled in the virtual environment. When the virtual vehicle driven by driver A in the simulation environment collides and is destroyed with the first virtual model, the result of which is that the first virtual model is destroyed. The result of the vehicle being destroyed is transmitted to the real-world vehicle, and the vehicle's sensors send a vibration alarm response, indicating that the vehicle has been destroyed and can no longer move.
[0037] In this way, if the virtual model in the simulation environment changes in real time, the embodiments of this application generate a first virtual model by modeling a first target object in the real world, and set a unified standard for virtual-real integration, including the characteristics of things, interactive input parameters, and change results. When the first virtual model undergoes an interactive change event, it is used as an interactive change parameter to generate a corresponding change result, and the change result is transmitted to the first target object in the real world so that the target object can generate a corresponding response result, thereby achieving a simulation effect of real-time interactive change.
[0038] In one embodiment, when the first virtual model or the second virtual model in the simulation environment changes, transmitting the change result to the first target object or the second target object so that the first target object or the second target object generates a response result corresponding to the change result includes: when the second virtual model in the simulation environment changes in accordance with a second input parameter, generating a change result corresponding to the second parameter, wherein the second input parameter is generated when the second virtual model is generated according to the virtual-real combination standard; and transmitting the change result to the second target object so that the second target object generates the response result corresponding to the change result.
[0039] In this embodiment of the application, when a user is training in a simulation environment, if the second virtual model in the simulation environment produces a change corresponding to the second input parameter, a change result corresponding to the second parameter can be generated. Then, the change result can be transmitted to the second target object so that the second target object produces a response result corresponding to the change result.
[0040] As an example, trainees can operate in a VR cockpit, and the corresponding element models in the simulation environment change synchronously. The second virtual model can be generated based on vehicles in the virtual world. Driver A can drive a virtual vehicle (second virtual model) in the simulation environment through the VR cockpit. When the virtual vehicle driven by driver A in the simulation environment collides and is destroyed, the result of the change in the second virtual model is that it is destroyed. The result of the vehicle being destroyed is transmitted to the second target object in the virtual world. In the virtual world, it means that the virtual vehicle of the second target object is destroyed and can no longer move.
[0041] In this way, if the virtual model in the simulation environment changes in real time, the embodiments of this application generate a second virtual model by modeling the second target object in the virtual world, and set a unified standard for combining virtual and real, including the characteristics of things, interactive input parameters, and change results. When the second virtual model undergoes an interactive change event, it is used as an interactive change parameter to generate a corresponding change result, and the change result is transmitted to the second target object in the virtual world so that the target object can generate a corresponding response result, thereby achieving a simulation effect of real-time interactive change.
[0042] In one embodiment, after combining the first virtual model and the second virtual model to obtain the simulation environment, the method further includes: acquiring virtual-real combination data obtained by combining the first virtual model and the second virtual model; generating a third virtual model based on the virtual-real combination large model, the virtual-real combination data, and the virtual-real combination standard; and combining the third virtual model into the simulation environment.
[0043] In this embodiment, after combining the first virtual model and the second virtual model, virtual-real combined data obtained from combining the first and second virtual models can be obtained, and this virtual-real combined data can be stored in a virtual-real combined standard database. In this embodiment, the virtual combined large model platform can use the virtual-real combined standard database as training data and the virtual-real combined standard of the standardized platform as prompt statements. The prompt statements can be directly used to generate a third simulation model in the virtual simulation environment, and the third virtual model can be combined with the simulation environment. The third virtual model can be combined and interact with the virtual model in the real world here.
[0044] It should be noted that the simulation environment interactive training method provided in this application embodiment can be executed by a simulation environment interactive training device, or a control module in the simulation environment interactive training device for executing the simulation environment interactive training method. This application embodiment uses the simulation environment interactive training device executing the simulation environment interactive training method as an example to illustrate the simulation environment interactive training device provided in this application embodiment.
[0045] Figure 4 This is a schematic diagram of the structure of a simulation environment interactive training device according to an embodiment of this application. Figure 4 As shown, the simulation environment interactive training device 400 includes a simulation module 410 and an interaction module 420.
[0046] The simulation module 410 is used to combine the first virtual model and the second virtual model to obtain a simulation environment. The first virtual model is generated based on a first target object in the real world, and the second virtual model is generated based on a second target object in the virtual world. The simulation environment is used for user training. The interaction module is used to transmit the change result to the first target object or the second target object when the first virtual model or the second virtual model in the simulation environment changes, so that the first target object or the second target object generates a response result corresponding to the change result.
[0047] In one implementation, the interaction module 420 is configured to generate a change result corresponding to the first input parameter when the first virtual model in the simulation environment undergoes a change corresponding to the first input parameter, wherein the first input parameter is generated when the first virtual model is generated according to the virtual-real combination standard; and transmit the change result to the first target object so that the first target object generates the response result corresponding to the change result.
[0048] In one implementation, the interaction module 420 is configured to generate a change result corresponding to the second parameter when the second virtual model in the simulation environment undergoes a change corresponding to the second input parameter, wherein the second input parameter is generated when the second virtual model is generated according to the virtual-real combination standard; and transmit the change result to the second target object so that the second target object generates the response result corresponding to the change result.
[0049] In one implementation, the simulation module 410 is used to acquire virtual-real combined data obtained by combining the first virtual model and the second virtual model; generate a third virtual model based on the virtual-real combined large model, the virtual-real combined data and the virtual-real combined standard; and combine the third virtual model into the simulation environment.
[0050] In one implementation, the simulation module 410 is used to model the first target object to obtain a first modeling model; and to configure the first virtual model according to the first modeling model and the virtual-real combination standard to obtain the first virtual model.
[0051] In one implementation, the simulation module 410 is used to model the second target object to obtain a second modeling model; and to configure the second virtual model according to the second modeling model and the virtual-real combination standard to obtain the second virtual model.
[0052] In one implementation, the virtual-real integration standard includes: input parameters, the change results corresponding to the input parameters, and model characteristics.
[0053] The simulation environment interactive training device in this application embodiment can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. For example, mobile electronic devices can be mobile phones, tablets, laptops, PDAs, in-vehicle electronic devices, wearable devices, ultra-mobile personal computers (UMPCs), netbooks, or personal digital assistants (PDAs), etc., while non-mobile electronic devices can be servers, network-attached storage (NAS), personal computers (PCs), televisions (TVs), ATMs, or self-service machines, etc. This application embodiment does not impose specific limitations.
[0054] The simulation environment interactive training device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.
[0055] The simulation environment interactive training device provided in this application embodiment can achieve... Figures 1 to 3 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.
[0056] like Figure 5 As shown in the illustration, this application embodiment also provides an electronic device 500, including a processor 501 and a memory 502. The memory 502 stores a program or instructions that can run on the processor 501. When the program or instructions are executed by the processor 501, they achieve the following: combining a first virtual model and a second virtual model to obtain a simulation environment. The first virtual model is generated based on a first target object in the real world, and the second virtual model is generated based on a second target object in the virtual world. The simulation environment is used for user training. When the first virtual model or the second virtual model in the simulation environment changes, the change result is transmitted to the first target object or the second target object so that the first target object or the second target object generates a response result corresponding to the change result.
[0057] In one implementation, when the first virtual model in the simulation environment undergoes a change corresponding to the first input parameter, a change result corresponding to the first parameter is generated, wherein the first input parameter is generated when the first virtual model is generated according to the virtual-real combination standard; the change result is transmitted to the first target object so that the first target object generates the response result corresponding to the change result.
[0058] In one implementation, when the second virtual model in the simulation environment undergoes a change corresponding to the second input parameter, a change result corresponding to the second parameter is generated, wherein the second input parameter is generated when the second virtual model is generated according to the virtual-real combination standard; the change result is transmitted to the second target object so that the second target object generates the response result corresponding to the change result.
[0059] In one implementation, after combining the first virtual model and the second virtual model to obtain the simulation environment, virtual-real combination data obtained by combining the first virtual model and the second virtual model is acquired; a third virtual model is generated based on the virtual-real combination large model, the virtual-real combination data, and the virtual-real combination standard; and the third virtual model is combined into the simulation environment.
[0060] In one implementation, before combining the first virtual model and the second virtual model to obtain the simulation environment, the first target object is modeled to obtain a first modeling model; based on the first modeling model and the virtual-real combination standard, the first virtual model is configured to obtain the first virtual model.
[0061] In one implementation, before combining the first virtual model and the second virtual model to obtain the simulation environment, the second target object is modeled to obtain a second modeling model; based on the second modeling model and the virtual-real combination standard, the second virtual model is configured to obtain the second virtual model.
[0062] In one implementation, the virtual-real integration standard includes: input parameters, the change results corresponding to the input parameters, and model characteristics.
[0063] The specific execution steps can be found in the various steps of the above-described simulation environment interactive training method embodiment, and can achieve the same technical effect. To avoid repetition, they will not be repeated here.
[0064] It should be noted that the electronic devices in the embodiments of this application include: servers, terminals, or other devices besides terminals.
[0065] The above electronic device structure does not constitute a limitation on the electronic device. An electronic device may include more or fewer components than illustrated, or combine certain components, or arrange them differently. For example, an input unit may include a Graphics Processing Unit (GPU) and a microphone, and a display unit may use a liquid crystal display (LCD), organic light-emitting diode (OLED), or other similar display panels. User input units include at least one of a touch panel and other input devices. A touch panel is also called a touchscreen. Other input devices may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be elaborated further here.
[0066] Memory can be used to store software programs and various data. Memory can primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area can store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, memory can include volatile memory or non-volatile memory, or both. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (Synchlink DRAM, SLDRAM), and direct memory bus RAM (DRRAM).
[0067] The processor may include one or more processing units; optionally, the processor integrates an application processor and a modem processor, wherein the application processor mainly handles operations related to the operating system, user interface, and applications, while the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor.
[0068] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described simulation environment interactive training method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0069] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as ROM, RAM, magnetic disk, or optical disk.
[0070] This application also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium. The computer program includes program instructions, which, when executed by a computer, cause the computer to perform various processes of the above-described simulation environment interactive training method, and achieve the same technical effect. To avoid repetition, these will not be described again here.
[0071] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0072] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0073] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. A simulation environment interactive training method, characterized in that, include: A simulation environment is obtained by combining the first virtual model and the second virtual model. The first virtual model is generated based on a first target object in the real world, and the second virtual model is generated based on a second target object in the virtual world. The simulation environment is used for user training. When the first virtual model or the second virtual model in the simulation environment changes, the change result is transmitted to the first target object or the second target object so that the first target object or the second target object generates a response result corresponding to the change result.
2. The method according to claim 1, characterized in that, When the first virtual model or the second virtual model in the simulation environment changes, the change result is transmitted to the first target object or the second target object so that the first target object or the second target object generates a response result corresponding to the change result, including: When the first virtual model in the simulation environment undergoes a change corresponding to the first input parameter, a change result corresponding to the first parameter is generated, wherein the first input parameter is generated when the first virtual model is generated according to the virtual-real combination standard; The change result is transmitted to the first target object so that the first target object generates the response result corresponding to the change result.
3. The method according to claim 1, characterized in that, When the first virtual model or the second virtual model in the simulation environment changes, the change result is transmitted to the first target object or the second target object so that the first target object or the second target object generates a response result corresponding to the change result, including: When the second virtual model in the simulation environment undergoes a change corresponding to the second input parameter, a change result corresponding to the second parameter is generated, wherein the second input parameter is generated when the second virtual model is generated according to the virtual-real combination standard; The change result is transmitted to the second target object so that the second target object generates the response result corresponding to the change result.
4. The method according to claim 1, characterized in that, After combining the first virtual model and the second virtual model to obtain the simulation environment, the process further includes: Obtain virtual-real combined data obtained by combining the first virtual model and the second virtual model; Based on the virtual-real integrated big model, the virtual-real integrated data, and the virtual-real integrated standard, a third virtual model is generated; The third virtual model is incorporated into the simulation environment.
5. The method according to claim 1, characterized in that, Before combining the first virtual model and the second virtual model to obtain the simulation environment, the following steps are also included: The first target object is modeled to obtain the first modeling model; Based on the first modeling model and the virtual-real integration standard, the first virtual model is configured to obtain the first virtual model.
6. The method according to claim 1, characterized in that, Before combining the first virtual model and the second virtual model to obtain the simulation environment, the following steps are also included: The second target object is modeled to obtain a second modeling model; Based on the second modeling model and the virtual-real integration standard, the second virtual model is configured to obtain the second virtual model.
7. The method according to any one of claims 2-6, characterized in that, The virtual-real integration standard includes: input parameters, the corresponding changes of the input parameters, and model characteristics.
8. An electronic device, characterized in that, It includes a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the interactive training method for a simulation environment as described in any one of claims 1-7.
9. A readable storage medium, characterized in that, The program or instructions are stored on the readable storage medium, and when the program or instructions are executed by the processor, they implement the steps of the simulation environment interactive training method as described in any one of claims 1-7.
10. A computer program product, characterized in that, The computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program including program instructions that, when executed by a computer, cause the computer to perform the steps of the interactive training method for a simulation environment as described in any one of claims 1-7.