Gesture interaction-based immersive geologic evolution dynamic simulation system and method

Abstract

This invention belongs to the field of geological evolution dynamic simulation technology. It discloses an immersive geological evolution dynamic simulation system and method based on gesture interaction. The system includes: a geological context intelligent reasoning module, a geological process dynamic simulation module, a user interaction command parsing and mapping module, and a dynamic terrain rendering module. Based on multi-source fused data, it performs geological information reasoning to obtain a geological context reasoning report. Based on the geological context reasoning report, it performs time and process simulation to obtain a dynamic terrain data report. It parses and maps parameters to the user interaction report and outputs the mapping results to the geological process dynamic simulation module for secondary processing to obtain a new dynamic terrain data report and a dynamic terrain image sequence. Overall, this invention has significant advantages in ensuring the realism of geological scenes, providing good adaptive effects for user interaction content, and greatly improving the user experience.

Description

Technical Field

[0001] This invention relates to the field of dynamic simulation technology of geological evolution, and more specifically, to an immersive dynamic simulation system and method for geological evolution based on gesture interaction. Background Technology

[0002] Immersive geological evolution dynamic simulation systems are advanced tools that use virtual reality technology to place users in a dynamically changing three-dimensional geological environment, enabling users to intuitively experience and interact with the geological changes that have taken place over millions of years. Such systems have broad application prospects in fields such as geological teaching, scientific research, mineral exploration, and public science education.

[0003] However, traditional immersive geological evolution dynamic simulation systems often suffer from the following shortcomings during use: First, the geological content displayed by traditional systems is mostly pre-set and generic animated models, unrelated to the user's specific location and observed real-world geological features. For example, the system struggles to automatically associate a specific rock seen in real-time in the field with the regional geological history, thus limiting the system to mere display. Second, traditional geological evolution simulations are mostly pre-rendered linear animations, with user interaction limited to play, pause, and jump, failing to provide parameterized and traceable dynamic simulations based on real geological data. The traditional system suffers from several drawbacks. First, the simulation results lack depth and flexibility, limiting the system's interaction to a purely visual level. Second, when performing real-time calculations of large-scale and high-precision dynamic terrain changes, the massive computational load and rendering pressure can cause image stuttering, delays, or a sharp drop in image quality, affecting the user's immersive experience and even causing dizziness or other discomfort. In general, effectively addressing the problems of rigid geological scene display, superficial user interaction, and delayed terrain rendering in traditional systems has become a challenge that current immersive geological evolution dynamic simulation systems need to tackle.

[0004] In view of this, the present invention proposes an immersive dynamic simulation system and method for geological evolution based on gesture interaction to solve the above problems. Summary of the Invention

[0005] To overcome the aforementioned deficiencies of the prior art and to achieve the above objectives, the present invention provides the following technical solution, including:

[0006] The multi-source geological data management and fusion module is used to collect raw data in real time based on the database, and perform spatial matching, attribute association and data fusion to obtain multi-source fused data;

[0007] Furthermore, the steps of real-time acquisition of raw data based on the database, and the subsequent spatial matching, attribute association, and data fusion include:

[0008] S1.1: Collect raw data in real time based on the database to obtain the raw dataset, which includes user positioning data, user command recognition data and geological database;

[0009] S1.2: Using the user location data in the original dataset as the query condition, perform spatial inclusion analysis on the high-precision geological map in the geological database to obtain the geological unit of the user's location, and obtain the rock attributes of the geological unit based on the rock attribute database to obtain a geological unit attribute report. At the same time, match the user command recognition data with the rock attribute database in the geological database to obtain a rock type probability report.

[0010] S1.3: Package user location data, user command identification data, geological unit attribute reports, and rock type probability reports to obtain multi-source fused data;

[0011] The geological context intelligent reasoning module is used to perform geological information reasoning based on multi-source fusion data and obtain a geological context reasoning report.

[0012] Furthermore, the steps for geological information reasoning based on multi-source fusion data include:

[0013] S2.1: The matching score is calculated based on multi-source fusion data. The specific formula for the calculation is as follows:

[0014] ;

[0015] Get matching score ,in, The total number of features participating in the comparison. For the first The weighting factors of each feature For comparison functions, For the first Each user command identifies feature values ​​in the data. For the first Characteristic values ​​in the attribute report of each geological unit;

[0016] S2.2: Sort the matching scores from largest to smallest, and select the rock type with the largest matching score as the final confirmed rock type;

[0017] S2.3: Based on the finally confirmed rock type, obtain the geological unit parameters and simulation parameters to which the finally confirmed rock type belongs, and obtain the geological context reasoning report;

[0018] S2.4: Output the geological context reasoning report to the geological process dynamic simulation module and the user interface presentation module respectively;

[0019] The geological process dynamic simulation module is used to perform time and process simulations based on geological context reasoning reports to obtain dynamic terrain data reports.

[0020] Furthermore, the steps for time and process simulation based on geological context reasoning reports include:

[0021] S3.1: Retrieve the 3D digital elevation model network from the database and initialize the 3D digital elevation model network based on the simulation parameters in the geological context reasoning report and user positioning data;

[0022] S3.2: Based on the initialized three-dimensional digital elevation model network, and based on the geological context reasoning report and simulation time window, a simulation process report is obtained. The simulation process report includes tectonic movement simulation, river erosion simulation, glacial action simulation, weathering process simulation, and sedimentation process simulation.

[0023] S3.3: Based on the timeline from far to near, sort all data items in the simulation process report to obtain a dynamic terrain data report;

[0024] S3.4: Output the dynamic terrain data report to the dynamic terrain rendering module, and output the simulation time window in step S3.2 to the user interaction command parsing and mapping module;

[0025] The user interaction command parsing and mapping module is used to parse and map parameters of user interaction reports, and output the mapping results to the geological process dynamic simulation module for secondary operation to obtain a new dynamic terrain data report.

[0026] Furthermore, the steps of parsing and mapping user interaction reports, and outputting the mapping results to the geological process dynamic simulation module for secondary operation include:

[0027] S4.1: Based on the user interface presentation module, obtain user interaction reports in real time;

[0028] S4.2: Based on the user interaction report, the simulation control command is generated and output to the geological process dynamic simulation module for the geological process dynamic simulation module to adjust the dynamic terrain data report;

[0029] S4.3: Obtain the simulation time window output by the geological process dynamic simulation module and output it to the user interface presentation module to update the timeline display on the UI;

[0030] The dynamic terrain rendering module is used to perform dynamic layer detail processing based on dynamic terrain data reports and user view parameter reports to obtain dynamic terrain image sequences;

[0031] Furthermore, the steps for dynamic hierarchical detail processing based on dynamic terrain data reports and user view parameter reports include:

[0032] S5.1: Based on the dynamic terrain data report and the user view parameter report, and simplifying the dynamic terrain data report according to the user view parameter report, a dynamic hierarchical processing report is obtained. The simplification method includes using a high-precision grid for areas close to the user viewpoint and a low-precision grid for areas far from the user viewpoint.

[0033] S5.2: Submit the dynamic hierarchy processing report to the GPU for processing to obtain a dynamic terrain image sequence. The processing includes the GPU executing shaders to render and blend the image frames in the dynamic hierarchy processing report for lighting, texture, and shadow.

[0034] S5.3: Output the dynamic terrain image sequence to the user interface presentation module;

[0035] The geological data collaboration resource scheduling module is used for data collaboration and rendering resource scheduling with other modules;

[0036] Furthermore, the steps for data collaboration and rendering resource scheduling with other modules include:

[0037] S6.1: Monitor the data transmission of other modules. Other modules refer to modules in the system excluding the geological data collaborative resource scheduling module.

[0038] S6.2: Predict the user's jump operation, and generate advance calculation instructions and preloading instructions based on the prediction results according to the resource scheduler. Output the advance prediction instructions to the geological process dynamic simulation module and the preloading instructions to the dynamic terrain rendering module.

[0039] The advance calculation instruction contains a set of characters representing a report of dynamic terrain data near the advance calculation prediction results;

[0040] The preload directive contains a set of texture resources representing the preloaded, pre-computed directives.

[0041] S6.3: Monitor the real-time load of the CPU and GPU, and adjust the power of the CPU and GPU according to the simulation intensity in step S3.2;

[0042] The user interface presentation module is used to provide users with all interaction entry points and visual data, and to collect user interaction operations and user view parameters to obtain user interaction reports and user view parameter reports respectively.

[0043] Furthermore, the steps of providing users with all interactive entry points and visual data, and collecting user interaction operations and user view parameters include:

[0044] S7.1: Based on a dynamic terrain image sequence, a three-dimensional environment main view is constructed and displayed in real time through the device display;

[0045] S7.2: Integrate UI controls into the device display;

[0046] Real-time acquisition of geological context reasoning reports, and real-time display and playback on the device's screen in text and voice formats;

[0047] S7.3: When a user uses a UI control, the user's interaction is collected, a user interaction report is generated, and the report is output to the user interaction command parsing and mapping module.

[0048] S7.4: When the device starts up, it collects the user's view parameters in real time, obtains a user view parameter report, and outputs it to the dynamic terrain rendering module;

[0049] Furthermore, S1: Based on the database, raw data is collected in real time, and spatial matching, attribute association and data fusion are performed to obtain multi-source fused data;

[0050] S2: Geological information reasoning is performed based on multi-source fusion data to obtain a geological context reasoning report;

[0051] S3: Based on the geological context reasoning report, perform time and process simulation to obtain a dynamic terrain data report;

[0052] S4: Parse and map parameters of the user interaction report, and output the mapping results to the geological process dynamic simulation module for secondary operation to obtain a new dynamic terrain data report;

[0053] S5: Based on the dynamic terrain data report and user view parameter report, perform dynamic hierarchical detail processing to obtain a dynamic terrain image sequence;

[0054] S6: Perform data collaboration and rendering resource scheduling with other modules;

[0055] S7: Provides users with all interaction entry points and visual data, and collects user interaction operations and user view parameters to obtain user interaction reports and user view parameter reports respectively.

[0056] The technical effects and advantages of the immersive geological evolution dynamic simulation system and method based on gesture interaction of this invention are as follows:

[0057] This invention acquires raw data in real time from a database, performs spatial matching, attribute association, and data fusion to obtain multi-source fused data. Based on this multi-source fused data, geological information inference is performed to generate a geological context inference report. Based on this geological context inference report, time and process simulation is performed to generate a dynamic terrain data report. User interaction reports are parsed and parameter-mapped, and the mapping results are output to the geological process dynamic simulation module for secondary processing to obtain a new dynamic terrain data report. Based on the dynamic terrain data report and the user view parameter report, dynamic hierarchical detail processing is performed to obtain a dynamic terrain image sequence. Data coordination and rendering resource scheduling are performed with other modules to provide users with all interactive entry points and visual data. User interaction operations and user view parameters are collected to generate user interaction reports and user view parameter reports, respectively. This allows the system to achieve [the following:] through the collaborative operation of the multi-source geological data management and fusion module and the geological context intelligent inference module, [the following is a separate, unrelated sentence:] Based on the user's real-time coordinates, on-site identification features, and geological database, this invention automatically generates a geological context reasoning report, significantly reducing the inaccuracies in geological scene display found in traditional systems. Furthermore, by establishing a dynamic geological process simulation module and a user interaction command parsing and mapping module, this invention enables users to move beyond passive viewing and actively explore geological knowledge. This not only meets the scientific needs of professionals but also provides a powerful and professional knowledge platform for general users. Finally, through the collaborative operation of the dynamic terrain rendering module and the geological data collaborative resource scheduling module, the invention ensures that users maintain a comfortable and immersive visual experience throughout the entire geological evolution simulation process, fundamentally improving system reliability and user experience. Overall, this invention has significant advantages in ensuring the realism of geological scenes, providing excellent adaptive effects for user interaction content, and greatly enhancing the user experience. Attached Figure Description

[0058] Figure 1 This is a schematic diagram of the immersive geological evolution dynamic simulation system based on gesture interaction according to the present invention;

[0059] Figure 2 This is a schematic diagram of the immersive dynamic simulation method for geological evolution based on gesture interaction according to the present invention. Detailed Implementation

[0060] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0061] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms “a,” “the,” and “the” used in the embodiments of this invention are also intended to include the plural forms, and “multiple” generally includes at least two unless the context clearly indicates otherwise.

[0062] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0063] Furthermore, the timing of the steps in the following method embodiments is merely an example and not a strict limitation.

[0064] In practice, the server-side equipment deployed in a gesture-based immersive geological evolution dynamic simulation system may consist of one or more devices. This gesture-based immersive geological evolution dynamic simulation system can be implemented as: a business instance, a virtual machine, or hardware devices. For example, this gesture-based immersive geological evolution dynamic simulation system can be implemented as a business instance deployed on one or more devices in a cloud node. Simply put, this gesture-based immersive geological evolution dynamic simulation system can be understood as software deployed on a cloud node, used to provide gesture-based immersive geological evolution dynamic simulation to various user terminals. Alternatively, this gesture-based immersive geological evolution dynamic simulation system can also be implemented as a virtual machine deployed on one or more devices in a cloud node. This virtual machine contains application software for managing various user terminals. Alternatively, this gesture-based immersive geological evolution dynamic simulation system can also be implemented as a server composed of numerous identical or different types of hardware devices, with one or more hardware devices configured to provide gesture-based immersive geological evolution dynamic simulation to various user terminals.

[0065] In terms of implementation, the gesture-based immersive geological evolution dynamic simulation system and the user terminal are mutually adaptable. That is, if the gesture-based immersive geological evolution dynamic simulation system is implemented as an application installed on a cloud service platform, then the user terminal is a client that establishes a communication connection with the application; or if the gesture-based immersive geological evolution dynamic simulation system is implemented as a website, then the user terminal is implemented as a webpage; or if the gesture-based immersive geological evolution dynamic simulation system is implemented as a cloud service platform, then the user terminal is implemented as a mini-program in an instant messaging application.

[0066] like Figure 1 The figure shown is a system architecture diagram of an immersive geological evolution dynamic simulation system based on gesture interaction provided in an embodiment of the present invention.

[0067] The gesture-based immersive geological evolution dynamic simulation system described in this invention can be hosted on a cloud server. In terms of implementation, it can function as one or more service devices, or as an application installed in the cloud (e.g., a mobile service operator's server or server cluster), or it can be developed as a website. Depending on the functions implemented, the gesture-based immersive geological evolution dynamic simulation system may include a multi-source geological data management and fusion module, a geological context intelligent reasoning module, a geological process dynamic simulation module, a user interaction command parsing and mapping module, a dynamic terrain rendering module, a geological data collaborative resource scheduling module, and a user interface presentation module. The modules described in this invention can also be referred to as units, which are a series of computer program segments that can be executed by an electronic device's processor and perform a fixed function, stored in the electronic device's memory.

[0068] In this embodiment of the invention, in the gesture-based immersive geological evolution dynamic simulation system, each of the above modules can be implemented independently and can call other modules. Here, "calling" can be understood as one module connecting to multiple modules of another type and providing corresponding services to those connected modules. For example, the user interface presentation module can call the same information acquisition module to obtain information collected by that module. Based on the above characteristics, in the gesture-based immersive geological evolution dynamic simulation system provided by this embodiment of the invention, without modifying the program code, the applicability of the gesture-based immersive geological evolution dynamic simulation system architecture can be adjusted by adding modules and directly calling them, achieving cluster-style horizontal expansion to quickly and flexibly expand the gesture-based immersive geological evolution dynamic simulation system. In practical applications, the above modules can be set in the same device or different devices, or they can be set in virtual devices, such as service instances in a cloud server.

[0069] Please refer to Example 1 Figure 1 As shown in this embodiment, the immersive geological evolution dynamic simulation system based on gesture interaction includes:

[0070] The multi-source geological data management and fusion module is used to collect raw data in real time based on the database, and perform spatial matching, attribute association and data fusion to obtain multi-source fused data;

[0071] Furthermore, the steps of real-time acquisition of raw data from the database, followed by spatial matching, attribute association, and data fusion, include:

[0072] S1.1: Collect raw data in real time based on the database to obtain the raw dataset, which includes user positioning data, user command recognition data and geological database;

[0073] It needs to be explained that user location data refers to the user's real-time latitude, longitude, and elevation coordinates obtained through the system's location service; user command recognition data refers to the rock type, color, and structure characteristics obtained after the user uses UI commands, where UI commands refer to, for example, the UI commands generated after the user clicks the "Recognize Current Rock" button; geological datasets refer to the high-precision geological maps and rock attribute databases pre-loaded by the system.

[0074] S1.2: Using the user location data in the original dataset as the query condition, perform spatial inclusion analysis on the high-precision geological map in the geological database to obtain the geological unit of the user's location, and obtain the rock attributes of the geological unit based on the rock attribute database to obtain a geological unit attribute report. At the same time, match the user command recognition data with the rock attribute database in the geological database to obtain a rock type probability report.

[0075] S1.3: Package user location data, user command identification data, geological unit attribute reports, and rock type probability reports to obtain multi-source fused data;

[0076] The geological context intelligent reasoning module is used to perform geological information reasoning based on multi-source fusion data and obtain a geological context reasoning report;

[0077] Furthermore, the steps for geological information reasoning based on multi-source fusion data include:

[0078] S2.1: The matching score is calculated based on multi-source fusion data. The specific formula for the calculation is as follows:

[0079] ;

[0080] Get matching score ,in, The total number of features participating in the comparison. For the first The weighting factors of each feature For comparison functions, For the first Each user command identifies feature values ​​in the data. For the first Characteristic values ​​in the attribute report of each geological unit;

[0081] It needs to be explained that the comparison function is used when... and When a match is found, the comparison function is set to 1; otherwise, the comparison function is set to 0.

[0082] S2.2: Sort the matching scores from largest to smallest, and select the rock type with the largest matching score as the final confirmed rock type;

[0083] S2.3: Based on the finally confirmed rock type, obtain the geological unit parameters and simulation parameters to which the finally confirmed rock type belongs, and obtain the geological context reasoning report;

[0084] It should be explained that geological unit parameters include, but are not limited to, the name, age, sedimentary environment description, and tectonic description of the geological unit; simulation parameters include, but are not limited to, the initial age, the main lithological code, and the inferred paleoenvironment type.

[0085] S2.4: Output the geological context reasoning report to the geological process dynamic simulation module and the user interface presentation module respectively;

[0086] The geological process dynamic simulation module is used to perform time and process simulation based on the geological context reasoning report to obtain a dynamic terrain data report.

[0087] Furthermore, the steps for time and process simulation based on geological context reasoning reports include:

[0088] S3.1: Retrieve the 3D digital elevation model network from the database and initialize the 3D digital elevation model network based on the simulation parameters in the geological context reasoning report and user positioning data;

[0089] S3.2: Based on the initialized three-dimensional digital elevation model network, and based on the geological context reasoning report and simulation time window, a simulation process report is obtained. The simulation process report includes tectonic movement simulation, river erosion simulation, glacial action simulation, weathering process simulation, and sedimentation process simulation.

[0090] It should be explained that, taking the tectonic motion simulation in the simulation process report as an example, the terrain elevation is obtained by applying vertical uplift / settlement data and horizontal strain to the three-dimensional digital elevation model network. The specific calculation formula is as follows: , obtain time step Topographic elevation at time ,in, For time steps The terrain elevation at that time For topographic uplift / subsidence data, To simulate a time window, for example, a time window of 10,000 years;

[0091] S3.3: Based on the timeline from far to near, sort all data items in the simulation process report to obtain a dynamic terrain data report;

[0092] S3.4: Output the dynamic terrain data report to the dynamic terrain rendering module, and output the simulation time window in step S3.2 to the user interaction command parsing and mapping module;

[0093] The user interaction instruction parsing and mapping module is used to parse and map the user interaction report, and output the mapping result to the geological process dynamic simulation module for secondary operation to obtain a new dynamic terrain data report.

[0094] Furthermore, the steps of parsing and mapping user interaction reports, and outputting the mapping results to the geological process dynamic simulation module for secondary operation include:

[0095] S4.1: Based on the user interface presentation module, obtain user interaction reports in real time;

[0096] It should be explained that user interaction reports include, but are not limited to, commands such as setting the simulation time window, playing, pausing, and resetting;

[0097] S4.2: Based on the user interaction report, the simulation control command is generated and output to the geological process dynamic simulation module for the geological process dynamic simulation module to adjust the dynamic terrain data report;

[0098] It should be explained that the function of step S4.2 is, for example, when the content of the user interaction report is to set the simulation time window, step S4.2 parses the setting simulation time window, generates a simulation control command for adjusting the simulation time window to the setting simulation time window, and outputs it to the geological process dynamic simulation module. When the geological process dynamic simulation module receives the simulation control command, the simulation time window in step S3.2 will be adjusted to the setting simulation time window, and the dynamic terrain data report at the time of the setting simulation time window will be presented to the user interaction interface module.

[0099] S4.3: Obtain the simulation time window output by the geological process dynamic simulation module and output it to the user interface presentation module to update the timeline display on the UI;

[0100] The dynamic terrain rendering module is used to perform dynamic layer detail processing based on dynamic terrain data reports and user view parameter reports to obtain a dynamic terrain image sequence.

[0101] Furthermore, the steps for dynamic hierarchical detail processing based on dynamic terrain data reports and user view parameter reports include:

[0102] S5.1: Based on the dynamic terrain data report and the user view parameter report, and simplifying the dynamic terrain data report according to the user view parameter report, a dynamic hierarchical processing report is obtained. The simplification method includes using a high-precision grid for areas close to the user viewpoint and a low-precision grid for areas far from the user viewpoint.

[0103] S5.2: Submit the dynamic hierarchy processing report to the GPU for processing to obtain a dynamic terrain image sequence. The processing includes the GPU executing shaders to render and blend the image frames in the dynamic hierarchy processing report for lighting, texture, and shadow.

[0104] S5.3: Output the dynamic terrain image sequence to the user interface presentation module;

[0105] The geological data collaborative resource scheduling module is used for data collaboration and rendering resource scheduling with other modules;

[0106] Furthermore, the steps for data collaboration and rendering resource scheduling with other modules include:

[0107] S6.1: Monitor the data transmission of other modules. Other modules refer to modules in the system excluding the geological data collaborative resource scheduling module.

[0108] It should be explained that the data in the data transfer refers to, for example, geological context reasoning reports, dynamic terrain data reports, and dynamic terrain image sequences; monitoring is used to ensure low latency and sequential transmission of data between other modules.

[0109] S6.2: Predict the user's jump operation, and generate advance calculation instructions and preloading instructions based on the prediction results according to the resource scheduler. Output the advance prediction instructions to the geological process dynamic simulation module and the preloading instructions to the dynamic terrain rendering module.

[0110] It should be explained that the prediction result refers to the prediction of the user's action at a certain point in time, such as when the user quickly drags the timeline;

[0111] The advance calculation instruction contains a set of characters representing a report of dynamic terrain data near the advance calculation prediction results;

[0112] The preload directive contains a set of texture resources representing the preloaded, pre-computed directives.

[0113] S6.3: Monitor the real-time load of the CPU and GPU, and adjust the power of the CPU and GPU according to the simulation intensity in step S3.2;

[0114] It should be explained that adjusting the power of the CPU and GPU is a priority to ensure the rendering frame rate;

[0115] The user interface presentation module is used to provide users with all interaction entry points and visual data, and to collect user interaction operations and user view parameters to obtain user interaction reports and user view parameter reports respectively.

[0116] Furthermore, the steps of providing users with all interactive entry points and visual data, and collecting user interaction operations and user view parameters include:

[0117] S7.1: Based on a dynamic terrain image sequence, a three-dimensional environment main view is constructed and displayed in real time through the device display;

[0118] S7.2: Integrate UI controls into the device display;

[0119] Real-time acquisition of geological context reasoning reports, and real-time display and playback on the device's screen in text and voice formats;

[0120] It should be noted that UI controls include, but are not limited to, timelines and buttons;

[0121] S7.3: When a user uses a UI control, the user's interaction is collected, a user interaction report is generated, and the report is output to the user interaction command parsing and mapping module.

[0122] S7.4: When the device starts up, it collects the user's view parameters in real time, obtains a user view parameter report, and outputs it to the dynamic terrain rendering module;

[0123] It should be explained that view parameters refer to data related to the user's line of sight, such as viewpoint position, line of sight direction, and field of view.

[0124] In this embodiment, the beneficial effects are achieved by acquiring raw data in real time based on a database, performing spatial matching, attribute association, and data fusion to obtain multi-source fused data. Geological information inference is then performed based on this multi-source fused data to generate a geological context inference report. Time and process simulation is then performed based on this geological context inference report to obtain a dynamic terrain data report. User interaction reports are parsed and parameter mapped, and the mapping results are output to the geological process dynamic simulation module for secondary processing to obtain a new dynamic terrain data report. Based on the dynamic terrain data report and the user view parameter report, dynamic hierarchical detail processing is performed to obtain a dynamic terrain image sequence. Data coordination and rendering resource scheduling are performed for other modules, providing users with all interactive entry points and visual data. User interaction operations and user view parameters are collected, generating user interaction reports and user view parameter reports respectively. This enables the system to achieve collaborative operation between the multi-source geological data management and fusion module and the geological context intelligent inference module. This invention achieves the goal of automatically generating a geological context reasoning report based on the user's real-time coordinates, on-site identification features, and geological database, significantly reducing the inaccuracies in geological scene display found in traditional systems. Furthermore, by establishing a dynamic geological process simulation module and a user interaction command parsing and mapping module, this invention enables users to move beyond the passive viewing limitations of traditional systems and actively explore geological knowledge. This not only meets the scientific needs of professionals but also provides a powerful and professional knowledge platform for general users. Finally, through the collaborative operation of the dynamic terrain rendering module and the geological data collaborative resource scheduling module, it ensures that users maintain a comfortable and immersive visual experience throughout the entire geological evolution simulation process, thereby fundamentally improving system reliability and user experience. Overall, this invention has significant advantages in ensuring the realism of geological scenes, providing excellent adaptive effects for user interaction content, and greatly enhancing the user experience.

[0125] Please refer to Example 2 Figure 2 As shown, the parts not described in detail in this embodiment are described in Embodiment 1. An immersive dynamic simulation method for geological evolution based on gesture interaction is provided. The method includes: S1: Real-time acquisition of raw data based on a database, and spatial matching, attribute association and data fusion to obtain multi-source fused data;

[0126] S2: Geological information reasoning is performed based on multi-source fusion data to obtain a geological context reasoning report;

[0127] S3: Based on the geological context reasoning report, perform time and process simulation to obtain a dynamic terrain data report;

[0128] S4: Parse and map parameters of the user interaction report, and output the mapping results to the geological process dynamic simulation module for secondary operation to obtain a new dynamic terrain data report;

[0129] S5: Based on the dynamic terrain data report and user view parameter report, perform dynamic hierarchical detail processing to obtain a dynamic terrain image sequence;

[0130] S6: Perform data collaboration and rendering resource scheduling with other modules;

[0131] S7: Provides users with all interaction entry points and visual data, and collects user interaction operations and user view parameters to obtain user interaction reports and user view parameter reports respectively.

[0132] The foregoing has only described certain exemplary embodiments of the present invention by way of illustration. Undoubtedly, those skilled in the art can modify the described embodiments in various ways without departing from the spirit and scope of the present invention. Therefore, the above drawings and descriptions are illustrative in nature and should not be construed as limiting the scope of protection of the present invention.

Claims

1. An immersive geologic evolution dynamic modeling system based on gesture interaction, characterized in that, The system comprises a geological process dynamic simulation module, a user interaction instruction analysis and mapping module, and a dynamic terrain rendering module, wherein: The geological process dynamic simulation module is configured to perform time and process simulation based on the geological context reasoning report to obtain a dynamic terrain data report; The step of performing time and process simulation based on the geological context reasoning report comprises: S3.1: based on the database, a three-dimensional digital elevation model network is called, and the three-dimensional digital elevation model network is initialized according to the simulation parameters and user positioning data in the geological context reasoning report; S3.2: based on the initialized three-dimensional digital elevation model network, simulation is performed according to the geological context reasoning report and the simulation time window to obtain a simulation process report, the simulation process report comprising tectonic movement simulation, river erosion simulation, glacial action simulation, weathering process simulation, and deposition process simulation; S3.3: based on the timeline from far to near, all data items in the simulation process report are sorted to obtain a dynamic terrain data report; S3.4: the dynamic terrain data report is output to the dynamic terrain rendering module, and the simulation time window in step S3.2 is output to the user interaction instruction analysis and mapping module; The user interaction instruction analysis and mapping module is configured to analyze and map the user interaction report, and output the mapping result to the geological process dynamic simulation module for secondary running to obtain a new dynamic terrain data report; The step of analyzing and mapping the user interaction report, and outputting the mapping result to the geological process dynamic simulation module for secondary running comprises: S4.1: based on the user interaction interface presentation module, the user interaction report is obtained in real time; S4.2: based on the user interaction report, simulation control instructions are generated and output to the geological process dynamic simulation module for adjusting the dynamic terrain data report by the geological process dynamic simulation module; S4.3: the simulation time window output by the geological process dynamic simulation module is obtained and output to the user interaction interface presentation module for updating the time axis display on the UI; The dynamic terrain rendering module is configured to perform dynamic level detail processing based on the dynamic terrain data report and a user view parameter report to obtain a dynamic terrain image sequence; The step of performing dynamic level detail processing based on the dynamic terrain data report and the user view parameter report comprises: S5.1: based on the dynamic terrain data report and the user view parameter report, the dynamic terrain data report is simplified according to the user view parameter report to obtain a dynamic level processing report, the simplification including using high-precision grids for areas close to the user's viewpoint and using low-precision grids for areas far from the user's viewpoint; S5.2: the dynamic level processing report is submitted to a GPU for processing to obtain a dynamic terrain image sequence, the processing including rendering and fusing of light, texture, and shadow on the image frames in the dynamic level processing report by the GPU executing a shader; S5.3: the dynamic terrain image sequence is output to the user interaction interface presentation module.

2. The gesture-interaction-based immersive geologic evolution dynamic modeling system of claim 1, wherein, The system further comprises a multi-source geological data management fusion module, a geological context intelligent reasoning module, a geological data collaborative resource scheduling module and a user interaction interface presentation module, wherein: The multi-source geological data management fusion module is configured to collect raw data in real time based on a database, and perform spatial matching, attribute association and data fusion to obtain multi-source fusion data; The geological context intelligent reasoning module is configured to perform geological information reasoning based on the multi-source fusion data to obtain a geological context reasoning report; The geological data collaborative resource scheduling module is configured to perform data collaboration and rendering resource scheduling on other modules; The user interaction interface presentation module is configured to provide all interaction entrances and visual data for a user, and collect user interaction operations and user view parameters to obtain a user interaction report and a user view parameter report, respectively.

3. The gesture-interaction-based immersive geologic evolution dynamic modeling system of claim 2, wherein, The steps of collecting raw data in real time based on a database, and performing spatial matching, attribute association and data fusion include: S1.1: Collecting raw data in real time based on a database to obtain a raw data set, wherein the raw data includes user positioning data, user instruction recognition data and a geological database; S1.2: Taking the user positioning data in the raw data set as a query condition, performing spatial inclusion analysis on a high-precision geological map in the geological database to obtain a geological unit where the user is located, and obtaining rock attributes of the geological unit according to a rock attribute database to obtain a geological unit attribute report, and meanwhile, matching the user instruction recognition data with a rock attribute database in the geological database to obtain a rock type possibility report; S1.3: Packaging the user positioning data, the user instruction recognition data, the geological unit attribute report and the rock type possibility report to obtain multi-source fusion data.

4. The gesture-interaction-based immersive geologic evolution dynamic modeling system of claim 3, wherein, The steps of performing geological information reasoning based on multi-source fusion data include: S2.1: Performing calculation based on the multi-source fusion data to obtain a matching score; S2.2: Sorting the matching scores from large to small, and selecting a rock type with the largest matching score value as a final confirmed rock type; S2.3: Based on the final confirmed rock type, obtaining geological unit parameters and simulation parameters of the final confirmed rock type to obtain a geological context reasoning report; S2.4: Outputting the geological context reasoning report to a geological process dynamic simulation module and a user interaction interface presentation module, respectively.

5. The gesture-interaction-based immersive geologic evolution dynamic modeling system of claim 2, wherein, The steps of performing data collaboration and rendering resource scheduling on other modules include: S6.1: Monitoring data transmission of other modules, wherein the other modules refer to modules in the system except the geological data collaborative resource scheduling module; S6.2: Predicting a user's jump operation, and generating an early calculation instruction and a preloading instruction according to a resource scheduler based on the prediction result, outputting the early prediction instruction to the geological process dynamic simulation module, and outputting the preloading instruction to a dynamic terrain rendering module; The early calculation instruction includes a group of characters representing dynamic terrain data reports near the early calculation prediction result; The preloading instruction includes a group of texture resources representing preloading of the early calculation instruction related resources; S6.3: Real-time monitoring of the load of CPU and GPU, and adjusting the power of CPU and GPU according to the simulation strength in step S3.

2.

6. The gesture-interaction-based immersive geologic evolution dynamic modeling system of claim 5, wherein, The step of providing all interactive entrances and visual data for the user and collecting the interactive operation of the user and the view parameter of the user comprises: S7.1: Based on the dynamic terrain image sequence, a three-dimensional environment main view is constructed and displayed in real time through the device display. S7.2: Integrating UI controls in the device display; Real-time acquisition of the geological context inference report, and real-time display and playing through the device display in the form of text and voice; S7.3: When the user uses the UI control, the interactive operation of the user is collected, a user interaction report is generated, and output to the user interaction instruction analysis mapping module; S7.4: When the device starts, the view parameter of the user is collected in real time, a user view parameter report is obtained, and output to the dynamic terrain rendering module.

7. The immersive geologic evolution dynamic simulation method based on gesture interaction according to any one of claims 1-6, implemented by the immersive geologic evolution dynamic simulation system based on gesture interaction, characterized in that, The following working steps are included: S1: Real-time acquisition of original data based on the database, and spatial matching, attribute association and data fusion to obtain multi-source fusion data; S2: Based on the multi-source fusion data, the geological information is inferred to obtain the geological context inference report; S3: Based on the geological context inference report, time and process simulation is carried out to obtain a dynamic terrain data report; S4: Analyzing and parameter mapping of the user interaction report, and outputting the mapping result to the geological process dynamic simulation module for secondary operation to obtain a new dynamic terrain data report; S5: Based on the dynamic terrain data report and the user view parameter report, dynamic hierarchical detail processing is carried out to obtain a dynamic terrain image sequence; S6: Data collaboration and rendering resource scheduling of other modules; S7: Providing all interactive entrances and visual data for the user, and collecting the interactive operation of the user and the view parameter of the user to obtain a user interaction report and a user view parameter report respectively.

Images