Immersive hardware and software path verification method and system

By applying virtual reality technology in hardware and software path verification, intelligent three-dimensional modeling and multi-frame three-dimensional scene three-dimensional presentation technology are used to solve the problems of high costs and long cycles in the existing technology, and efficient and economical hardware and software path verification is achieved.

CN119739290APending Publication Date: 2025-04-01BEIHANG UNIV
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411825004.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-12
Publication Date
2025-04-01

AI Technical Summary

Technical Problem

When faced with complex systems and high-tech equipment, existing hardware and software path verification methods have problems of high costs, long cycles and complex components coordination, making it difficult to effectively reduce hardware costs and verification time.

Method used

Combining virtual reality technology, intelligent three-dimensional modeling, multi-frame three-dimensional scene three-dimensional presentation technology, deformable three-dimensional scene projection presentation technology, etc., we build an immersive hardware path verification environment, and simulate the hardware operation environment through virtual reality technology to achieve high-precision hardware path verification.

Benefits of technology

Through virtual reality technology, hardware costs and space limitations are significantly reduced, verification cycles are shortened, verification efficiency is improved, testing costs are reduced, and flexible multi-scene and multi-level verification methods are provided.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119739290A_ABST
    Figure CN119739290A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses an immersive hardware and software path verification method and system. A specific embodiment of the method comprises the following steps: acquiring space calculation data, pose and gesture data and depth data according to a depth distance sensor, a 4K high-definition sensor, a graphic rendering workstation and an optical imaging projection lens included in a hardware layer; performing data processing and storage on the system data; in the functional layer, through verification demonstration of intelligent three-dimensional scene modeling and deformable three-dimensional scene projection presentation technology and verification demonstration of multi-breadth three-dimensional scene stereo imaging technology, high-precision simulation is carried out on the operation process of a hardware and software path. According to the embodiment, the hardware and software paths can be checked from multiple angles and multiple levels, potential problems are found in time, adjustment and optimization are carried out in time in the design stage, and therefore the test cost is reduced, and the verification efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of immersive three-dimensional modeling presentation and interactive technology, and specifically to an immersive hardware and software path verification method and system. Background Art

[0002] Hardware and software path verification refers to the technical means and processes for comprehensive testing and verification of the functional implementation and performance of hardware and software in software development or system integration. Existing hardware and software path verification methods rely heavily on building a comprehensive and detailed hardware and software environment. This traditional verification method has certain limitations when facing high-tech equipment, especially when it comes to complex systems, precision instruments or large-scale integrated equipment. First, the cost of testing and verification is high, which not only includes the cost of purchasing and maintaining high-end hardware equipment, but also covers the cost of software development, system integration and continuous updates. Secondly, the construction of a complete verification environment takes a long time. From demand analysis to hardware and software environment construction, to the writing and execution of test scripts, each link requires a lot of time and manpower investment. In addition, with the rapid development of technology, the rapid iteration of hardware and software platforms has accelerated the update frequency of the verification environment, further exacerbating the problem of cost and time.

[0003] In recent years, virtual reality technology has demonstrated strong advantages in three-dimensional simulation and immersive demonstration. It can use advanced computer graphics, human-computer interaction technology and sensing equipment to generate highly realistic virtual environments, giving users an immersive experience. It can also simulate the operating logic and interactive feedback of complex systems, providing new solutions for hardware and software path verification.

[0004] Therefore, how to combine virtual reality technology with hardware and software path verification and build a hardware and software path simulation environment based on virtual reality has become a key issue that needs to be solved urgently. It will greatly reduce the hardware cost and space limitations required by traditional path verification methods, while shortening the verification cycle.

[0005] The technical problems solved by the present disclosure are:

[0006] The difficulties faced by the immersive hardware and software path verification method and system combined with virtual reality technology are mainly reflected in two aspects, including modeling realistic hardware and software environment and coordinating hardware and software. Specifically:

[0007] Modeling realistic hardware and software environments: To build a virtual environment that can accurately reflect the actual hardware and software operating status, it is first necessary to ensure the high accuracy of the model. How to combine intelligent 3D modeling technology, immersive presentation and interaction technology to model the geometry and interaction of the hardware and software environment is one of the technical problems to be solved by this disclosure.

[0008] Coordination of hardware and software: Coordination of hardware and software is a major obstacle in the verification process of hardware and software paths. Since the system integrates multiple complex components such as algorithm software, hardware environment, and three-dimensional scenes, the interaction and collaboration between these components are also particularly complex. The algorithm software needs to accurately control the operation of the hardware equipment, and the performance and stability of the hardware equipment directly affect the execution effect of the software algorithm. This coupling relationship requires that hardware and software need to be deeply considered in collaboration at the beginning of the design, which increases the uncertainty and difficulty of the verification process.

[0009] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art. Summary of the invention

[0010] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0011] Some embodiments of the present disclosure propose an immersive hardware-software path verification method and system to solve one or more of the technical problems mentioned in the above background technology section.

[0012] Some embodiments of the present disclosure provide an immersive hardware and software pathway verification method, the method comprising: according to the depth distance sensor, 4K high-definition sensor, graphics rendering workstation and optical imaging projection lens included in the above-mentioned hardware layer, collecting spatial calculation data, posture and gesture data, and depth data as system data; according to the model data storage management, simulation business data management and configuration data management included in the above-mentioned storage layer, processing and storing the system data; according to the above-mentioned technical module layer including multi-format three-dimensional scene stereoscopic presentation technology, deformable three-dimensional scene projection presentation technology, CAVE adaptation technology, touch interaction technology, body posture interaction technology and three-dimensional modeling technology, at the above-mentioned functional layer, through intelligent three-dimensional scene modeling, deformation The verification demonstration of the projection presentation technology of the three-dimensional scene and the verification demonstration of the stereoscopic imaging technology of the multi-format three-dimensional scene is used to perform a high-precision simulation of the operation process of the hardware and software pathway.

[0013] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the immersive hardware and software path verification method of some embodiments of the present disclosure, through a variety of interactive technologies, three-dimensional modeling technology and other virtual reality technologies, spatial calculation data, posture and gesture data, depth data and other system data are collected, processed and stored, and with the support of CAVE adaptation technology and the above-mentioned system data, multi-format three-dimensional scene stereoscopic presentation technology and deformable three-dimensional scene projection presentation technology are used to perform high-precision simulation of the operation process of the hardware and software path. Some embodiments of the present disclosure enable users to intuitively observe, analyze and verify the functions and performance of the hardware and software paths in a virtual environment. By constructing a multi-dimensional virtual scene, users can inspect the path from multiple angles and multiple levels, discover potential problems in time, and make timely adjustments and optimizations in the design stage, thereby reducing testing costs and improving verification efficiency. In addition, some embodiments of the present disclosure simulate the real hardware and software operating environment through virtual reality technology, avoiding a large amount of expensive hardware procurement and construction costs. Traditional hardware and software path verification methods usually rely on high-cost physical equipment, while the present disclosure can perform high-precision modeling in virtual space, significantly reducing hardware investment and maintenance costs in the verification process, and achieving a more economical verification method. Finally, the present disclosure enables users to quickly conduct multi-scenario and multi-level verification through an immersive virtual environment, thereby saving the verification time of complex hardware and software pathways. Unlike the periodic updates and time-consuming operations of traditional verification methods, the immersive hardware and software pathways can be adjusted and optimized at any time, and users can obtain test results efficiently and conveniently, bringing great flexibility and time advantages to the verification process. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0015] Figure 1 is a flow chart of some embodiments of the immersive hardware and software path verification method according to the present disclosure;

[0016] Figure 2 It is a schematic diagram of the structure of some embodiments of the immersive hardware and software path verification system according to the present disclosure.

[0017] Figure 3 is a hardware and software deployment diagram according to some embodiments of the immersive hardware and software path verification method of the present disclosure.

[0018] Figure 4 It is a smart 3D modeling flowchart according to some embodiments of the immersive hardware and software path verification method disclosed in the present invention.

[0019] Figure 5 It is a flowchart of a verification demonstration of a deformable three-dimensional scene projection presentation technology according to some embodiments of the immersive hardware and software path verification method disclosed herein. DETAILED DESCRIPTION

[0020] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0021] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0022] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0023] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0024] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0025] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0026] Figure 1 The process 100 of some embodiments of the immersive hardware and software path verification method according to the present disclosure is shown. The immersive hardware and software path verification method comprises the following steps:

[0027] Step 101, according to the depth distance sensor, 4K high-definition sensor, graphics rendering workstation and optical imaging projection lens included in the hardware layer, spatial calculation data, posture and gesture data, and depth data are collected as system data. The above-mentioned immersive hardware and software path verification method is applied to the immersive hardware and software path verification system, and the above-mentioned immersive hardware and software path verification system includes a hardware layer, a storage layer, a technical module layer, and a functional layer.

[0028] The hardware layer, as the cornerstone of the verification system, is the hardware equipment and computing environment required for path verification, including depth distance sensors, 4K high-definition sensors, graphics rendering workstations, and optical imaging projection lenses. Among them, the depth distance sensor and 4K high-definition sensor obtain depth data, interaction data, etc. to provide the necessary data input for the system; the graphics rendering workstation realizes the rendering calculation of the scene; and the optical imaging projection lens is used to display the rendering output.

[0029] The storage layer provides services for data storage, including model data storage management, simulation business data management, and configuration data management. The system data stored at this level, such as 3D modeling data, depth data, posture and gesture data, provide data support for interaction, rendering and other processing.

[0030] The technical module layer provides technical support for the functional layer, including multi-format 3D scene stereoscopic presentation technology, deformable 3D scene projection presentation technology, CAVE adaptation technology, touch interaction technology, body posture interaction technology, and 3D modeling technology. Among them, multi-format 3D scene stereoscopic presentation technology realizes multi-view and multi-dimensional image output; deformable 3D scene projection presentation technology is used for dynamic adjustment and deformation of 3D scenes; CAVE adaptation technology is optimized for immersive virtual environments; touch interaction technology supports touch interaction such as gesture recognition; body posture interaction technology uses posture sensing equipment to capture user posture; and 3D modeling technology realizes high-quality modeling and restoration of scenes.

[0031] The functional layer consists of the core functions of the system, including intelligent 3D scene modeling, verification and demonstration of deformable 3D scene projection presentation technology, and verification and demonstration of multi-format 3D scene stereo imaging technology.

[0032] Step 102 , according to the model data storage management, simulation business data management and configuration data management included in the storage layer, the system data is processed and stored.

[0033] Step 103, according to the technical module layer including multi-format three-dimensional scene stereoscopic presentation technology, deformable three-dimensional scene projection presentation technology, CAVE adaptation technology, touch interaction technology, body posture interaction technology and three-dimensional modeling technology, at the functional layer, through intelligent three-dimensional scene modeling, deformable three-dimensional scene projection presentation technology verification demonstration and multi-format three-dimensional scene stereo imaging technology verification demonstration, the operation process of the hardware and software pathways is simulated with high precision.

[0034] Intelligent 3D scene modeling intelligently models 3D scenes based on input spatial data, including digital elevation data modeling, geographic vector data modeling and image data modeling. The three types of modeling are as follows:

[0035] Digital elevation data modeling, which uses the collected terrain elevation data to intelligently generate a three-dimensional model of the surface, namely the digital elevation model. Specifically, after data cleaning and coordinate conversion, the discrete elevation points are converted into a continuous terrain model through an intelligent modeling algorithm to generate a grid or irregular triangulated mesh. The generated DEM is used to construct a three-dimensional scene through modeling tools;

[0036] Geographic vector data modeling, which is to create a digital geographic environment model by collecting geographic data to characterize the shape and position of geographic surface elements. Specifically, geographic data includes geographic information systems, ground measurements, and remote sensing images. After preprocessing and coordinate conversion, an accurate vector data model is formed;

[0037] Satellite remote sensing image modeling generates a surface model by collecting images of the earth's surface taken by satellites. Satellite remote sensing images capture surface features, terrain, vegetation, and water bodies. Specifically, the acquired satellite remote sensing images are subjected to geometric correction, radiation correction, and atmospheric correction to eliminate noise and errors in the images. Through image classification technology or image segmentation algorithms, different types of land objects in the image are identified and key geographic information is extracted. Intelligent modeling is performed based on the processed images to generate accurate surface models.

[0038] Through intelligent 3D scene modeling methods combined with intelligent modeling technology, it is possible to construct realistic 3D scenes from terrain elevation data, geographic data, satellite remote sensing and other image data.

[0039] The verification demonstration of deformable 3D scene projection rendering technology uses CAVE immersive space to simulate the hardware and software pathways of deformable 3D scene projection rendering technology, including touch interaction and posture interaction demonstration based on deformable 3D scene projection rendering technology, and 3D scene immersive rendering demonstration based on deformable 3D scene projection rendering technology:

[0040] Touch interaction, posture interaction and voice interaction demonstration based on deformable 3D scene projection presentation technology, through collecting data from multiple terminal devices as interactive operations, dynamically interacting with the deformable 3D scene;

[0041] The immersive presentation of three-dimensional scenes based on deformable three-dimensional scene projection presentation technology is responsible for reading the three-dimensional scene height data, dynamically modifying the height of the matrix grid units in the three-dimensional scene through matrix algorithms and distributed algorithms, and combining projection technology to modularize the scene elements into a three-dimensional scene.

[0042] The verification demonstration of multi-frame 3D scene stereo imaging technology uses CAVE immersive space to simulate the hardware and software pathways of multi-frame 3D scene stereo imaging technology, including touch interaction and posture interaction demonstration based on multi-frame 3D scene stereo imaging technology, and immersive presentation demonstration of 3D scenes based on multi-frame 3D scene stereo imaging technology:

[0043] The touch interaction demonstration, posture interaction demonstration and voice interaction demonstration based on multi-frame three-dimensional scene stereo imaging technology include: in the touch interaction demonstration, the user interacts with the scene through the touch device and issues various command operations for the scene; in the posture interaction demonstration, the system calculates the user's movement and spatial state information to achieve real-time tracking of personnel; the position information is used to schedule the rendering output of the screen in real time, and the user moves freely in the space. The system uses the position information to render and transform in real time, completely simulating the perspective change and visual effect of the relative movement of people and objects in the real environment, and achieving free perspective, scene following people, and immersive display effects; in the voice interaction demonstration, the user issues commands through voice recognition technology, and the system understands the semantics of the voice commands and makes corresponding responses;

[0044] The immersive presentation of three-dimensional scenes based on multi-frame three-dimensional scene stereo imaging technology uses three-dimensional reconstruction and image rendering technology to ensure the accurate reproduction of three-dimensional models to virtualize the real environment; immersive perception of the architectural structure, facility layout and surrounding environment of the real environment; the engine is used to render lighting, reflection, shadow, etc., combined with spatial perception technology, so that the user can adjust the perspective and surrounding scenes in real time with each movement in the virtual environment to ensure a smooth immersive experience.

[0045] Further references Figure 2 As an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of an immersive hardware and software path verification system. These system embodiments are Figure 1 Corresponding to the method embodiments shown, the immersive hardware-software path verification system can be specifically applied to various electronic devices.

[0046] like Figure 2 As shown, the immersive hardware and software path verification system of some embodiments includes: a hardware layer, a storage layer, a technical module layer and a functional layer. Among them, the above-mentioned hardware layer includes a depth distance sensor, a 4K high-definition sensor, a graphics rendering workstation, and an optical imaging projection lens, which are used to achieve the hardware equipment and computing environment required for path verification; the above-mentioned storage layer includes model data storage management, simulation business data management, and configuration data management, which are used to provide services for data storage; the above-mentioned technical module layer includes multi-format three-dimensional scene stereoscopic presentation technology, deformable three-dimensional scene projection presentation technology, CAVE adaptation technology, touch interaction technology, body posture interaction technology, and three-dimensional modeling technology, which are used to provide technical support for the functional layer; the above-mentioned functional layer includes intelligent three-dimensional scene modeling, verification demonstration of deformable three-dimensional scene projection presentation technology, and verification demonstration of multi-format three-dimensional scene stereo imaging technology.

[0047] It is understood that the units and references recorded in the immersive hardware and software path verification system Figure 1 Therefore, the operations, features and beneficial effects described above for the method are also applicable to the immersive hardware and software path verification system and the units contained therein, and will not be described in detail here.

[0048] Figure 3 It is a hardware and software deployment diagram of some embodiments of the immersive hardware and software path verification method disclosed in the present invention. As shown in the figure, when the user carries out the verification task through the immersive hardware and software path verification system, on the one hand, the multi-light path projection and depth sensor collect the user's space, posture and other information, and transmit the spatial calculation results, posture gestures and depth data to the interactive processing module; on the other hand, the user's voice command is also transmitted to the interactive processing module. After receiving the data, the interactive processing module calls the voice processing module and the data module to analyze and process the data, and then transmits the interactive feedback data to the graphics rendering module. After rendering, the screen output needs to be transmitted to the multi-light path projection and multi-format display devices respectively, and the real-time rendering data is returned to the data module.

[0049] Figure 4 This is a flow chart of intelligent 3D modeling according to some embodiments of the immersive hardware and software path verification method disclosed in the present invention. First, the system acquires spatial data by collecting relevant devices and sensors, and inputs it into the intelligent modeling algorithm program; then, the modeling algorithm implements digital elevation data modeling, geographic vector data modeling, and image data modeling according to the data type; finally, the algorithm outputs the modeling results to complete the business process of intelligent 3D modeling.

[0050] Figure 5 This is a flow chart of the verification demonstration of the deformable three-dimensional scene projection presentation technology according to some embodiments of the immersive hardware and software path verification method disclosed in the present invention. First, the user needs to start the system of some embodiments of the present invention and the tablet management terminal used for interaction; then, the user needs to choose one of the deformable three-dimensional scene projection presentation technology and the multi-format three-dimensional scene stereo imaging technology as the demonstration mode of the system; next, the user needs to select the demonstration scene to be presented by the system; finally, after the above operations of the user, the system renders the demonstration effect in real time, and can synchronously receive user interaction instructions and feedback the effect of the interaction. After the user exits, the demonstration ends.

[0051] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) and the technical solutions formed.

Claims

1. An immersive hardware and software path verification method, applied to an immersive hardware and software path verification system, the immersive hardware and software path verification system comprising a hardware layer, a storage layer, a technology module layer, and a function layer, the method comprising: According to the depth distance sensor, 4K high-definition sensor, graphics rendering workstation and optical imaging projection lens included in the hardware layer, spatial calculation data, posture and gesture data, and depth data are collected as system data; Process and store system data according to the model data storage management, simulation business data management and configuration data management included in the storage layer; According to the technical module layer including multi-format three-dimensional scene stereoscopic presentation technology, deformable three-dimensional scene projection presentation technology, CAVE adaptation technology, touch interaction technology, body posture interaction technology and three-dimensional modeling technology, at the functional layer, through the verification demonstration of intelligent three-dimensional scene modeling, deformable three-dimensional scene projection presentation technology and multi-format three-dimensional scene stereoscopic imaging technology, the operation process of the hardware and software pathways is simulated with high precision.

2. The method according to claim 1, wherein: The intelligent three-dimensional scene modeling includes: Intelligent 3D scene modeling intelligently models 3D scenes based on input spatial data, including digital elevation data modeling, geographic vector data modeling and image data modeling. The three types of modeling are as follows: Digital elevation data modeling, which uses the collected terrain elevation data to intelligently generate a three-dimensional model of the surface, namely the digital elevation model. Specifically, after data cleaning and coordinate conversion, the discrete elevation points are converted into a continuous terrain model through an intelligent modeling algorithm to generate a grid or irregular triangulated mesh. The generated DEM is used to construct a three-dimensional scene through modeling tools; Geographic vector data modeling, which is to create a digital geographic environment model by collecting geographic data to characterize the shape and position of geographic surface elements. Specifically, geographic data includes geographic information systems, ground measurements, and remote sensing images. After preprocessing and coordinate conversion, an accurate vector data model is formed; Satellite remote sensing image modeling generates a surface model by collecting images of the earth's surface taken by satellites. Satellite remote sensing images capture surface features, terrain, vegetation, and water bodies. Specifically, the acquired satellite remote sensing images are subjected to geometric correction, radiation correction, and atmospheric correction to eliminate noise and errors in the images. Through image classification technology or image segmentation algorithms, different types of land objects in the image are identified and key geographic information is extracted. Intelligent modeling is performed based on the processed images to generate accurate surface models.

3. The method according to claim 1, wherein: The verification demonstration of the deformable three-dimensional scene projection presentation technology includes: The verification demonstration of deformable 3D scene projection rendering technology uses CAVE immersive space to simulate the hardware and software pathways of deformable 3D scene projection rendering technology, including touch interaction and posture interaction demonstration based on deformable 3D scene projection rendering technology, and 3D scene immersive rendering demonstration based on deformable 3D scene projection rendering technology: Touch interaction, posture interaction and voice interaction demonstration based on deformable 3D scene projection presentation technology, through collecting data from multiple terminal devices as interactive operations, dynamically interacting with the deformable 3D scene; The immersive presentation of three-dimensional scenes based on deformable three-dimensional scene projection presentation technology is responsible for reading the three-dimensional scene height data, dynamically modifying the height of the matrix grid units in the three-dimensional scene through matrix algorithms and distributed algorithms, and combining projection technology to modularize the scene elements into a three-dimensional scene.

4. The method according to claim 1, wherein: The verification demonstration of the multi-format three-dimensional scene stereo imaging technology includes: The verification demonstration of multi-frame 3D scene stereo imaging technology uses CAVE immersive space to simulate the hardware and software pathways of multi-frame 3D scene stereo imaging technology, including touch interaction and posture interaction demonstration based on multi-frame 3D scene stereo imaging technology, and immersive presentation demonstration of 3D scenes based on multi-frame 3D scene stereo imaging technology: The touch interaction demonstration, posture interaction demonstration and voice interaction demonstration based on multi-frame three-dimensional scene stereo imaging technology include: in the touch interaction demonstration, the user interacts with the scene through the touch device and issues various command operations for the scene; in the posture interaction demonstration, the system calculates the user's movement and spatial state information to achieve real-time tracking of personnel; the position information is used to schedule the rendering output of the screen in real time, and the user moves freely in the space. The system uses the position information to render and transform in real time, completely simulating the perspective change and visual effect of the relative movement of people and objects in the real environment, and achieving free perspective, scene following people, and immersive display effects; in the voice interaction demonstration, the user issues commands through voice recognition technology, and the system understands the semantics of the voice commands and makes corresponding responses; The immersive presentation of three-dimensional scenes based on multi-frame three-dimensional scene stereo imaging technology uses three-dimensional reconstruction and image rendering technology to ensure the accurate reproduction of three-dimensional models to virtualize the real environment; immersive perception of the architectural structure, facility layout and surrounding environment of the real environment; the engine is used to render lighting, reflection, shadow, etc., combined with spatial perception technology, so that the user can adjust the perspective and surrounding scenes in real time with each movement in the virtual environment to ensure a smooth immersive experience.

5. An immersive hardware and software path verification system, the immersive hardware and software path verification system comprising a hardware layer, a storage layer, a technology module layer, and a function layer, wherein: The hardware layer includes a depth distance sensor, a 4K high-definition sensor, a graphics rendering workstation, and an optical imaging projection lens, which are used to achieve the hardware equipment and computing environment required for path verification; The storage layer includes model data storage management, simulation business data management, and configuration data management, which are used to provide services for data storage; The technical module layer includes multi-format 3D scene stereoscopic presentation technology, deformable 3D scene projection presentation technology, CAVE adaptation technology, touch interaction technology, body posture interaction technology, and 3D modeling technology, which are used to provide technical support for the functional layer; The functional layer includes intelligent 3D scene modeling, verification and demonstration of deformable 3D scene projection presentation technology, and verification and demonstration of multi-format 3D scene stereo imaging technology.

Citation Information

Patent Citations

  • Immersion type nuclear power plant main equipment process simulation deduction method and system

    CN110299042A

  • CAVE rescue scene construction method and system based on digital twinning and holographic technology

    CN118918293A