Access type simulation operation interaction system based on VR virtual reality

Abstract

The invention relates to the technical field of virtual reality, particularly discloses an entry type simulation operation interaction system based on VR virtual reality, and aims to solve the problems that traditional CAD software is insufficient in visualization, low in interaction efficiency, high in cooperation threshold, not timely in verification feedback and the like in three-dimensional design. The system comprises three modules, namely a sensing operation system, a three-dimensional space positioning system and a multi-mode instruction processing system, through the three modules, an operator can immersively enter a model environment through a VR virtual reality technology, a mapping relation between a virtual body coordinate system of the operator and a model reference coordinate system can be established through a positioning system, a model is operated through actions or languages of the body of the operator, model parameter change is directly triggered, and the operation efficiency is improved. And the operation process is in real-time linkage change. An operating system in the field of three-dimensional design is optimized, immersion and intuition in the working and designing process are improved, and the working efficiency of operators is remarkably improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of virtual reality technology, and particularly relates to an entering type simulation operation interaction system based on VR virtual reality. BACKGROUND

[0002] Currently, three-dimensional design in the fields of building, electronics, machinery and industrial equipment design mainly relies on traditional CAD software, and designers and other users need to operate three-dimensional models through two-dimensional screens, and cannot clearly perceive the spatial proportion and whether the structure is reasonable or not. The modification of the model relies on the input of the mouse and keyboard, and it is difficult to quickly adjust complex structures.

[0003] At present, there are many problems in the actual application of traditional three-dimensional design tools. Such tools generally have insufficient visualization effect, which makes it difficult for users to intuitively perceive the spatial correlation and structural rationality of the model, making it difficult to grasp the details of each component during the design process. Moreover, the interactive mode is relatively single, the operation process is complex, which greatly reduces the work design efficiency and prolongs the working time. These problems limit the efficiency improvement and industry application expansion in the field of three-dimensional design, and cannot meet the actual needs of efficient, intuitive and convenient design schemes in the current field. SUMMARY

[0004] The purpose of the present application is to provide an entering type simulation operation interaction system based on VR virtual reality.

[0005] To achieve the above purpose, the present application provides the following technical solutions: An entering type simulation operation interaction system based on VR virtual reality, comprising: a) Sensing operation system: the operator enters the model environment in situ through VR virtual reality technology; b) Three-dimensional space positioning system: the mapping relationship between the model virtual coordinate system and the model reference coordinate system is established through the positioning system; c) Multi-modal instruction processing system: the model parameters are directly triggered by the operator's body movements or language operation model, and the operation process is changed in real time.

[0006] Preferably, a scale adjustment module is included for the operator to scale down or up in the virtual scene and dynamically load the corresponding precision model details according to the scale.

[0007] Preferably, the multi-modal instruction processing system is configured to recognize the operator's limb operation, eye movement or language instruction, and modify the parameters of the 3D model based on the instruction.

[0008] Preferably, an extensible instruction library module is included, allowing users to customize action instructions and bind to specific operation actions; and a voice interaction module is included for invoking a command menu or generating a description through voice.

[0009] Preferably, a risk visualization and alarm module is included, which is configured to present the high and low of stress or risk through different color scales on the helmet display, and trigger different levels of alarm reminders when detecting physical collision conflicts or errors violating preset design rules.

[0010] Preferably, a field perspective operation module is included, which is configured to allow users to enter the virtual design environment with a field perspective inside the model, grab virtual objects through drag-and-drop operations, and place them to target positions.

[0011] Preferably, a block assembly module is included, which is configured to allow users to combine predefined modular components in a block-by-block manner to form a three-dimensional model.

[0012] Preferably, in the three-dimensional space positioning system, a mapping relationship between the virtual coordinate system of the operator and the operator reference coordinate system can also be established through the positioning system. The present application improves and optimizes the operating system in the field of three-dimensional design, directly operates three-dimensional models through immersive interaction, shortens the display time of complex pipeline layout design, reduces the error rate, avoids rework caused by neglecting bearing or physical problems in traditional design through real-time physical verification function, improves the immersion and intuitiveness in the working and design process, and enables the operator to more intuitively see the rationality between the spatial relationship and structure of the design drawing, significantly improving the design interaction efficiency of the operator.

[0013] In addition, the present application can reduce the professional threshold of design operation, enable more non-professional personnel to participate in design, also ensure the safety and traceability of operation records, and improve the efficiency and work experience of three-dimensional design work.

[0014] The above description is only a summary of the technical solutions of the present application, in order to more clearly understand the technical means of the present application, and can be implemented according to the content of the specification, as follows. The preferred embodiments of the present application are described in detail below with the help of the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0015] Figure 1 The system schematic diagram of the present application. DETAILED DESCRIPTION

[0016] The technical solutions of the present application will be described clearly and completely below in conjunction with the drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of the present application.

[0017] In the description of the present application, it should be noted that the orientations or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, and therefore cannot be understood as indicating or implying that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as limiting the present application. In addition, the terms "first", "second", "third" are only for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0018] In the description of the present application, it should be noted that unless otherwise explicitly specified and limited, the terms "mounting", "connection", "connection" should be understood broadly, for example, it can be fixedly connected, or it can be detachably connected, or integrally connected; it can be mechanically connected, or it can be electrically connected; it can be directly connected, or it can be indirectly connected through an intermediate medium; it can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances.

[0019] In addition, the technical features involved in the different embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.

[0020] As Figure 1 A VR virtual reality-based entry simulation operation interaction system, comprising: a) Induction operation system: the operator enters the model environment through VR virtual reality technology; unlike the current operation computer to modify the design parameters, abandoning the traditional computer operation menu bar and toolbar, the personnel enter the design environment for work through proportional reduction or enlargement.

[0021] The design of the staff can be completed in a closed loop in the VR (virtual reality) environment, including: from model creation to model modification to output integration: from starting to build a model, real-time modification of parameters, direct export of engineering drawings, which can be realized in the VR (virtual reality) environment; cross-device collaborative interface: supporting VR (virtual reality) headsets, computers, engineering tablets, and mobile phones linkage, model editing and simulation verification can be performed on the VR (virtual reality) device end.

[0022] b) Three-dimensional spatial positioning system: The mapping relationship between the model virtual coordinate system and the model reference coordinate system is established through the positioning system; including scene detail dynamic loading: automatically matching model accuracy according to the current scale of the model, displaying building contours in a macro view and showing bolts and threads in a micro view, and rendering local high light details through ray tracing; and spatial penetration navigation: in a micro scale (such as 1:10), the user can observe the internal structure by penetrating the pipe wall.

[0023] c) Multi-modal instruction processing system: directly trigger model parameter changes through the actions or language of the operator's body, and the operation process is linked in real time. In the VR (Virtual Reality) environment, the model can be directly imported, supporting gesture operation, directly grabbing and stretching the model through gestures to modify model parameters such as pipe diameter, building height, and material, and the system synchronously calls data in the database to calculate mechanical parameters, confirms whether it meets the specifications, and in the operation process, through vision, color gradient prompts stress values, and haptics, glove vibration feedback force limits, immediate feedback, eliminating the delay of traditional design operations to calculations, calculations to verification, and simultaneously generating standardized engineering drawings.

[0024] Based on a distributed network architecture, it also allows multiple designers to enter the same virtual space through VR (Virtual Reality) devices, implement collaborative design through voice instructions and virtual marking tools, and automatically synchronize modification records to the cloud.

[0025] Preferably, a scale adjustment module is included for the operator to scale down or up in the virtual scene and dynamically load model details of corresponding accuracy according to the scale. The scale adjustment module also includes dynamic scale zooming and scene immersion adaptation technology for the operator to scale down or up in the virtual scene and dynamically load model details of corresponding accuracy according to the scale. The user can switch design scales through gestures or voice, such as gestures: pulling hands out to enlarge the scale to 1:1000 for a bird's eye view, or voice instructions: "enter the pipe interior view".

[0026] Preferably, the multi-modal instruction processing system is configured to recognize the operator's limb operation, eye movement, or language instruction, and modify the parameters of the 3D model based on the instruction. In runtime, gesture semantics can be bound: specific gestures trigger design functions, such as rotating by clenching fists to adjust the orientation of devices in the system, or drawing a circle with the index finger to generate a marker annotation; through interactive scene clicking to select targets, when the user's finger moves to select a building wall, the wall editing mode is activated, and gestures are used to directly modify the thickness or material.

[0027] Preferably, an extensible instruction library module is included, allowing users to customize action instructions and bind to specific operation actions; and a voice interaction module is included for invoking a command menu or generating a description by voice. A voice interaction module is also included for invoking a command menu or generating a description by voice; which can be combined with eye movement tracking, such as positioning a design focus; gesture recognition, such as grabbing, rotating a model, voice control, such as invoking a command menu, forming an integrated interaction process of eye looking, instructions and voice.

[0028] Preferably, a risk visualization and alarm module is included, which is configured to present the high and low of stress or risk through different color scales on the helmet display, and trigger different levels of alarm reminders when detecting physical collision conflicts or errors that violate preset design rules. By integrating a physics engine to automatically calculate structural bearing, fluid mechanics and other data during VR (Virtual Reality) interaction, the risk is immediately fed back through color labeling or data display (such as red highlighting the stress over-limit area).

[0029] Preferably, a field perspective operation module is included, which is configured to allow users to enter a virtual design environment with a field perspective inside the model, grab virtual objects through drag-and-drop operations, and place them to the target position.

[0030] Preferably, a block assembly module is included, which is configured to allow users to combine predefined modular components in a block-by-block manner to form a three-dimensional model.

[0031] Preferably, in the three-dimensional space positioning system, a mapping relationship between the operator's virtual coordinate system and the operator's reference coordinate system can also be established through the positioning system.

[0032] The technical features of the above-mentioned embodiments can be combined in any way. In order to make the description concise, not all possible combinations of the technical features in the above-mentioned embodiments are described, however, as long as the combination of the technical features does not exist contradictory, it should be considered as the scope of the present disclosure.

[0033] The above-mentioned embodiments only express several embodiments of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent. It should be noted that for ordinary skilled in the art, without departing from the concept of the present application, a number of variations and improvements can be made, which are within the scope of the present application. Therefore, the scope of protection of the present application should be subject to the appended claims.

Claims

1. An immersive simulation operation interaction system based on VR (Virtual Reality), characterized in that, Includes: a) Sensory operating system: Operators immerse themselves in the model environment through VR virtual reality technology; b) Three-dimensional spatial positioning system: The positioning system establishes a mapping relationship between the virtual coordinate system of the model and the reference coordinate system of the model; c) Multimodal instruction processing system: The system directly triggers changes in model parameters through the operator's physical actions or verbal commands, and the operation process is linked and changes in real time.

2. The system according to claim 1, characterized in that, It includes a scale adjustment module, which allows operators to shrink or enlarge their virtual avatars in a virtual scene and dynamically load model details of corresponding precision according to the scale.

3. The system according to claim 1, wherein the multimodal instruction processing system is configured to recognize the operator's limb movements, eye movements or verbal instructions, and modify the parameters of the 3D model in conjunction with the instructions.

4. The system according to claim 1, characterized in that, It includes an extensible command library module that allows users to customize action commands and bind them to specific operations; and a voice interaction module for calling command menus or generating descriptions via voice.

5. The system according to claim 1, characterized in that, It includes a risk visualization and alarm module, which is configured to display the level of stress or risk in different color levels through a helmet display, and to trigger different levels of alarm reminders when a physical collision or violation of preset design rules is detected.

6. The system according to claim 1, characterized in that, It includes a live view operation module, which is configured to allow users to enter the virtual design environment from a live view within the model, grab virtual objects through drag-and-drop operations, and place them at the target location.

7. The system according to claim 6, characterized in that, It includes a modular assembly module, which is configured to allow users to combine predefined modular components in a building block manner to form a three-dimensional model.

8. The system as described in claim 1, characterized in that, The three-dimensional spatial positioning system can also establish a mapping relationship between the operator's virtual coordinate system and the operator's reference coordinate system.

Images