Real-time multi-angle view angle switching method in virtual reality

Abstract

The invention relates to a real-time multi-angle view angle switching method in virtual reality, and aims to solve the problems of view angle limitation, unsmooth switching, difficulty in view angle self-definition and low multi-user cooperation efficiency in an existing virtual reality system. According to the method, a plurality of preset viewing angles are provided in a virtual reality environment, including a first-person viewing angle, a third-person viewing angle, a free camera viewing angle and a panoramic viewing angle, so that a user can flexibly switch to adapt to different operation requirements. The system allows a user to customize visual angle setting, facilitates quick calling, and improves the operation efficiency. Meanwhile, the method supports view angle sharing and synchronization among multiple users, and is particularly suitable for virtual training, remote cooperation and interactive operation of a multi-user scene. The method can be widely applied to scenes such as industrial training, remote teaching, virtual conferences and multi-person cooperation in virtual reality, and has remarkable operation flexibility and interaction efficiency.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a real-time multi-angle viewing angle switching method applicable to a virtual reality system. Background Art

[0002] With the rapid development of virtual reality (VR) technology, the immersive experience of users in virtual environments has become one of the important indicators for measuring the quality of VR systems. Most existing virtual reality systems adopt a single perspective design, usually a first-person perspective, and users perceive the virtual world through head displays or other devices. Although this single perspective design can simulate the user's real perspective, it has the following specific problems in many complex application scenarios, such as multiplayer games, training simulations, virtual meetings, etc.: Perspective limitation problem: In existing virtual reality applications, the first-person perspective is widely used due to its strong immersion. However, the first-person perspective can only show the limited field of view directly in front of the user, and the user cannot observe other key areas or objects in the virtual environment at the same time. For example, in virtual reality games, users cannot observe potential threats behind or on the side; in virtual training, users cannot view their own operation details and the overall environment layout at the same time. This limitation seriously affects the user's operating efficiency and decision-making ability. Therefore, in response to these problems in the existing technology, it is urgent to develop a new virtual reality perspective switching method that can not only solve the perspective limitation problem, but also ensure the smoothness of the perspective switching process, the convenience of user-defined perspectives, efficient collaboration between multiple users, and the optimal use of hardware resources. Summary of the invention

[0003] The present invention relates to a real-time multi-angle view switching method in virtual reality, aiming to solve the problems of view limitation, unsmooth switching, insufficient customization, low efficiency of multi-user collaboration and poor utilization of hardware resources in existing virtual reality systems. Through the present invention, users can flexibly and in real time switch multiple view angles in a virtual reality environment, and significantly enhance the degree of freedom of operation and the efficiency of collaboration in different application scenarios. The present invention provides a low-latency and efficient view switching mechanism, which can be widely used in scenarios such as games, training and remote collaboration in virtual reality.

[0004] In order to achieve the above-mentioned purpose, the present invention proposes a multi-angle view switching method in virtual reality. First, multiple view angles are preset to meet the user's observation needs in different scenes. These view angles include first-person view angle, third-person view angle, free camera view angle and panoramic view angle. The first-person view angle is used to simulate the user's immersive experience in virtual reality, which is suitable for scenes that require delicate operations; the third-person view angle places the camera outside the user's character, which is convenient for the user to observe the overall situation of the character and its surrounding environment; the free camera view angle allows the user to freely adjust the position and angle of the camera according to needs to explore the details of the scene; the panoramic view angle provides users with 360-degree all-round observation, which is convenient for users to quickly browse the entire virtual environment. These view angles can be quickly switched through input devices such as virtual reality handles, gesture recognition or eye tracking devices, and the system will ensure the real-time and smoothness of view angle switching through optimized rendering algorithms.

[0005] In addition to the preset multi-viewing angles, the present invention also allows users to freely customize viewing angles according to personal needs. Users can adjust the position, angle, distance and other parameters of the camera, and the system will save these customized viewing angles as quick viewing angles, which are convenient for users to quickly call in subsequent operations. In practical applications, such as virtual training or remote collaboration, users can set multiple commonly used operating viewing angles according to scene requirements and quickly switch through shortcuts. For example, the user can set a close-up viewing angle when operating the device, and switch to a long-range viewing angle when it is necessary to monitor the overall situation. This customization function significantly improves the flexibility of the system, allowing users to operate more efficiently according to different task requirements.

[0006] In order to cope with the application scenarios of multi-person collaboration, the technical solution of the present invention provides a perspective sharing and synchronization function. Through this function, when multiple users collaborate in the same virtual environment, real-time sharing and synchronization of perspectives can be achieved. For example, teachers can share their first-person perspective with students in remote training, and students can observe the operation details from the teacher's perspective. In multiplayer games or virtual meetings, users can also share their observation angles with team members through the perspective sharing function to ensure that all members can obtain a consistent perspective observation experience. In order to ensure the real-time performance of perspective sharing, the present invention adopts a low-latency synchronization mechanism to avoid the problem of perspective asynchrony caused by network delays or insufficient hardware performance. This perspective sharing function greatly improves the collaboration efficiency and interactive experience in multi-user scenarios.

[0007] In order to solve the visual discomfort that may be caused by frequent perspective switching, the present invention introduces a smooth transition visual effect design. When the user switches the perspective, the system will achieve a smooth transition through a gradual zoom effect. Especially when switching between the first-person perspective and the third-person perspective, the system gradually enlarges or reduces the field of view, allowing the user to naturally transition to a new perspective position, avoiding dizziness or loss of sense of direction caused by sudden perspective changes. In addition, the system can also automatically adjust the visual effects during the switching process according to the user's movement speed and changes in the current environment, ensuring that the user can still obtain a smooth visual experience when moving quickly or switching frequently.

[0008] In order to further enhance the user experience, the present invention also introduces an automatic perspective switching mechanism based on multi-dimensional perception signals. In addition to the traditional manual perspective switching, the system can automatically adjust the perspective through signals such as audio and tactile feedback. For example, when the system detects a sound emitted by a virtual object, the perspective will automatically switch to the location of the object to help the user quickly locate the source of the sound. In some tactile feedback devices, the system can also automatically adjust the perspective to the interaction point between the user and the virtual object based on the vibration feedback signal. Through the integration of multi-dimensional perception signals, the system can adjust the perspective more intelligently, reduce the burden of manual operation on the user, and further enhance the interactive experience in virtual reality.

[0009] The present invention ensures the smoothness of perspective switching in complex scenes by optimizing the use of system resources. In highly complex virtual scenes, the system will give priority to rendering the core objects in the user's current field of view, reducing the rendering accuracy of the distant view or background, thereby saving hardware resources and improving the efficiency of perspective switching. In addition, the system will dynamically adjust the rendering quality and data transmission efficiency of perspective switching according to the actual situation of network bandwidth and device performance, ensuring low latency and efficient operation during multi-user collaboration.

[0010] Through the above technical solutions, the present invention significantly improves the multi-angle perspective switching experience in virtual reality, and solves the problems of perspective limitations, switching delays, and low efficiency of multi-user collaboration in existing systems. Users can switch freely between multiple perspectives, and the switching process is smooth and without lag; the perspective sharing mechanism between multiple users ensures the efficiency of collaboration; the smooth transition effect and the automatic perspective switching function triggered by multi-dimensional perception improve the user's comfort and interactive experience. Finally, the present invention can be widely used in various scenarios such as games, remote training, virtual meetings, etc. in virtual reality, effectively improving the overall performance and user experience of the virtual reality system. DETAILED DESCRIPTION

[0011] The specific embodiments of the present invention can be applied to industrial equipment operation training scenarios in virtual reality. In order to improve workers' operating skills and ensure safety, the multi-angle view switching method of the present invention can provide users with an immersive training environment and simulate the operation process of actual equipment in virtual reality. The following describes the specific embodiments of the present invention in conjunction with the actual industrial training scenario.

[0012] In a virtual reality training system for an oil drilling platform, new operators need to be familiar with complex equipment operation procedures, such as rig startup, maintenance, and troubleshooting. Traditional training methods may be conducted through videos or text instructions, which cannot allow trainees to truly experience the overall picture and operation details of the equipment. The present invention provides a more intuitive and immersive training experience through the multi-angle view switching function in virtual reality.

[0013] At the beginning of the training, the operator wears a virtual reality headset to enter the virtual drilling platform environment, and the system sets the user to the first-person perspective by default. At this time, the operator can see the equipment in front of him by moving his head, and feel the immersive operating environment. When the trainee needs to start the equipment, the system will simulate the buttons and control panel of the equipment, and the trainee can operate directly through the virtual reality handle. The first-person perspective provides an immersive close-up observation, allowing the trainee to carefully view the button layout of the equipment and the display information of the operation panel.

[0014] However, the single first-person perspective has perspective limitations, such as the inability to view the back of the equipment or the overall layout of the platform at the same time. In order to help students better understand the operation of the entire equipment, the system provides a third-person perspective and a free camera perspective switching function. Students can switch from the first-person perspective to the third-person perspective by pressing the perspective switching button on the handle. The camera position automatically moves behind the student's character, providing a broader global perspective. At this point, students can see the full picture of the equipment and monitor potential problems that may arise during the operation of the equipment, such as whether there are loose parts or abnormal operation. The third-person perspective is particularly suitable for students when operating large equipment, helping them to better understand the overall operation of the equipment.

[0015] In equipment maintenance scenarios, key components of some equipment may be located inside or on the back of the equipment, which is not easy to view directly from a first-person or third-person perspective. At this time, students can switch to the free camera perspective and freely adjust the position and angle of the camera using the handle. For example, when students need to check the operation of the gears inside the equipment, they can adjust the free camera to the back of the equipment and use the zoom function to view the details of the gears up close. The free camera perspective allows students to observe the equipment from multiple different angles and distances, ensuring that they can grasp every detail.

[0016] The present invention also allows trainees to customize the viewing angle settings according to their personal needs. For example, in a complex troubleshooting process, trainees may need to regularly check multiple specific parts of the equipment. In actual operation, trainees can manually adjust the camera angle, save key viewing angles as custom viewing angles, and quickly switch between them using shortcut keys. This function greatly improves the efficiency of the training process, especially in complex task scenarios, where trainees do not need to repeatedly adjust the viewing angle and can focus on operating and judging equipment problems.

[0017] During the training process, the virtual reality training system supports collaborative training of multiple trainees. Assuming that there is an experienced instructor participating in the training, he can use the perspective sharing function of the present invention to share his first-person perspective with other trainees. For example, when the instructor is operating a drilling rig, he can synchronize his first-person perspective with the new trainees, allowing them to observe how to start and adjust the equipment from the instructor's perspective. This perspective sharing function is particularly important in remote teaching and training scenarios, especially in complex equipment operation training, which can effectively improve the trainees' understanding and mastery of the operating steps.

[0018] In order to avoid visual discomfort caused by frequent perspective switching, the present invention adopts a smooth transition effect. For example, when the trainee switches from the first-person perspective to the free camera perspective, the system will gradually zoom in or out to make the perspective change more natural, avoiding sudden perspective changes that cause the trainee to lose their sense of direction or feel dizzy. This transition effect is particularly suitable for scenes with long-term operation and high-frequency perspective switching, ensuring that the trainee can still maintain a good visual experience during long-term operation.

[0019] In addition, the present invention integrates the automatic perspective switching function of multi-dimensional perception signals. For example, when a device fails, the system can detect the abnormal sound source through the audio perception module and automatically switch the perspective to the location of the sound source, allowing trainees to quickly locate the problem area. In a virtual reality environment, operators usually need multi-sensory feedback to make correct judgments, so the automated perspective switching function can greatly reduce manual operations and improve operating efficiency.

[0020] Finally, in order to ensure the smooth operation of the system in highly complex scenes, the present invention designs a dynamic resource optimization mechanism. During the perspective switching process, the system will give priority to rendering the key equipment components in the trainee's field of view, reduce the rendering accuracy of the background, and ensure the smoothness of the switching process. For example, when the trainee uses the free camera to view the inside of the device at close range, the system will give priority to rendering the internal structure of the device and reduce the rendering of irrelevant scenes in the distance, ensuring that the trainee can obtain a high-quality visual experience without affecting the smoothness of the operation.

[0021] Through the implementation of the present invention, industrial equipment operation training in virtual reality can significantly improve the learning efficiency and operation skills of trainees. The multi-angle view switching function not only allows trainees to have an in-depth understanding of the operation mechanism of the equipment from multiple perspectives, but also improves the effect of collaborative training through customized view and view sharing. The smooth visual transition effect and automatic switching function based on multi-dimensional perception further improve the comfort and intelligence of operation, ensuring that trainees can complete training tasks efficiently and safely in an immersive virtual reality environment.

Claims

1. A real-time multi-angle view switching method in virtual reality, characterized in that: The method comprises the following steps: 1) Preset multiple perspectives in the virtual reality environment, including first-person perspective, third-person perspective, free camera perspective and panoramic perspective; 2) The user selects a perspective switching instruction through an input device; 3) The system responds to user instructions in real time and switches to the selected perspective, while dynamically adjusting the perspective position and angle to adapt to changes in objects and environment in the current scene.

2. A method for real-time multi-angle view switching in virtual reality according to claim 1, characterized in that: The input device includes a virtual reality handle, a gesture recognition device, an eye tracking device or other user input devices.

3. A method for real-time multi-angle view switching in virtual reality as claimed in claim 1, characterized in that: The dynamic adjustment of the viewing angle position and angle includes: automatically adjusting the height, angle and distance of the camera according to the user's interactive position; and adjusting the camera focus in real time according to the position change of the target object in the scene.

4. A method for real-time multi-angle view switching in virtual reality as claimed in claim 1, characterized in that: The method also includes a step of user customizing the viewing angle, which specifically includes: the user adjusts the viewing angle parameters of the camera through an input device, including position, angle, distance, etc.; the system saves the user's custom viewing angle settings for subsequent operation calls.

5. The method for real-time multi-angle view switching in virtual reality according to claim 1, characterized in that: The custom viewing angle setting includes multiple preset positions and angles, and the user can quickly switch between them through shortcut commands.

6. A method for real-time multi-angle view switching in virtual reality as claimed in claim 1, characterized in that: The method also includes a perspective sharing function in multi-user collaboration, specifically including: user A chooses to share his perspective, the system synchronizes user A's perspective to other user B, and user B can observe the virtual scene from user A's perspective.

7. A method for real-time multi-angle view switching in virtual reality according to claim 1, characterized in that: The perspective sharing function in the multi-user collaboration includes real-time synchronization and dynamic adjustment, ensuring low latency and high consistency of perspectives of multiple users.

8. The method for real-time multi-angle view switching in virtual reality according to claim 1, characterized in that: The method includes a smooth transition visual effect to reduce the visual discomfort of the user when switching perspectives, specifically including: when switching from a third-person perspective to a first-person perspective, achieving transition through background blur and gradual zoom effects; and automatically adjusting the perspective switching transition animation effect according to the user's movement speed.

9. The method for real-time multi-angle view switching in virtual reality according to claim 1, characterized in that: The method includes a function of triggering perspective switching through multi-dimensional perception signals, specifically including: the system automatically switches the perspective to the location where the sound occurs according to the sound source; the system automatically adjusts the camera to the relevant interactive object by detecting the signal of the tactile feedback device.

10. The method for real-time multi-angle view switching in virtual reality according to claim 1, characterized in that: The method uses dynamic resource optimization technology to give priority to rendering core objects within the user's field of view, reduce the rendering accuracy of unimportant areas, and ensure smooth viewing angle switching in complex scenes.