Virtual Scene Rendering With Pose-Based 3D Object Updates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual live streaming applications lack the ability to provide immersive and interactive three-dimensional experiences, limiting users' understanding of large products such as furniture or houses, as they can only view from a fixed angle and lack real-time detailed information.
Innovation Solution
Generate a virtual scene associated with a physical scene by integrating an avatar and virtual object based on measurement data, allowing users to switch poses and interact with the virtual scene, enhancing the immersive experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If users view physical objects through fixed-angle virtual representations, then device complexity is reduced, but user immersion and interaction capability deteriorate
Solution Approach 1:
The patent implements dynamic virtual scene generation that adapts to user pose changes. The system continuously updates the virtual scene based on the user's current pose, transforming the static fixed-angle view into a dynamic interactive experience. This resolves the contradiction by making the system adaptable without requiring complex hardware, using software-based real-time rendering adjustments.
Solution Approach 2:
The system changes rendering parameters based on user pose information. When the user's pose changes, the virtual scene's camera angle, object orientations, and visibility parameters are automatically adjusted. This allows the system to provide immersive interaction capability through parameter adjustments rather than complex device architecture.
2Measurement precision
If users view physical objects from fixed angles, then measurement precision of object details is improved, but user immersion and interactive understanding deteriorate
Solution Approach 1:
The system dynamically adjusts the virtual scene presentation based on user pose, allowing users to explore objects from multiple angles while maintaining accurate representations. The measurement precision is preserved through accurate 3D modeling while immersion is enhanced through pose-dependent scene adjustments.
3Adaptability or versatility
If the system provides detailed real-time virtual scene updates based on user pose, then immersive experience is improved, but loss of time for scene rendering and processing increases
Solution Approach 1:
The system performs preliminary actions by pre-processing 3D model data and preparing virtual scene assets before user interaction. This allows real-time pose-based rendering without excessive processing delays, as the heavy computational work is done in advance.
Solution Approach 2:
The system efficiently manages rendering time by changing only the necessary parameters (camera angle, object visibility, lighting) based on pose changes rather than re-rendering entire scenes. This selective parameter updates approach maintains immersion while minimizing processing time.
Data Source
AI summary
A method, a device and a storage medium for presenting a virtual scene are provided. The method includes: receiving a request to access a virtual scene by a first user of a virtual live streaming application, the virtual scene being associated with a physical scene which a second user of the virtual live streaming application is currently in, and the physical scene including a physical object; presenting the virtual scene to the first user based on the request, the virtual scene including an avatar associated with the second user and a virtual object associated with the physical object; and presenting an updated virtual scene to the first user based on a request by the first user to switch to a target pose in the virtual scene, the updated virtual scene including an updated avatar of the second user and an updated virtual object determined based on the target pose.