Virtual Scene Playback With Spatial-Temporal User Interaction Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality technologies fail to effectively capture and replay all information from virtual scenes, particularly user interactions, limiting the ability to preserve and relive memorable moments.
Innovation Solution
A method and apparatus that reconstructs virtual scenes by querying virtual space and user model information based on playback parameters, including spatial and temporal data, using multiple virtual cameras and microphones to capture user actions and voices, and synthesizing the scene playback content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If scene screenshots are used to record virtual scenes, then the recording process is simple, but the screenshots cannot retain all the information in the virtual scene
Solution Approach 1:
The patent segments the virtual scene recording into multiple independent data types: spatial information (position, orientation), temporal information (time stamps), object information (model data, textures), and interaction information (user actions, voice commands). Each segment is recorded separately through dedicated virtual cameras and sensors, allowing complete information retention while maintaining simple operation through automated multi-parameter recording
Solution Approach 2:
The patent transitions from 2D screenshots to 3D spatial recording by introducing virtual cameras that capture multi-angle views of the virtual scene. This dimensional expansion enables recording of spatial relationships, object positions, and user interactions that cannot be captured in traditional 2D images, thereby retaining complete virtual scene information
2Loss of information
If multiple virtual cameras and microphones are used to capture user actions and voices, then the completeness of virtual scene information is improved, but the device complexity increases
Solution Approach 1:
The patent implements a universal virtual recording system where multiple virtual cameras and microphones serve various functions: capturing spatial information, temporal information, object interactions, and user voices. These components are integrated into a single virtual scene playback system that handles all recording tasks through unified software control, reducing operational complexity despite having multiple hardware elements
Solution Approach 2:
The patent creates virtual copies of physical recording devices (virtual cameras and microphones) that replicate their functions within the virtual environment. These virtual sensors capture information without requiring additional physical hardware, as the virtual scene can be rendered and recorded through software-based virtual cameras and audio sensors, thereby reducing physical device complexity
3Measurement precision
If virtual scene playback content is generated by querying virtual space and user model information, then the accuracy of scene replay is improved, but the processing time increases
Solution Approach 1:
The patent performs preliminary actions by pre-processing and storing virtual space information, user model information, and recording parameters in advance. Virtual cameras are positioned and configured beforehand, and recording parameters are pre-set, so that during actual playback, the system only needs to retrieve and synthesize pre-prepared data, significantly reducing real-time processing time while maintaining high accuracy
Solution Approach 2:
The patent extracts essential information from the virtual scene recording by separating and isolating key data elements: spatial coordinates, temporal stamps, object identifiers, and interaction parameters. This extraction allows the playback system to quickly retrieve only the necessary information for accurate scene replay, avoiding processing of redundant data and reducing overall processing time
Data Source
AI summary
A virtual scene playback method is disclosed, which comprises: receiving a scene playback instruction and determining playback parameters according to the scene playback instruction, wherein the playback parameters include playback space and playback time; querying virtual space information and user model information corresponding to the playback parameters; and generating virtual scene playback content according to the virtual space information and the user model information. The present disclosure can save all the information in the virtual scene and play back the virtual scene corresponding to specific space and time. A virtual scene playback apparatus, an electronic device and a storage medium are also disclosed, which also have the above beneficial effects.