3D Video Segment Matching for Coherent Virtual Space Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging technologies fail to provide a coherent and immersive understanding of a space's layout and spatial relationships, often resulting in disjointed and distorted transitions between images, making it difficult for users to visualize and navigate the space effectively.
Innovation Solution
The system captures 360-degree video from multiple directions, aligns frames to create seamless transitions, and uses VSLAM to normalize distances and angles, allowing for fluid navigation and orientation within the space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If morphing algorithms are used to transition between images, then spatial understanding is improved, but image coherence deteriorates resulting in distorted and unrecognizable imagery
Solution Approach 1:
The patent introduces an intermediary virtual camera system that captures and displays intermediate views during transitions between positions. Instead of directly morphing between disparate images, the system uses a virtual camera to capture a sequence of intermediate frames that maintain architectural coherence while providing spatial context, thus mediating between the need for spatial understanding and image stability
Solution Approach 2:
The patent creates a virtual copy of the physical space through photogrammetry and SLAM techniques, generating a digital twin that can be navigated independently. This virtual copy allows transitions to be rendered in the virtual environment rather than morphing real images, preserving the authenticity and coherence of the original captured images while providing seamless spatial navigation
2Loss of information
If 360-degree images are used to provide spatial flow, then spatial understanding is improved, but transition coherence deteriorates resulting in disjointed imagery
Solution Approach 1:
The patent implements dynamic transition rendering where the virtual camera smoothly interpolates between positions and orientations during transitions. The system dynamically adjusts the virtual camera's position, orientation, and field of view to maintain a coherent view of architectural features throughout the transition, rather than using static morphing between fixed 360-degree images
Solution Approach 2:
The virtual camera acts as an intermediary that bridges the gap between discrete 360-degree images. By capturing and displaying intermediate frames from virtual positions between the original capture points, the system maintains architectural coherence and provides continuous spatial context without directly morphing the 360-degree images themselves
3Loss of information
If floor plans are provided to help understand space, then spatial conceptualization is improved for some users, but accessibility deteriorates for one-third of population unable to translate 2D to 3D
Solution Approach 1:
The patent transitions from 2D floor plans to immersive 3D virtual reality experiences. By rendering the space in three dimensions with proper depth, scale, and spatial relationships, the system provides intuitive spatial understanding that does not require the user to mentally translate 2D representations, making it accessible to all users regardless of spatial reasoning abilities
Solution Approach 2:
The patent creates an accurate virtual copy of the physical space that preserves all spatial relationships, dimensions, and architectural features. This virtual replica can be navigated interactively, providing direct experiential understanding of the space without requiring interpretation of abstract 2D representations, thus improving accessibility for all users
4Loss of information
If multiple images are captured to show space layout, then spatial relationships are improved, but immersion deteriorates due to disjointed transitions
Solution Approach 1:
The patent ensures continuous and coherent display of architectural features throughout transitions by using a virtual camera to capture intermediate frames. The system maintains continuous visibility of key spatial landmarks and architectural elements during transitions, preventing the immersion break that occurs when features disappear or distort, thus preserving the reliable immersive experience while conveying spatial relationships
Data Source
AI summary
Systems, methods, and non-transitory computer-readable medium storing instructions that, when executed, causes a processor to perform operations to display a three-dimensional (3D) space. The methods may include, with an imaging device, capturing a first series of frames as the imaging device travels from a first location to a second location within a space, and capturing a second series of frames as the imaging device travels from the second location to the first location. The method may also include determining a first segment in the first series of frames that matches a second segment in the second series of frames to create a segmentation dataset, generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips, and displaying the series of video clips.