Multi-View Interactive Digital Media Representation Lock Screen
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional digital media formats, such as 2D flat images, limit the ability to recreate memories and events with high fidelity and require significant data and processing resources for generating 3D models, making them inefficient for real-time capture and presentation in augmented and virtual reality systems.
Innovation Solution
The development of multi-view interactive digital media representations (MIDMR) that utilize mobile devices with processors, memory, and sensors to generate dynamic, interactive 3D representations based on user input, location, and environmental factors, allowing for real-time capture and presentation of immersive content without the need for dense depth maps or high processing power.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If traditional 2D flat images are used, then device complexity and processing requirements are low, but the ability to recreate memories and events with high fidelity is limited
Solution Approach 1:
The patent transitions from traditional 2D flat images to multi-view interactive digital media representations that incorporate depth information and multiple viewing angles. This dimensional enhancement allows for high-fidelity recreation of memories and events by providing three-dimensional spatial relationships and interactive exploration capabilities, directly resolving the contradiction between fidelity and complexity.
2Manufacturing precision
If dense depth maps or optical flow maps are used for interpolation, then 3D model accuracy is improved, but data requirements and processing resources increase significantly
Solution Approach 1:
The patent extracts and utilizes depth information directly from multiple captured images through multi-view geometry and structure-from-motion techniques. By deriving depth maps from the image set itself rather than requiring separate dense depth sensing, the system achieves accurate 3D reconstruction without the excessive data requirements of traditional approaches.
Solution Approach 2:
The captured images serve multiple functions simultaneously: they provide both the visual content for rendering and the depth information for 3D reconstruction. This multi-functionality eliminates the need for separate depth sensing systems or additional data streams, reducing overall data requirements while maintaining 3D accuracy.
3Manufacturing precision
If computer generation of polygons or texture mapping is used, then 3D model quality is improved, but processing time and resource requirements increase
Solution Approach 1:
The patent performs preliminary processing during the image capture phase by organizing images into structured formats with embedded metadata, depth information, and spatial relationships. This preliminary organization enables rapid 3D model generation and real-time rendering without requiring intensive processing during playback, thus maintaining both quality and speed.
4Productivity
If traditional 2D flat images are used, then transfer rates over network are efficient, but the immersive experience for augmented and virtual reality is limited
Solution Approach 1:
The patent segments the 3D scene into discrete components including geometry data, texture maps, depth maps, and metadata. This segmentation allows for efficient compression and selective transmission of only the necessary data elements for each viewing scenario, maintaining high transfer rates while enabling immersive AR/VR experiences through the rich multi-view representation.
Data Source
AI summary
Described are systems and processes for generating multi-view interactive digital media representations (MIDMR) for display on a user device. In one aspect, a mobile device is provided which comprises a display, one or more processors, memory, and one or more programs stored in memory. The one or more programs comprise instructions for locking the mobile device, and providing a lock screen on the display in a lock mode upon receiving user input for accessing the mobile device. The lock screen may display a dynamic MIDMR that dynamically changes without user input, which provides an interactive three-dimensional representation of an object that is responsive to user interaction with the mobile device. The dynamic MIDMR displayed is selected based on predetermined criteria, and may change based on a predetermined algorithm that includes weighted predetermined criteria factors as variables and recalculates the algorithm value to determine changes to the dynamic MIDMR.