3-D Scene Decomposition for Cross-Device Mixed Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge lies in bridging the gap between immersive 3-D mixed-reality experiences and conventional 2-D devices, ensuring seamless interaction and collaboration across different platforms and devices, while minimizing computational and display resource requirements.
Innovation Solution
A technique for decomposing 3-D mixed-reality environments into constituent elements such as people, places, and things, optimizing them for 2-D interfaces, and utilizing virtual cameras and intelligent interface design to provide a coherent and navigable 2-D representation, incorporating accessibility features like screen readers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 3-D mixed-reality environments are decomposed and converted for 2-D device compatibility, then cross-device interoperability is improved, but computational resources and processing time are increased
Solution Approach 1:
The patent segments the 3-D mixed-reality environment into distinct components (spatial data, objects, users, actions) that can be independently processed and transmitted. This allows 2-D devices to receive only the necessary data elements rather than processing the entire 3-D scene, reducing computational load while maintaining interoperability.
Solution Approach 2:
The patent creates simplified 2-D representations (copies) of the 3-D mixed-reality environment. These 2-D copies preserve essential spatial relationships and interactions while requiring significantly fewer computational resources to process and display on conventional devices.
2Adaptability or versatility
If 3-D mixed-reality environments are decomposed and converted for 2-D device compatibility, then cross-device interoperability is improved, but processing time is increased
Solution Approach 1:
The patent performs preliminary decomposition of the 3-D environment into standardized data elements before transmission to 2-D devices. By pre-processing the spatial data, objects, and interactions into a compatible format, the system reduces the processing time required on the receiving end, enabling faster interoperability.
3Ease of operation
If virtual cameras and intelligent interface design are used to provide coherent 2-D representation, then user experience quality is improved, but device complexity is increased
Solution Approach 1:
The patent introduces virtual cameras as an intermediary layer between the 3-D environment and the 2-D display. These virtual cameras capture and translate spatial relationships into coherent 2-D representations, improving user experience while abstracting the complexity of the underlying decomposition and conversion processes.
Data Source
AI summary
Interactive methods and systems for converting three-dimensional (3-D) mixed-reality experiences into two-dimensional (2-D) representations are disclosed. A system comprises a 3-D-to-2-D decomposition engine that analyzes a data model of a 3-D environment to ascertain the positions, orientations, and activities of users, objects, and places within the environment. A 2-D user interface engine generates intuitive interface elements for display on conventional devices such as mobile phones, tablets, and laptops. The interface allows users to navigate the 3-D space efficiently through a series of interactive buttons representing conversation groups, individual users, and objects. Virtual cameras capture various perspectives within the 3-D environment, which are then processed to create a coherent 2-D representation for the user. This approach enables inclusive collaboration across a diverse range of devices and user capabilities, expanding the reach of mixed-reality technologies.