AR Scene Composer for Window Snapping and Virtual Inking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR and AR applications have limited integration with VR and AR environments, failing to utilize their unique capabilities such as expanded display areas, and lack support for features like window snapping, virtual inking, and accessibility for users.
Innovation Solution
A method that involves a computing device receiving input from VR/AR devices to identify application content and its location, composing scenes by overlaying content onto regions in the environment, and allowing users to interact with these scenes through touch inputs, enabling features like window snapping and accessibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional input methods (keyboards, mice, touchscreens) are used for VR/AR applications, then applications can run on conventional computing devices, but the applications fail to utilize unique VR/AR capabilities such as expanded display areas and immersive interaction
Solution Approach 1:
The patent introduces a scene composer as an intermediary component that bridges traditional applications and VR/AR environments. This scene composer translates conventional application output into immersive VR/AR scenes, enabling applications to leverage VR/AR capabilities without requiring complex native VR/AR development. The scene composer handles the complexity of VR/AR integration internally while maintaining compatibility with standard applications.
Solution Approach 2:
The system enables a single application to function across multiple platforms (traditional displays and VR/AR devices) through the scene composer. The scene composer acts as a universal adapter that can process application content and render it appropriately for different display environments, allowing one application to serve multiple purposes without requiring separate VR/AR versions.
2Ease of operation
If applications are designed to natively support VR/AR features, then enhanced user interaction and accessibility are achieved, but the device complexity and development requirements increase significantly
Solution Approach 1:
The scene composer provides self-service functionality by automatically handling the translation and adaptation of application content for VR/AR environments. It autonomously composes scenes, manages spatial positioning, and renders content without requiring manual configuration or complex development efforts. This self-service capability enables enhanced user interaction while keeping development complexity low.
3Area of stationary object
If applications overlay content onto regions in the AR environment, then expanded display areas are utilized effectively, but the precision of content placement and alignment becomes more difficult
Solution Approach 1:
The patent replaces manual or mechanical content placement methods with automated computational scene composition. The scene composer uses algorithms to automatically position and align content within AR regions, substituting precise manual positioning with computational precision. This allows effective utilization of expanded display areas while maintaining high content placement precision through automated spatial management.
Data Source
AI summary
Embodiments of the present disclosure relate to providing an augmented reality experience. Embodiments include receiving, from an augmented reality or virtual reality (AR/VR) device, first input that identifies application content and a location of an artifact in an AR/VR environment. Embodiments include identifying a region in the environment based on the location, the region corresponding to the artifact. Embodiments include receiving the application content from an application. Embodiments include composing a first scene, the application content being overlaid onto the region. Embodiments include transporting the first scene to the AR/VR device for display. Embodiments include receiving, from the client device, second input in the region in the environment. Embodiments include composing a second scene wherein the application content is modified based on the second input. Embodiments include transporting the second scene to the AR/VR device for display.