Holographic Productivity Authoring Through Device Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual and augmented reality technologies have not effectively integrated with productivity applications for content authoring, requiring significant user interaction and computational efforts.
Innovation Solution
A mixed reality system with holographic modes for productivity applications, enabling content authoring through holographic-enabled devices that communicate with computing devices to facilitate seamless interaction and manipulation of holographic images, allowing users to interact with content components using gaze, gesture, and voice, and synchronize changes across devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If holographic modes are integrated into productivity applications, then user interaction and computational efforts are reduced, but device complexity increases
Solution Approach 1:
The system divides functionality between a holographic-enabled device (HMD) and a second computing device. The HMD handles holographic display and basic interactions, while the second device manages complex productivity application logic and content file processing. This segmentation reduces the computational burden on the HMD while maintaining full productivity capabilities.
Solution Approach 2:
A software component on the HMD acts as an intermediary between the user and the productivity application on the second device. This intermediary translates user interactions (gaze, gesture, voice) into commands that the second device can process, reducing the need for complex interaction handling on the HMD itself.
2Adaptability or versatility
If holographic augmented authoring is enabled, then authoring experience is enhanced, but user interaction requirements increase
Solution Approach 1:
The system enables self-service through automated synchronization. When content is authored or modified on either device, changes are automatically synchronized to the other device without requiring manual intervention. This reduces user interaction overhead while maintaining enhanced authoring capabilities.
Solution Approach 2:
The system implements real-time feedback through bidirectional communication between the HMD and second device. Changes made on one device are immediately reflected on the other, providing continuous feedback that reduces the need for manual verification and reduces overall user interaction requirements.
3Adaptability or versatility
If holographic modes are added to productivity applications, then functionality is expanded, but computational efforts increase
Solution Approach 1:
Computational tasks are segmented between devices based on their capabilities. The HMD performs lightweight tasks such as displaying holographic content and capturing basic user interactions. The second device handles computationally intensive tasks such as processing content files, managing application state, and performing complex data operations. This segmentation reduces overall computational efforts while maintaining expanded functionality.
Solution Approach 2:
The system uses copying to distribute content files between devices. Instead of duplicating full application instances on both devices, the HMD works with local copies or references to content files stored on the second device. This reduces computational overhead on the HMD while maintaining full access to productivity features.
Data Source
Figure 1A
Figure 1B
Figure 2A
AI summary
Holographic augmented authoring provides an extension to personal computing experiences of a universal or conventional productivity application. A user interface of a productivity application executing on a personal computing device can be switched from a touch or conventional mode to a holographic mode, which opens communication between the personal computing device and a holographic enabled device providing a mixed reality system. A semantic representation of a command in a productivity application is generated as a hologram in a mixed reality system and the change to a content file from performing the command in the mixed reality system does not require a holographic enabled device to view or even further edit.