Mid-Air Projection Interface for Mobile Device Multitasking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile computing devices face limitations in screen size, which restricts the amount of information that can be displayed simultaneously, leading to reduced productivity and user experience due to the need to switch between applications or use voice-based interfaces that may not be practical in all situations.
Innovation Solution
The implementation of projected visualization interaction (PVI) technology, which uses volumetric display technology to project user interface elements into mid-air, allowing multiple applications to be interacted with simultaneously without obstructing the current screen view, using a combination of guiding and rendering sources to create a three-dimensional visualization in a field of particles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the screen size of mobile computing device is increased to display more information, then the amount of information displayed improves, but the portability and compactness of the device deteriorates
Solution Approach 1:
The patent projects user interface elements from the two-dimensional screen into three-dimensional mid-air space. This dimensional transition allows additional visual information to be displayed without increasing the physical screen area of the mobile device, effectively resolving the contradiction between display area and device compactness.
2Productivity
If multiple applications are displayed simultaneously on the screen, then productivity improves, but the screen real estate required increases, reducing the quality of individual application displays
Solution Approach 1:
The patent extends the display space from the flat screen into three-dimensional mid-air space above the device. This allows multiple application interfaces to be projected simultaneously in different spatial locations, enabling effective multitasking without consuming additional screen real estate and maintaining high display quality for each application.
Solution Approach 2:
The patent segments the user interface elements and distributes them across different spatial zones in mid-air above the screen. This segmentation allows users to interact with multiple applications simultaneously in different locations, improving productivity while keeping the physical screen area unchanged.
3Ease of operation
If voice-based interfaces are used to interact with the device, then hands-free operation improves, but the applicability deteriorates in situations where voice input is not practical
Solution Approach 1:
The patent creates a universal interaction system that combines visual projection with multiple input methods including touch, gesture, and voice. This multi-functional approach maintains the ease of hands-free operation when needed while preserving adaptability to various situations by allowing users to switch between interaction modes based on context.
4Area of stationary object
If external monitors are used to display additional information, then information display capacity improves, but the portability and integrated nature of the mobile device deteriorates
Solution Approach 1:
The patent extracts the display function from the physical monitor and projects it into mid-air space using light fields and particles. This eliminates the need for external hardware monitors while maintaining expanded display capacity, preserving device portability and integrated functionality.
Solution Approach 2:
The patent uses a field of particles as an intermediary medium to carry and display visual information in mid-air. This intermediary approach enables external display functionality without requiring physical external monitors, maintaining system integration and portability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances user productivity by providing additional visual information without interfering with the current tasks on the screen, allowing for intuitive multitasking and improved interaction with multiple applications without the need for external monitors or voice-based interfaces.
Implementation Method 1
uses volumetric display technology to project user interface elements into mid-air
Implementation Method 2
using a combination of guiding and rendering sources to create a three-dimensional visualization in a field of particles
Data Source
AI summary
A current state of a mobile computing device may be monitored. The mobile computing device has a set of one or more installed applications. The current state is related to the set of installed applications. A first computing action of a user of the mobile computing device is identified responsive to the current state. The first computing action is related to the set of installed applications. Responsive to the first computing action, a set of one or more candidate computing actions is determined. The mobile computing device generates, based on the first computing action, a projected visualization that relates to a first candidate computing action of the set of candidate computing actions.