Mobile Interface Virtual Content Viewing via Sensor Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional user interfaces for mobile computing devices are not optimized for hand-held use, as they are derived from desktop interfaces, leading to limitations such as requiring two hands, counter-intuitive navigation, and difficulty in comprehending large files due to small display sizes and resolutions.
Innovation Solution
A mobile user interface that treats content as fixed in virtual space, allowing users to move a mobile computing device to view different portions, using sensors like accelerometers, distance measuring sensors, and cameras to determine movement and adjust the viewing perspective, eliminating the need for pointing devices and enabling one-handed operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional graphical user interface systems are used on mobile devices, then users can interact with familiar PC-based interfaces, but the device must be held fixed in space while content is moved in virtual space, requiring two hands and complex navigation
Solution Approach 1:
The patent inverts the conventional GUI paradigm by fixing content in virtual space and allowing the device to move in real space. Instead of moving content within a fixed window, the system tracks device movement via sensors and updates the viewing perspective accordingly, enabling one-handed operation and eliminating the need for scroll bars and pointing devices
Solution Approach 2:
The patent replaces mechanical interaction mechanisms (scroll bars, drag-and-drop, pointing devices) with sensor-based movement detection. Accelerometers, gyroscopes, and other sensors track device position and orientation changes, automatically updating the content display perspective without requiring manual manipulation of interface elements
2Length of moving object
If content is displayed on small mobile device screens, then portability is maintained, but users have difficulty comprehending large files and images
Solution Approach 1:
The patent adds the real spatial dimension to the virtual content space. By tracking device position, orientation, and movement in three-dimensional space, the system creates a sense of depth and scale that helps users comprehend large files. The content appears to exist in a virtual space that the device moves through, providing spatial context that enhances understanding of content structure and scale
3Adaptability or versatility
If the device is made mobile and handheld, then portability and mobility are improved, but the interface must adapt to device movement in real space
Solution Approach 1:
The system performs self-service by automatically tracking device movement through sensors and adjusting the content display perspective without user intervention. The accelerometer, gyroscope, and other sensors continuously monitor device position and orientation, and the system automatically updates the virtual viewing perspective to match real-world device movement, eliminating the need for manual interface adjustments
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach provides a natural user experience, allowing users to view and interact with content as if it were on a desk, improving usability and reducing the need for complex navigation, while accommodating larger content sizes and orientations.
Implementation Method 1
sensing a movement in real space of the mobile computing, determining a change in position in real space of the mobile computing device based upon the sensed movement
Implementation Method 2
receiving a digital image from a camera, comparing at least a portion of the received digital image to at least a portion of a previous digital image to identify a change in sequential images, and determining a movement based upon the identified change in the sequential images
Data Source
AI summary
A mobile user interface suitable for mobile computing devices uses device position/orientation in real space to select a portion of content that is displayed. Content (e.g., documents, files or a desktop) is presumed fixed in virtual space with the mobile user interface displaying a portion of the content as if viewed through a camera or magnifying glass. Data from motion, distance or position sensors are used to determine the relative position/orientation of the device with respect to the content to select the portion for display. Content elements can be selected by centering the display on the desired portion, obviating the need for cursors and pointing devices (e.g., mouse or touchscreen). Magnification can be manipulated by moving the device away from or towards the user. 3-D content viewing may be enabled by sensing the device orientation and displaying content that is above or below the display in 3-D virtual space.