Interactive AR Display Synchronization Using Motion Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems are complex and expensive, making them unsuitable for general consumer use.
Innovation Solution
A device that receives live video of a real-world environment, identifies objects, generates an information layer with annotations, synchronizes the layer with motion sensors, and shares it over a communication link, allowing split screen displays with computer-generated imagery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If existing augmented reality systems are implemented, then augmented reality functionality is achieved, but complexity and cost increase
Solution Approach 1:
The system divides the augmented reality functionality into separate modules: a camera module for capturing images, a processing module for generating information layers, and a display module for combining them. This segmentation allows each component to be independently optimized and reduces overall system complexity.
Solution Approach 2:
The device uses a standard camera and display already present in the multifunction device, making these components serve dual purposes - traditional photography/display functions and augmented reality functions. This universality reduces the need for specialized expensive hardware.
2Adaptability or versatility
If existing augmented reality systems are implemented, then augmented reality functionality is achieved, but cost increases
Solution Approach 1:
The patent reuses existing camera and display hardware already manufactured in the multifunction device, eliminating the need for specialized expensive AR components. This approach significantly reduces manufacturing costs while maintaining AR functionality.
Solution Approach 2:
The system uses the device's own existing sensors and processing capabilities to generate and display augmented reality information, rather than requiring external specialized hardware. This self-service approach reduces component costs.
3Measurement precision
If motion sensors are used to synchronize video and information layer, then synchronization accuracy is improved, but device complexity increases
Solution Approach 1:
The system continuously reads motion sensor data and uses this feedback to adjust the synchronization of the information layer with the video feed in real-time. This closed-loop feedback mechanism maintains high synchronization accuracy without requiring complex manual calibration.
Solution Approach 2:
The patent replaces complex mechanical synchronization mechanisms with electronic sensor-based detection and software-based alignment. Motion sensors electronically detect device movement, and software algorithms automatically adjust the information layer positioning, eliminating the need for mechanical synchronization components.
4Ease of operation
If split screen display is implemented, then user interaction with computer-generated imagery is improved, but display area for live video is reduced
Solution Approach 1:
The system transitions from a two-dimensional display to a three-dimensional spatial arrangement by using the device's depth perception and perspective cues. The split screen is not merely a flat division but incorporates spatial depth information, allowing users to navigate CG imagery while maintaining context of the live video environment.
Solution Approach 2:
The display is segmented into functional zones: one area for live video and another for computer-generated imagery navigation. This segmentation allows simultaneous access to both real-world view and virtual information, improving ease of operation without completely sacrificing live video visibility.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables cost-effective, interactive augmented reality experiences by reducing complexity and cost, facilitating collaboration and synchronization across devices, and enhancing user interaction with real-world environments.
Implementation Method 1
Data can be received from one or more onboard sensors indicating that the device is in motion. The sensor data can be used to synchronize the live video and the information layer as the perspective of video camera view changes due to the motion.
Data Source
AI summary
A device can receive live video of a real-world, physical environment on a touch sensitive surface. One or more objects can be identified in the live video. An information layer can be generated related to the objects. In some implementations, the information layer can include annotations made by a user through the touch sensitive surface. The information layer and live video can be combined in a display of the device. Data can be received from one or more onboard sensors indicating that the device is in motion. The sensor data can be used to synchronize the live video and the information layer as the perspective of video camera view changes due to the motion. The live video and information layer can be shared with other devices over a communication link.