See-through display alignment using camera feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display technologies for electronic devices do not effectively allow users to view information in a non-invasive, non-intrusive manner while still being able to see objects on the other side of the display, particularly in vehicles, where the alignment of video information with the user's field of view is disrupted by the display's orientation and movement.
Innovation Solution
A see-through display system that aligns video information with the user's field of view, using camera modules to capture and process visual data, allowing for the display of video information on a different display while enabling features like object sharing, identification, and mirror image representation to enhance user experience, particularly in vehicles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If video information is displayed on a see-through display in a vehicle, then users can view information without completely blocking the view of surroundings, but the alignment of video information with the user's field of view is disrupted by the display's orientation and movement
Solution Approach 1:
The system continuously tracks the display's orientation and position using sensors (accelerometers, gyroscopes, magnetometers) and uses this feedback to dynamically adjust the video information alignment. The processor receives sensor data, determines display orientation and position, and transforms video coordinates accordingly to maintain proper alignment with the user's field of view despite display movement or rotation.
Solution Approach 2:
The system transitions from static video display to dynamic adaptive display. The video information alignment is continuously adjusted based on real-time sensor data about display orientation and position. The system adapts to changing conditions (display rotation, vehicle movement) by dynamically transforming video coordinates to maintain proper alignment with the user's perspective.
2Loss of information
If a see-through display is used to show video information, then users can access information, but the display may obstruct the user's view of objects on the other side
Solution Approach 1:
The system enhances specific local areas of the display where objects are detected, rather than uniformly obscuring the entire display. When an object is identified in the scene, video information or annotations are overlaid only in the relevant local region, allowing users to access information about specific objects without completely blocking their view of the surrounding environment.
3Device complexity
If video information is displayed without alignment correction, then the display system is simpler, but the user experience is degraded due to misalignment with field of view
Solution Approach 1:
The system combines multiple functions into a single integrated display system: the see-through display simultaneously presents the real-world view and overlaid video information, the sensor suite (accelerometers, gyroscopes, magnetometers) serves multiple purposes for orientation detection, and the processor performs both object detection and video alignment transformation. This multi-functional integration manages complexity while delivering enhanced user experience.
Data Source
Figure 1~2
Figure 3
Figure 4A~4B
AI summary
A method comprising receiving information indicative of an object sharing input, receiving video information from a camera module that is configured to have a field of capture that corresponds with a field of view through a see through display, identifying at least one object representation comprised by the video information, the object representation being a visual representation of an object that within the field of view of the see through display, causing display of the video information on a different display, determining that the video information fails to comprise the object representation, and terminating display of the video information on the different display based, at least in part, on the determination that the video information fails to comprise the object representation is disclosed.