AR Touchscreen Vehicle Window for Real-Time Learning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Occupants of vehicles experience boredom and difficulty in learning about surrounding environment elements during travel due to lack of interactive and efficient information retrieval methods, which can be cumbersome and unhealthy, especially for children.
Innovation Solution
An in-vehicle augmented reality system processes image data from vehicle cameras to identify elements of interest and project relevant information on windows, allowing passengers to interact, learn, and share content in a fun and educational manner.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If occupants use tablets or smartphones for entertainment during vehicle travel, then entertainment availability is improved, but occupant health deteriorates due to harmful usage patterns
Solution Approach 1:
The patent introduces an augmented reality window as an intermediary device that projects information about surrounding environment elements directly into the passenger's field of view. This mediator eliminates the need for handheld devices by providing entertainment and educational content through the window itself, thereby maintaining health while achieving entertainment availability.
2Loss of information
If passengers want to learn about surrounding environment elements during travel, then educational value is improved, but time required for information retrieval deteriorates due to cumbersome search processes
Solution Approach 1:
The system performs preliminary actions by continuously capturing images of the surrounding environment with vehicle-mounted cameras and pre-identifying elements of interest before the passenger even asks. When a passenger selects an element, the information is already prepared and can be instantly displayed, eliminating the need for time-consuming manual search processes.
Solution Approach 2:
The augmented reality system enables self-service by automatically detecting and identifying surrounding environment elements, retrieving relevant information from databases, and presenting it to passengers without requiring manual intervention. The system serves itself by handling the entire information retrieval process autonomously, from image capture to information display.
3Speed
If the vehicle is moving at speed, then travel efficiency is improved, but the ability to capture clear images of surrounding elements deteriorates due to motion blur
Solution Approach 1:
The system maintains continuity of useful action by continuously capturing images at high frame rates while the vehicle is moving. Rather than attempting to capture single static images, the system continuously records video frames, ensuring that clear images of surrounding elements are captured at appropriate moments despite vehicle motion. This continuous capture approach maintains image quality while preserving travel speed.
Data Source
AI summary
The current disclosure provides systems and methods for allowing passengers of a vehicle to interact with a surrounding environment in educational and entertaining ways, using an augmented reality (AR) touchscreen window. The passenger may select an element of the surrounding environment by touching a location of the element on the AR window. An image of the element may be captured and displayed in a portion of the AR window, along with information about the element retrieved from the Internet. The passenger can select the image using the touchscreen of the AR window to view an Internet browser with additional information about the selected element. Additionally, the passenger can edit the information and/or add further annotations, attach additional images, audio and/or video clips, etc. to generate a mixed-media content that can be shared or stored in a cloud-based storage to be reviewed at a later time.


