AR Touchscreen Vehicle Window for Real-Time Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Occupants of vehicles experience boredom and difficulty in learning about surrounding environment elements during travel due to lack of interactive and efficient information retrieval methods, which can be cumbersome and unhealthy, especially for children.

Innovation Solution

An in-vehicle augmented reality system processes image data from vehicle cameras to identify elements of interest and project relevant information on windows, allowing passengers to interact, learn, and share content in a fun and educational manner.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If occupants use tablets or smartphones for entertainment during vehicle travel, then entertainment availability is improved, but occupant health deteriorates due to harmful usage patterns

Engineering Contradiction:
Improveentertainment availabilityVSAvoidoccupant health
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an augmented reality window as an intermediary device that projects information about surrounding environment elements directly into the passenger's field of view. This mediator eliminates the need for handheld devices by providing entertainment and educational content through the window itself, thereby maintaining health while achieving entertainment availability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If passengers want to learn about surrounding environment elements during travel, then educational value is improved, but time required for information retrieval deteriorates due to cumbersome search processes

Engineering Contradiction:
Improveeducational valueVSAvoidinformation retrieval time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by continuously capturing images of the surrounding environment with vehicle-mounted cameras and pre-identifying elements of interest before the passenger even asks. When a passenger selects an element, the information is already prepared and can be instantly displayed, eliminating the need for time-consuming manual search processes.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The augmented reality system enables self-service by automatically detecting and identifying surrounding environment elements, retrieving relevant information from databases, and presenting it to passengers without requiring manual intervention. The system serves itself by handling the entire information retrieval process autonomously, from image capture to information display.

Inventive Principle:
Principle #25Self-service

3Speed

If the vehicle is moving at speed, then travel efficiency is improved, but the ability to capture clear images of surrounding elements deteriorates due to motion blur

Engineering Contradiction:
Improvevehicle speedVSAvoidimage quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The system maintains continuity of useful action by continuously capturing images at high frame rates while the vehicle is moving. Rather than attempting to capture single static images, the system continuously records video frames, ensuring that clear images of surrounding elements are captured at appropriate moments despite vehicle motion. This continuous capture approach maintains image quality while preserving travel speed.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12536808B2Vehicle in-cabin learning experience using augmented reality
Publication Date: 2026.01.27 HARMAN INT IND INC
  • US12536808B2 patent drawing
  • US12536808B2 patent drawing
  • US12536808B2 patent drawing

AI summary

The current disclosure provides systems and methods for allowing passengers of a vehicle to interact with a surrounding environment in educational and entertaining ways, using an augmented reality (AR) touchscreen window. The passenger may select an element of the surrounding environment by touching a location of the element on the AR window. An image of the element may be captured and displayed in a portion of the AR window, along with information about the element retrieved from the Internet. The passenger can select the image using the touchscreen of the AR window to view an Internet browser with additional information about the selected element. Additionally, the passenger can edit the information and/or add further annotations, attach additional images, audio and/or video clips, etc. to generate a mixed-media content that can be shared or stored in a cloud-based storage to be reviewed at a later time.