In-Vehicle Content Augmentation via External Object Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing content delivery systems in autonomous vehicles are not optimized for the unique autonomous driving experience, failing to leverage dynamic visual object recognition and sensor inputs, resulting in sub-optimal content presentation for passengers.
Innovation Solution
An in-vehicle content presentation apparatus that includes an image processing module, content selection engine, and content rendering module, which recognizes external physical objects using camera images, selects relevant content items, and augments them onto the image for display, creating an augmented reality experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional content delivery systems are used in autonomous vehicles, then the system structure remains simple and familiar, but the content relevance to external physical objects is low and passenger engagement is sub-optimal
Solution Approach 1:
The patent merges the autonomous vehicle's image identification system with the content delivery system. The image processing module that identifies external physical objects (signs, obstacles, POIs) is integrated with the content selection engine, allowing content to be automatically selected and presented based on recognized objects without requiring separate sensing systems
Solution Approach 2:
The existing image identification components of the autonomous vehicle are made multi-functional by enabling them to serve both their original purpose (identifying obstacles and signs for navigation) and a new purpose (identifying objects for content selection and presentation). This eliminates the need for dedicated content delivery hardware
2Adaptability or versatility
If traditional display content formats are used, then the rendering format is simple and compatible with existing displays, but the immersive experience and passenger engagement are limited
Solution Approach 1:
The patent transitions from traditional 2D flat screen content to augmented reality overlays that add a spatial dimension. Content is rendered in the context of the physical environment, with virtual objects positioned relative to real-world objects detected by the vehicle's cameras, creating a multi-layered immersive experience
3Speed
If content is selected based on pre-defined routes and POIs, then the content selection process is simple, but the real-time responsiveness to dynamically recognized objects is poor
Solution Approach 1:
The system maintains continuous operation of the image processing module throughout the vehicle's journey, continuously identifying external physical objects and updating content selections in real-time. This continuous processing ensures no dynamic object information is lost while maintaining fast response through optimized processing pipelines
Data Source
AI summary
In one embodiment, a first image of a physical object external to an autonomous vehicle is received, where the first image is captured by an image sensor attached to the autonomous vehicle. An image recognition is performed on the first image to derive one or more keywords related to the physical object. A list of one or more content items are identified based on the one or more keywords. A first content item selected from the list of content items is augmented onto the first image to generate a second image. The second image is displayed on a display device within the autonomous vehicle.