Vehicle Experience System Synchronizing Audio and Visual Outputs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing automated driving technologies do not consider the entertainment of vehicle passengers, lacking solutions to engage them during travel.
Innovation Solution
An experience providing system that includes a passenger information detector, an outside information detector, a virtual image generator, and a provider to synchronize sound and display outputs, creating interactive and immersive experiences for passengers by generating virtual images and adjusting interactions based on passenger and external situation data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If automated driving technology is implemented, then driving safety and efficiency are improved, but passenger entertainment and engagement are neglected
Solution Approach 1:
The automated driving system is enhanced with multiple functions beyond basic driving control. The system integrates passenger information detection (cameras, microphones, sensors), virtual image generation (AR/VR displays), and interactive content delivery, transforming the vehicle into a multi-functional platform that simultaneously ensures safe automated driving and provides engaging entertainment experiences for passengers.
2Adaptability or versatility
If virtual images and synchronized sound are generated for passenger entertainment, then passenger engagement is improved, but system complexity increases
Solution Approach 1:
The entertainment system is divided into independent functional modules: passenger information detection module (sensors, cameras, microphones), virtual image generation module (AR/VR processing), sound output module (speakers, audio processing), and synchronization control module. Each module operates independently but communicates through standardized interfaces, reducing overall system complexity while maintaining comprehensive entertainment functionality.
Solution Approach 2:
A synchronization controller acts as an intermediary between the virtual image generator and sound output system. This mediator coordinates the timing and content of visual and audio outputs, ensuring they are properly synchronized without requiring direct complex integration between all system components, thereby simplifying the overall system architecture.
3Adaptability or versatility
If multiple sensors and detectors are added to detect passenger and outside information, then interaction quality is improved, but cost increases
Solution Approach 1:
Existing automated driving sensors (cameras, LIDAR, microphones, occupancy detectors) are repurposed to serve dual functions: maintaining driving safety monitoring and enabling passenger entertainment interactions. This eliminates the need to add numerous dedicated entertainment-only sensors, reducing component quantity while maintaining high interaction quality through the existing sensor network.
Data Source
AI summary
An experience providing system includes: a passenger information detector configured to detect information regarding a passenger of a vehicle; an outside information detector configured to detect information outside the vehicle; an output section configured to output sound; a virtual image generator configured to output display; and a provider configured to dynamically provide an interaction to the passenger of the vehicle by causing the sound output from the output section to be synchronized with the display output from the virtual image generator on the basis of detection results of the passenger information detector and the outside information detector.