Vehicle Exterior Video Review with Passenger Gaze Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Passengers in vehicles often miss important information due to insufficient time to process external objects or uncertainty about missed exits, highlighting a need for enhanced communication and information sharing between drivers and passengers during travel.
Innovation Solution
A data processing device that receives and displays video recordings of the vehicle's exterior, allowing passengers to select frames of interest and superimpose gaze locations on the video, facilitating conversation and information retrieval through real-time synchronization and content identification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If video recording of vehicle exterior is provided to passengers, then information availability is improved, but device complexity increases
Solution Approach 1:
The data processing device is integrated into the existing vehicle's infotainment system, allowing the same hardware to serve both original entertainment/navigation functions and the new video review function. This multi-functionality approach avoids adding separate dedicated hardware for video recording and playback.
Solution Approach 2:
The system creates digital copies of exterior visual information through video recording by camera devices, storing these copies for later review. This allows passengers to access information without requiring direct real-time viewing of external objects, resolving the information availability issue while using standard digital storage techniques.
2Adaptability or versatility
If frame selection and gaze tracking features are added, then communication effectiveness is improved, but device complexity increases
Solution Approach 1:
The system introduces intermediate digital representations including frame selections and gaze location markers that mediate between passengers' attention and the actual external objects. These intermediaries allow indirect reference to external reality, enabling communication about missed information without requiring direct simultaneous observation.
Solution Approach 2:
The gaze tracking system provides feedback by detecting where passengers look on the display and automatically marking these locations with pointers. This automated feedback mechanism reduces the need for manual annotation and simplifies the interface while improving communication effectiveness.
3Adaptability or versatility
If multiple passengers' gaze information is processed, then collaboration is improved, but measurement precision requirements increase
Solution Approach 1:
The system segments gaze information by individual passenger, creating separate pointer markers for each person's gaze location. This segmentation allows the system to handle multiple passengers' attention independently, tracking and displaying each person's focus point separately on the video frame to facilitate collaboration.
Data Source
Figure 1~2
AI summary
A data processing device (1) for providing a video to a passenger of a vehicle (10) is provided. The data processing device (1) is configured to receive (S1) a video recorded of an outside of the vehicle (10), provide (S2) the video to a display device (2) arranged at an interior of the vehicle (10), receive (S3) frame information identifying a frame of interest of the provided video selected by the passenger via the display device (2), receive (S4) gaze information from a sensor device (4) arranged at the interior of the vehicle (10), the gaze information identifying a gaze location of the passenger with respect to the display device (2) at a time the frame of interest has been selected by the passenger, and control (S5) the display device (2) to display the video and/or the frame of interest superimposed by a first pointer marking the identified gaze location.