In-Vehicle Gaze-Tracked Scene Capture for Extended Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing approaches for capturing and displaying visual data in vehicles are limited, as they require manual operation of recording devices, focus on interior selfies, or merely display blocked views without targeting and tracking capabilities.
Innovation Solution
The system tracks a user's gaze to identify objects of interest outside the vehicle, such as roadside billboards, and automatically captures and display these objects on in-vehicle displays or extended displays, even after they have moved out of view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual operation of recording devices is required, then capture control is simple, but user hands are occupied and experience is reduced
Solution Approach 1:
The system enables self-service capture by automatically detecting user gaze direction and triggering cameras without manual intervention. The gaze detection system monitors where the user is looking and autonomously captures visual data from that direction, freeing the user's hands for enjoying the experience while maintaining simple operation through automatic activation.
Solution Approach 2:
The patent replaces manual mechanical operation with automated gaze-based control. Instead of physically handling recording devices, the system uses gaze detection technology to automatically determine capture direction and trigger cameras, substituting the mechanical interaction with an optical/biological signal-based system.
2Extent of automation
If gaze tracking is used to guide camera direction, then capture direction is automated, but capture is limited to gaze direction only
Solution Approach 1:
The system achieves multi-functionality by combining multiple capture modes: gaze-directed capture for automatic operation, gesture-triggered capture for intentional snapshots, and continuous recording for comprehensive documentation. This allows the system to adapt to different user needs and scenarios, providing both automated and flexible capture options.
Solution Approach 2:
The capture system dynamically adjusts its behavior based on detected user actions. It transitions between different operational states including gaze-following mode, gesture-activated mode, and continuous recording mode, allowing the system to be both automated when appropriate and flexible when needed.
3Adaptability or versatility
If interior cameras are used for selfies, then passenger capture is enabled, but exterior scene capture is limited
Solution Approach 1:
The camera system is segmented into multiple independent cameras positioned at different locations and orientations within the vehicle. This includes interior cameras for passenger capture and exterior-facing cameras for scene capture, allowing each camera to specialize in its function while the system as a whole provides comprehensive coverage through coordinated operation.
4Loss of information
If A-pillar displays show blocked views, then blind spot is eliminated, but display content is static and not targeted
Solution Approach 1:
The display system incorporates feedback mechanisms by using gaze detection to determine what content should be displayed on A-pillar screens. The system continuously monitors user gaze direction and adjusts display content accordingly, showing relevant exterior scenes or information that matches user interest rather than static predetermined content.
Solution Approach 2:
The A-pillar display content dynamically changes based on real-time gaze detection and scene analysis. Rather than displaying static images, the system continuously updates display content to reflect current user interest and external conditions, making the display adaptive and context-aware.
5Area of stationary object
If multiple cameras are deployed for comprehensive capture, then scene coverage is improved, but system complexity increases
Solution Approach 1:
The system merges multiple camera feeds and data streams into a unified processing pipeline. By combining interior cameras, exterior cameras, gaze detection data, and gesture recognition into a single integrated system controlled by one processor, the patent reduces operational complexity while maintaining comprehensive scene coverage through coordinated multi-camera operation.
Data Source
AI summary
Methods and systems are described for imaging and content generation. During a road trip, a driver or passenger observes an object or scene from a vehicle. From a perspective of the driver or passenger, the object or scene flows out of view in a relatively short amount of time. Images and video of the object or scene are captured with cameras. A field of view is extended beyond what the driver or passenger can easily observe. The capture is configurable to focus on particular types of objects or scenes. Recordings of billboards and road signs are easily displayed after passing the object. Object identification, gaze determination, and interest determination are provided. Curated content is generated. Applications to extended reality environments are provided. Artificial intelligence systems, including neural networks, and models are utilized to improve the imaging and content generation. Related apparatuses, devices, techniques, and articles are also described.