Driver-Assistance Device Using Head-Tracking for Virtual Surround Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current driver-assistance systems lack the ability to intuitively present surrounding environmental information to drivers in a manner that aligns with their line of sight, leading to potential discomfort and reduced safety due to the need for frequent head movements and limited field of view.
Innovation Solution
A driver-assistance device that includes a processor to acquire line-of-sight information and image data, setting display positions and contents based on this information to project virtual bird's-eye, rear, and side views onto the vehicle's interior or a wearable device, allowing drivers to easily grasp their surroundings without neck strain and with an expanded visual field.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If drivers use conventional mirrors (inner mirror, outer mirror) to view surroundings, then they can see rear and side views, but they experience neck strain and limited field of view requiring frequent head movements
Solution Approach 1:
The patent transitions from 2D mirror reflections to a 3D virtual reality environment, allowing drivers to view surrounding areas (rear, side, blind spots) from multiple perspectives simultaneously. The head-tracking technology enables the virtual camera to capture images from different spatial positions, creating an immersive three-dimensional viewing experience that eliminates the need for physical head movements to check different areas.
Solution Approach 2:
The system creates virtual copies of the driver's line of sight by using head-tracking to determine where the driver is looking and generating corresponding virtual images. The image generation unit produces virtual images that replicate what the driver would see if they physically turned their head, allowing them to view surrounding areas without actual head movement.
2Loss of information
If drivers frequently move their heads to check surroundings, then they can gather environmental information, but their safety is reduced due to distraction and neck strain
Solution Approach 1:
The system proactively provides environmental information before the driver needs to request it. The head-tracking unit continuously monitors driver gaze direction, and the image generation unit pre-renders virtual images of surrounding areas based on predicted line of sight, so that information is immediately available when the driver looks in a particular direction, eliminating the need for reactive head movements.
Solution Approach 2:
The patent introduces a virtual reality display system as an intermediary between the driver and the external environment. Instead of directly turning their head to view surroundings, drivers interact with a virtual representation of their environment that is generated based on their gaze direction, allowing them to gather environmental information while maintaining their primary focus on the road.
3Ease of operation
If the system displays images based on driver's line of sight, then information is presented intuitively, but the system complexity increases due to head-tracking and dynamic image generation
Solution Approach 1:
The head-tracking unit serves multiple functions: it detects driver gaze direction, determines line of sight for image generation, and enables the virtual reality system to adapt to different viewing positions. The image generation unit also performs multiple tasks by creating virtual images from captured images, applying perspective transformations, and rendering views from different spatial positions, reducing the need for separate dedicated components.
Solution Approach 2:
The patent replaces physical mechanical systems (conventional mirrors, head movements) with electronic and software-based solutions. Instead of using physical mirrors to reflect images, the system uses image capture devices combined with virtual reality processing. The mechanical head movements are replaced by electronic head-tracking sensors that detect gaze direction and trigger corresponding virtual image generation.
Data Source
AI summary
A driver-assistance device includes: a memory; and a processor including hardware. The processor is configured to: acquire both line-of-sight information on a line of sight of a driver and image data resulting from imaging surroundings of a vehicle; set a display position and display contents of an image generated from the image data based on the line-of-sight information; and output the display position and the display contents together with the image.