Vehicle Display Image Correction Using Occupant Vision Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display devices for vehicles struggle to efficiently correct image distortion on curved instrument panels due to variations in panel profiles and assembly inconsistencies, leading to increased time and effort in achieving accurate image projection.

Innovation Solution

A display control device that includes an output section, an acquisition section, a detection section, and a correction section, which outputs images to a projection unit, acquires vision information from the occupant, detects misalignment between the projected image and a design-reference state, and corrects the image in real-time based on this information, using feature points and iris authentication to ensure precise alignment and notification of significant misalignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional image projection methods are used on curved instrument panels, then image distortion occurs due to panel profile variations and assembly inconsistencies, but adding complex correction hardware increases device complexity and cost

Engineering Contradiction:
Improveimage projection accuracyVSAvoidcorrection system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system uses the occupant's own eye position information, automatically captured by the vision information acquisition unit, to detect and correct image misalignment. The occupant serves themselves as the reference point for correction without requiring external calibration tools or complex additional hardware

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes the parameter being used for alignment from physical measurement tools to vision information (eye position data). By transforming the correction basis from mechanical/physical parameters to optical/biological parameters, the system achieves accurate correction without complex mechanical correction hardware

Inventive Principle:
Principle #35Parameter changes

2Loss of time

If manual alignment methods are used during assembly, then correction time is extended, but automated vision-based detection requires additional sensors and processing complexity

Engineering Contradiction:
Improveimage correction timeVSAvoidvision information acquisition system
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The vision information acquisition unit serves multiple functions: it captures the occupant's eye position for alignment correction, and can simultaneously be used for other vehicle systems such as driver monitoring, authentication, or attention detection. This multi-functionality justifies the added system complexity by providing multiple benefits from a single hardware addition

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system establishes a real-time feedback loop where the occupant's eye position is continuously monitored, compared against the ideal position, and used to dynamically adjust the image projection. This automated feedback mechanism eliminates manual alignment time while the processing complexity is managed through software algorithms

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the occupant must fixate on multiple feature points for correction, then measurement precision improves, but the operation becomes more complex and time-consuming

Engineering Contradiction:
Improvemisalignment detection accuracyVSAvoidoccupant operation simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The correction process is segmented into discrete feature points that are presented sequentially to the occupant rather than requiring simultaneous observation of multiple points. This segmentation makes the task more manageable and less cognitively demanding while still achieving comprehensive alignment coverage

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses periodic presentation of feature points in a structured sequence, where the occupant fixates on each point in turn. This periodic, rhythmic interaction pattern simplifies the operation by creating a predictable and repeatable process, reducing the cognitive load on the occupant

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11477421B2Display control device, image correction method, and recording medium recorded with program
Publication Date: 2022.10.18 TOYOTA JIDOSHA KK
  • US11477421B2 patent drawing
  • US11477421B2 patent drawing
  • US11477421B2 patent drawing

AI summary

A display control device includes a processor. The processor being configured to: output an image to a projection unit for projecting an image onto an interior surface of a vehicle; acquire vision information of an occupant of the vehicle; detect misalignment between a target image projected onto the interior surface and a design-reference state of the target image based on vision information acquired while the occupant fixates on the target image projected onto the interior surface; and correct an image projected by the projection unit based on the misalignment.