Vehicle Image Area Recognition for Stable Head-Up Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Infrared camera systems in vehicles face instability in image area recognition due to rapid relative motions and occlusions, leading to insecure image display for drivers.

Innovation Solution

An image information processing system that measures variables based on vehicle mode and object position, recognizes stable image areas using first and second image area recognition means, and controls display to show stable image information, even if the initial image area is unstable, by estimating and combining image areas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image area recognition is performed based on infrared camera images, then object detection capability is improved, but image area stability deteriorates due to rapid relative motions and occlusions

Engineering Contradiction:
Improveobject detection capabilityVSAvoidimage area stability
Core Design Contradiction:
ReliabilityVSStability of the object's composition

Solution Approach 1:

The system performs preliminary actions by predicting future image areas based on current motion trends and occlusion patterns. The image area recognition unit anticipates where the object will be located in the next frame, allowing the system to maintain stable tracking even when the object temporarily disappears or becomes occluded. This predictive approach compensates for the instability caused by rapid relative motions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms by continuously monitoring the stability of recognized image areas and adjusting recognition parameters accordingly. When image area instability is detected due to occlusions or rapid motion, the system feeds back this information to modify the recognition algorithm, thereby maintaining reliable object detection despite challenging conditions.

Inventive Principle:
Principle #23Feedback

2Productivity

If high-speed vehicle operation is maintained, then productivity is improved, but image recognition stability deteriorates due to rapid relative motions

Engineering Contradiction:
Improvevehicle operation speedVSAvoidimage recognition stability
Core Design Contradiction:
ProductivityVSStability of the object's composition

Solution Approach 1:

The system applies dynamics by adapting the image recognition process to the current motion state of the vehicle. The image area recognition unit dynamically adjusts its parameters based on detected motion patterns, allowing stable object tracking even during high-speed operation. The system becomes more responsive to rapid changes in relative position when motion is detected, maintaining recognition stability across varying vehicle speeds.

Inventive Principle:
Principle #15Dynamics

3Device complexity

If single image area recognition is used, then device complexity is reduced, but measurement precision deteriorates under unstable conditions

Engineering Contradiction:
Improverecognition system complexityVSAvoidimage area measurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system segments the image area recognition process into multiple functional units: a first image area recognition unit for initial detection and a second image area recognition unit for stability verification. This segmentation allows each unit to specialize in specific aspects of recognition, improving overall measurement precision while keeping individual unit complexity manageable. The divided approach enables cross-validation of recognition results.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system merges the outputs of multiple image area recognition units to produce a final stable image area. By combining the detection results from the first recognition unit with the stability verification from the second recognition unit, the system achieves higher measurement precision than either unit could provide alone, while the integration logic remains relatively simple.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS7672481B2Image information processing system, image information processing method, image information processing program, and automobile
Publication Date: 2010.03.02 QUALCOMM AUTO LTD
  • US7672481B2 patent drawing
  • US7672481B2 patent drawing
  • US7672481B2 patent drawing

AI summary

An image information processing system permits stable display of image information regarding an object on an image display device even if an image area of the object recognized through an infrared camera is unstable. In the image information processing system, a first image area recognition unit recognizes a first image area associated with an object on the basis of a second variable based on the position of the object measured through the infrared camera. Further, a second image area recognition unit estimates the first image area on the basis of a first variable and a second variable based on the running mode of an automobile, and recognizes the estimated image area as a second image area. Then, an image information control unit causes a head-up display to display one or both of the first image information associated with the first image area and the second image information associated with the second image area.