Vehicle Camera Image Processing for Projected Pattern Removal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In vehicles equipped with projection devices for traffic safety, the notification patterns projected on the road surface can be mistakenly recognized as parking lines on captured images, leading to incorrect driver recognition and parking issues.

Innovation Solution

A control device that includes an image processor to remove the notification pattern from captured images by storing the pattern, calculating differences between images with and without the pattern, or projecting it at specific positions to identify and store the pattern, ensuring it is not imprinted on the image displayed to the driver.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a projection device projects a notification pattern on the road surface to notify third parties of vehicle behavior, then traffic safety is improved, but the notification pattern may be imprinted on captured images and cause driver misrecognition

Engineering Contradiction:
Improvetraffic safetyVSAvoidimage accuracy
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The image processing unit extracts and removes the notification pattern from the captured image by comparing it with stored reference patterns. This separates the harmful imprint from the useful image information, allowing the notification function to continue while preventing driver misrecognition.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

A reference pattern storage unit acts as an intermediary between the projection device and the image display. It stores templates of notification patterns that are projected, enabling the image processing unit to accurately identify and remove these patterns from captured images through pattern matching.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the notification pattern is projected on the road surface, then third parties can recognize vehicle behavior, but the driver may erroneously recognize the notification pattern as parking lines

Engineering Contradiction:
Improvevehicle behavior notificationVSAvoidpattern recognition accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system uses feedback from captured images to detect when a notification pattern is imprinted on the road surface. The image processing unit continuously monitors the captured images, compares them with stored reference patterns, and removes the notification pattern when detected, preventing driver misrecognition while maintaining the notification function.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system creates copies of the notification patterns in the form of reference patterns stored in the storage unit. These reference copies are used for comparison and identification purposes, allowing the system to recognize and remove the actual notification patterns from captured images without affecting the original projection function.

Inventive Principle:
Principle #26Copying

3Area of stationary object

If the captured image includes both the notification pattern and parking lines, then the imaging device captures the full scene, but the driver cannot distinguish between the notification pattern and parking lines

Engineering Contradiction:
Improveimaging coverageVSAvoidpattern distinction
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The image processing unit extracts the notification pattern from the captured image by comparing it with stored reference patterns and removes it through image processing. This maintains the full imaging coverage while selectively eliminating the confusing notification pattern, leaving only the parking lines and other relevant scene information.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system can change the color or appearance of the notification pattern in the processed image to distinguish it from parking lines. By modifying the visual characteristics of the notification pattern in the displayed image, the system maintains full scene coverage while preventing driver misrecognition through enhanced pattern differentiation.

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS20240278714A1Control device for vehicle
Publication Date: 2024.08.22 KOITO MFG CO LTD
  • US20240278714A1 patent drawing
  • US20240278714A1 patent drawing
  • US20240278714A1 patent drawing

AI summary

Provided is a control device capable of acquiring an image from which a notification pattern has been removed in a vehicle including a projection device that projects the notification pattern on a road surface and an imaging device. A projection device 20 (rear projector RP) that projects a required notification pattern (CP) on a region in the vicinity of an automobile CAR and an imaging device 10 including a rear camera RC that images the region in the vicinity of the automobile CAR are provided. A control device 100 includes an image processing unit 12 that acquires an image on which the notification pattern (CP) is not imprinted. The acquired image is displayed on a monitor MO. Alternatively, driving assistance is performed based on the acquired image.